-- Logs begin at Tue 2022-07-12 11:06:36 UTC, end at Tue 2022-07-12 12:09:59 UTC. -- Jul 12 11:38:32.145533 n-d-849104-4 systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 11:38:32.154202 n-d-849104-4 devstack@n-api.service[110641]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 11:38:32.156289 n-d-849104-4 devstack@n-api.service[110641]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 11:38:32 2022] *** Jul 12 11:38:32.156289 n-d-849104-4 devstack@n-api.service[110641]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 11:38:32.156289 n-d-849104-4 devstack@n-api.service[110641]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 11:38:32.156289 n-d-849104-4 devstack@n-api.service[110641]: nodename: n-d-849104-4 Jul 12 11:38:32.156289 n-d-849104-4 devstack@n-api.service[110641]: machine: x86_64 Jul 12 11:38:32.156289 n-d-849104-4 devstack@n-api.service[110641]: clock source: unix Jul 12 11:38:32.156289 n-d-849104-4 devstack@n-api.service[110641]: pcre jit disabled Jul 12 11:38:32.156289 n-d-849104-4 devstack@n-api.service[110641]: detected number of CPU cores: 4 Jul 12 11:38:32.156289 n-d-849104-4 devstack@n-api.service[110641]: current working directory: / Jul 12 11:38:32.156289 n-d-849104-4 devstack@n-api.service[110641]: detected binary path: /usr/bin/uwsgi-core Jul 12 11:38:32.157000 n-d-849104-4 devstack@n-api.service[110641]: your processes number limit is 47680 Jul 12 11:38:32.157000 n-d-849104-4 devstack@n-api.service[110641]: your memory page size is 4096 bytes Jul 12 11:38:32.157000 n-d-849104-4 devstack@n-api.service[110641]: detected max file descriptor number: 2048 Jul 12 11:38:32.157000 n-d-849104-4 devstack@n-api.service[110641]: lock engine: pthread robust mutexes Jul 12 11:38:32.157000 n-d-849104-4 devstack@n-api.service[110641]: thunder lock: enabled Jul 12 11:38:32.157000 n-d-849104-4 devstack@n-api.service[110641]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 11:38:32.157000 n-d-849104-4 devstack@n-api.service[110641]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 11:38:32.200454 n-d-849104-4 devstack@n-api.service[110641]: Python main interpreter initialized at 0x55643acd09c0 Jul 12 11:38:32.200454 n-d-849104-4 devstack@n-api.service[110641]: python threads support enabled Jul 12 11:38:32.200454 n-d-849104-4 devstack@n-api.service[110641]: your server socket listen backlog is limited to 100 connections Jul 12 11:38:32.200720 n-d-849104-4 devstack@n-api.service[110641]: your mercy for graceful operations on workers is 90 seconds Jul 12 11:38:32.200797 n-d-849104-4 devstack@n-api.service[110641]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 11:38:32.200872 n-d-849104-4 devstack@n-api.service[110641]: *** Operational MODE: preforking *** Jul 12 11:38:32.201127 n-d-849104-4 devstack@n-api.service[110641]: *** uWSGI is running in multiple interpreter mode *** Jul 12 11:38:32.201127 n-d-849104-4 devstack@n-api.service[110641]: spawned uWSGI master process (pid: 110641) Jul 12 11:38:32.201320 n-d-849104-4 systemd[1]: Started Devstack devstack@n-api.service. Jul 12 11:38:32.202395 n-d-849104-4 devstack@n-api.service[110641]: spawned uWSGI worker 1 (pid: 110642, cores: 1) Jul 12 11:38:32.202395 n-d-849104-4 devstack@n-api.service[110641]: spawned uWSGI worker 2 (pid: 110643, cores: 1) Jul 12 11:38:32.202395 n-d-849104-4 devstack@n-api.service[110641]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 11:38:32.864161 n-d-849104-4 devstack@n-api.service[110643]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 11:38:32.869932 n-d-849104-4 devstack@n-api.service[110642]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 11:38:33.987163 n-d-849104-4 devstack@n-api.service[110642]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 11:38:33.987163 n-d-849104-4 devstack@n-api.service[110642]: from cryptography.utils import int_from_bytes Jul 12 11:38:33.987849 n-d-849104-4 devstack@n-api.service[110642]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 11:38:33.987849 n-d-849104-4 devstack@n-api.service[110642]: from cryptography.utils import int_from_bytes Jul 12 11:38:33.988092 n-d-849104-4 devstack@n-api.service[110643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 11:38:33.988092 n-d-849104-4 devstack@n-api.service[110643]: from cryptography.utils import int_from_bytes Jul 12 11:38:33.988560 n-d-849104-4 devstack@n-api.service[110643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 11:38:33.988560 n-d-849104-4 devstack@n-api.service[110643]: from cryptography.utils import int_from_bytes Jul 12 11:38:36.482987 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 11:38:36.483598 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 11:38:36.483698 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 11:38:36.483698 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 11:38:36.484137 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 11:38:36.484137 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 11:38:36.484276 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 11:38:36.484356 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 11:38:36.484524 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 11:38:36.484672 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.484788 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 11:38:36.485003 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.485179 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.485328 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.485509 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.485649 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.485834 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.485984 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.486154 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.486298 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.486485 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.486622 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.486796 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.486974 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.487144 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.487312 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.487467 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.487562 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.487795 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.487888 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.488080 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.488227 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-849104-4 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.488402 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.488553 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.488727 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-849104-4 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.488863 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.489050 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.489176 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.489362 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.489488 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.489674 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.489805 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.489990 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.490116 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.490301 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.490444 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.490625 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.490874 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.491020 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.491318 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.492256 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.492394 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.492519 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.492648 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.492769 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.492889 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.493011 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.493149 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.493262 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.493380 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.493499 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.493618 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.493736 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.493937 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.494049 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.494167 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.494539 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.494651 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.494791 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.494791 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.494996 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-849104-4 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.494996 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.495233 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-849104-4 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.495343 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.495461 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.495618 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.495751 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.495998 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.496144 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.496361 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.496495 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.496675 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.496808 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.496999 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.497124 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.497331 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.497465 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.497641 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.497773 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.497948 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.498071 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.498278 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.498426 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.498596 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.498720 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.498912 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.499036 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.499214 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.499337 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.499524 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.499657 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.499830 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.499962 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.500168 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.500296 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.500500 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.500633 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.500756 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.500884 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.501014 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.501216 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.501374 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.501499 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.501621 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.501748 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.501913 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.502038 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.502235 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.502363 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.503013 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.503149 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.503274 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.503395 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.503561 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.503688 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.503883 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.504011 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.504228 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.504358 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.504537 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.504666 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.504842 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.504966 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.505148 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.505271 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.505454 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.505587 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.505746 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.505872 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.506050 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.506173 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.506356 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.506487 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.506660 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.506796 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.506976 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.507109 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.507293 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.507426 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.507600 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.507722 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.507908 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.508050 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.508254 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.508393 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.508572 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.508697 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.508884 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.509010 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.509188 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.509320 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.509528 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.509653 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.509835 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.509958 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.510144 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.510268 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.510465 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.510662 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.510786 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.510915 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.511047 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.511175 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.511355 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.511479 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.511661 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.511785 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.511987 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.512135 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.512333 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.512455 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.512580 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.512700 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.512874 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.513006 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.513178 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.513301 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.513479 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.513610 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.513791 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.513918 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.514095 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.514219 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.514399 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.514534 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.514700 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.514834 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.514997 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.515127 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.515300 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.515431 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.515602 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.515724 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.515905 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.516102 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.516227 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.516359 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.516528 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.516659 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.516831 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.516954 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.517134 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.517265 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.517437 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.517589 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.517739 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.517870 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.518057 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.518772 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.518899 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.519018 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.519211 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.519343 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.519516 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.519640 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.519821 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.520019 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.520177 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.520305 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.520463 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.520595 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.520793 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.520915 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.521045 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.521167 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.521356 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.521482 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.521662 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.521787 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.521971 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.522123 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.522278 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.522402 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.522581 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.522706 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.522888 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.523014 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.523189 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.523312 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.523492 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.523619 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.523798 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.523923 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.524109 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.524228 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.524421 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.524545 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.524722 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.524852 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.525024 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.525158 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.525324 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.525448 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.525627 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.525763 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.525928 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.526052 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.526230 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.526352 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.526530 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.526663 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.526829 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.526956 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.527148 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.527273 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.527456 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.527600 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.527762 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.527892 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.528087 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.528215 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.528423 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.528561 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.528684 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:38:36.528812 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.529021 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.529146 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.529357 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.529483 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.529686 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.529809 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.530002 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.530125 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.530337 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.530472 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.530655 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.530792 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.530977 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.531102 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.531273 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.531399 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.531586 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.531716 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.531903 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.532063 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.532243 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.532378 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.532554 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.532677 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.532868 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.533002 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.533185 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.533307 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.533501 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.533639 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.533851 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.533985 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.534169 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.534293 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.534489 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.534612 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.534803 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.534941 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.535112 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.535237 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.535432 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.535557 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.535752 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.535884 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.536090 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.536219 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.536407 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.536542 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.536750 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.536885 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.537068 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.537191 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.537397 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.537528 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.537719 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.537843 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.538032 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.538156 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.538342 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.538465 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.538652 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.538776 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.538960 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.539083 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.539283 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.539409 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.539597 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.539721 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.539913 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.540069 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.540251 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.540375 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.540564 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.540689 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.540877 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.541012 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.541195 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.541399 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.541532 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.541650 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.541785 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.541911 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.542121 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.542253 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.542437 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.542562 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.542748 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.542871 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.543059 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.543188 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.543369 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.543493 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.543679 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.543810 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.543988 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.544164 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.544322 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.544454 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.544626 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.544757 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.544931 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.545064 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.545235 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.545359 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.545540 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.545672 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.545842 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.545966 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.546164 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.546297 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.546472 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.546604 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.546785 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.546909 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.547104 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.547234 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.547410 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.547532 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.547721 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.547844 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.548079 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.548207 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.548364 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.548489 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.548668 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.548793 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.548977 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.549099 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.549285 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.549447 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.549619 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.549745 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.549937 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.550069 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.550245 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.550377 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.550552 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.550677 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.550861 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.550985 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.551238 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.551381 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.551505 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.551624 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.551772 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.551888 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.552107 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.552247 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.552424 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.552548 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.552735 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.552858 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.553042 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.553166 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.553365 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.553487 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.553677 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.553813 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.553990 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.554124 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.554324 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.554449 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.554630 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.554753 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.554949 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.555075 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.555274 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.555403 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.555595 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.555719 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.555906 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.556071 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.556236 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.556367 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.556542 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.556673 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.556844 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.556974 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.557150 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.557284 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.557456 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.557590 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.557758 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.557880 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.558059 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.558182 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.558364 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.558497 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.558667 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.558797 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.558970 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.559103 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.559271 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.559403 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.559591 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.559715 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.559894 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.560016 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.560224 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.560350 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.560530 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.560653 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.560833 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.560956 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.561170 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.561309 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.561492 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.561623 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.561798 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.561921 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.562137 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.562261 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.562459 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.562583 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.562771 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.562886 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.563095 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.563209 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.563391 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.563516 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.563700 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.563832 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.564010 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.564162 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.564345 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.564476 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.564657 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.564791 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.565488 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.565621 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.565803 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.565926 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.566116 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.566248 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.566425 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.566549 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.566740 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.566873 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.567049 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.567186 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.567354 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.567477 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.567657 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.567794 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.567974 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.568137 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.568340 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.568466 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.568659 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.568784 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.568977 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.569101 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.569290 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.569413 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.569598 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.569729 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.569908 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.570042 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.570216 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.570340 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.570525 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.570655 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.570852 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.570975 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.571131 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.571264 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.571443 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.571639 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.571773 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.571896 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.572082 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.572292 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.572418 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.572548 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.572704 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.572837 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.573015 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.573140 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.573318 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.573451 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.573625 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.573748 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.573939 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.574065 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.574267 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.574401 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.574577 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.574700 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.574892 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.575017 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.575200 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.575333 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.575516 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.575646 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.575824 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.575948 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.576162 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.576288 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.576473 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.576605 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.576802 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.576933 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.577064 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.577188 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.577363 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.577489 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.577679 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.577811 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.577991 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.578124 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.578297 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.578428 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.578603 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.578729 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.578912 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.579036 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.579220 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.579343 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.579525 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.579691 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.579815 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.579942 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.580146 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.580275 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.580470 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.580643 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.581362 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.581504 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.581689 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.581810 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.582000 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.582142 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.582309 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.582442 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.582619 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.582743 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.582932 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.583064 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.583239 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.583362 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.583543 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.583666 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.583846 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.583988 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.584180 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.584305 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.584518 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.584653 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.584828 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.584976 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.585202 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.585348 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.585472 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.585601 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.585736 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.585858 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.586040 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.586165 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.586358 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.586491 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.586668 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.586791 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.586979 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.587101 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.587303 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.587425 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.587614 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.587745 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.587926 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.588094 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.588265 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.588405 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.588577 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.588700 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.588889 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.589012 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.589198 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.589334 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.589518 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.589653 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.589824 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.589947 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.590135 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.590266 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.590444 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.590574 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.590751 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.590875 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.591063 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.591200 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.591383 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.591636 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.591958 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.592121 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.592317 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.592441 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.592631 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.592763 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.592951 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.593080 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.593272 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.593398 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.593595 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.593721 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.593927 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.594051 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.594253 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.594383 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.594571 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.594708 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.594891 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.595084 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.595217 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.595338 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.595538 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.595662 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.595782 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.595903 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.596106 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.596265 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.596445 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.596579 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.596757 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.596891 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.597062 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.597186 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.597368 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.597492 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.597670 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.597801 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.597979 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.598104 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.598281 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.598413 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.598587 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.598720 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.598892 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.599028 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.599195 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.599319 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.599502 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.599624 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.599805 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.599939 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.600153 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.600290 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.600464 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.600587 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.600770 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.600906 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.601075 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.601200 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.601380 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.601505 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.601716 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.601848 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.602046 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.602170 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.602348 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.602475 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.602679 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.602806 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.603003 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.603126 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.603313 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.603439 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.603617 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.603743 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.603936 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.604079 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.604270 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.604396 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.604579 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.604706 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.604893 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.605017 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.605205 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.605339 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.605512 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.605636 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.605816 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.605942 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.606127 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.606263 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.606434 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.606560 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.606745 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.606869 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.607052 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.607184 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.607357 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.607490 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.607665 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.607790 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.607970 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.608145 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.608310 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.608434 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.608619 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.608752 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.608923 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.609049 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.609231 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.609356 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.609539 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.609663 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.609848 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.609974 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.610149 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.610272 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.610453 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.610575 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.610754 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.610879 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.611067 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.611190 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.611369 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.611500 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.611676 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.611823 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.612006 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.612269 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.612397 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.612523 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.612651 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.612775 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.612929 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.613054 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.613249 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.613385 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.613558 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.613682 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.613863 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.613987 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.614165 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.614303 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.614472 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.614602 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.614776 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.614901 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.615083 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.615221 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.615395 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.615528 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.615714 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.615848 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.616024 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.616184 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.616358 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.616483 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.616666 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.616796 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.616972 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.617106 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.617275 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.617407 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.617579 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.617703 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.617889 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.618016 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.618192 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.618317 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.618498 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.618621 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.618800 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.618934 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.619107 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.619230 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.619665 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.619799 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.619986 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.620177 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.620322 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.620446 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.620629 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.620761 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.620932 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.621062 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.621238 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.621364 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.621568 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.621700 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.621882 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.622005 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.622294 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.622428 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.622550 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.622679 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.622838 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.622963 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.623149 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.623274 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.623458 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.623590 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.623770 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.623901 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.624101 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.624230 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.624431 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.624554 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.624713 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.624845 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.625024 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.625151 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.625330 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.625455 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.625633 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.625763 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.625938 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.626064 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.626254 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.626380 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.626563 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.626687 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.626875 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.627000 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.627197 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.627322 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.628091 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.628244 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.628379 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.628595 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.628721 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.628842 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.628961 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.629080 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.629270 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.629403 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.629577 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.629699 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.629886 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.630007 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.630190 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.630321 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.630501 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.630625 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.630810 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.630932 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.631121 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.631252 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.631435 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.631566 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.631744 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.631873 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.632066 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.632193 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.632385 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.632519 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.632690 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.632814 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.632994 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.633301 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.633398 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.633616 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.633710 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.633923 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.634027 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.634234 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.634341 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.634537 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.634643 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.634846 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.634959 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.635151 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.635244 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.635577 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.635676 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.635891 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.635984 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.636228 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.636321 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.636536 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.636639 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.636847 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.636948 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.637160 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.637252 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.637476 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.637568 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.637791 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.637884 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.638097 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.638189 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.638514 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.638615 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.638829 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.638922 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.639139 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.639233 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.639450 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.639551 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.639754 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.639853 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.640111 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.640217 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.640388 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.640483 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.640712 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.640799 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.641019 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.641104 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.641325 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.641418 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.641628 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.641713 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.641950 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.642034 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.642253 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.642346 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.642574 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.642668 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.642991 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.643096 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.643847 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.643939 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.644180 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.644269 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.644598 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.644683 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.644910 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.644996 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.645225 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.645311 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.645552 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.645695 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.645874 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.646001 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.646197 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.646324 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.646507 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.646652 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.646818 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.646943 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.647128 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.647252 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.647451 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.647574 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.647775 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.647899 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.648116 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.648243 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.648436 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.648560 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.648737 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.648873 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.649061 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.649193 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.649381 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.649513 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.649696 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.649835 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.650018 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.650142 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.650431 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.650557 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.650755 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.650893 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.651066 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.651190 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.651389 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.651512 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.651714 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.651852 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.652022 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.652175 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.652352 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.652492 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.652708 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.652835 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.652971 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.653099 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.653249 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.653375 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.653569 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.653697 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.653877 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.654009 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.654186 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.654310 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.654496 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.654628 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.654802 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.654934 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.655108 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.655232 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.655411 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.655537 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.655734 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.655858 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.656052 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.656192 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.656384 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.656517 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.656701 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.656827 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.657022 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.657155 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.657342 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.657467 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.657649 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.657772 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.657968 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.658101 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.658278 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.658404 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.658584 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.658726 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.658913 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.659047 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.659220 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.659351 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.659559 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.659684 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.659869 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.659995 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.660221 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.660348 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.660553 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.660678 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.660885 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.661019 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.661198 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.661325 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.661534 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.661658 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.661860 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.661986 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.662178 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.662302 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.662498 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.662622 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.662826 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.662953 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.663120 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.663255 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.663427 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.663563 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.663736 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.663860 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.664066 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.664194 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.664375 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.664510 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.664679 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.664803 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.664989 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.665112 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.665291 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.665462 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.665587 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.665707 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.665890 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.666015 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.666215 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.666350 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.666524 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.666647 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.666845 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.666981 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.667158 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.667290 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.667462 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.667586 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.667769 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.667901 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.668101 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.668226 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.668445 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.668570 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.668754 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.668890 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.669085 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.669209 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.669406 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.669537 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.669726 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.669849 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.670058 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.670189 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.670368 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.670492 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.670693 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.670826 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.671012 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.671137 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.671330 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.671461 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.671648 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.671784 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.671968 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.672132 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.672340 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.672471 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.672624 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.672890 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.673081 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.673209 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.673331 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.673459 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.673582 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.673717 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.673840 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.673962 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.674148 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.674282 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.675215 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.675348 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.675542 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.675668 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.675863 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.675988 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.676203 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.676337 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.676518 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.676665 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.676853 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.676976 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.677136 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.677261 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.677448 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.677575 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.677764 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.677896 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.678075 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.678200 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.678389 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.678513 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.678714 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.678848 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.679038 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.679165 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.679366 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.679500 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.679703 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.679874 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.680011 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.680175 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.680354 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.680479 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.680680 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.680803 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.680973 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.681098 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.681329 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.681455 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.681642 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.681773 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.681952 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.682085 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.682266 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.682398 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.682583 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.682713 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.682895 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.683019 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.683221 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.683365 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.683488 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.683609 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.683805 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.683987 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.684139 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.684275 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.684445 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.684571 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.684753 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.684886 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.685067 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.685193 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.685377 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.685508 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.685701 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.685825 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.686032 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.686166 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.686354 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.686480 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.686668 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.686792 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.686981 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.687114 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.687298 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.687422 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.687815 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.687952 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.688156 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.688283 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.688494 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.688621 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.688823 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.688963 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.689148 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.689275 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.689466 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.689589 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.689781 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.689933 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.690659 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.690786 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.690968 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.691100 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.691275 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.691409 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.691585 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.691721 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.691894 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.692019 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.692213 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.692344 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.692541 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.692674 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.692852 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.692984 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.693154 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.693354 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.693481 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.693609 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.693771 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.693897 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.694304 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.694429 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.694650 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.694783 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.694968 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.695097 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.695294 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.695422 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.695619 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.695746 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.695939 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.696092 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.696275 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.696400 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.696602 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.696736 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.696910 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.697043 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.697215 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.697340 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.697533 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.697664 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.697844 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.697977 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.698151 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.698278 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.698454 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.698578 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.698765 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.698900 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.699076 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.699207 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.699377 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.699502 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.699687 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.699809 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.699991 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.700209 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.700334 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.700455 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.700642 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.700776 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.700944 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.701068 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.701250 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.701373 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.701559 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.701692 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.701866 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.701990 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.702168 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.702299 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.702475 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.702598 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.702777 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.702901 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.703089 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.703221 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.703465 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.703582 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.703704 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.703836 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.703990 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.704187 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.704313 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.704434 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.704619 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.704746 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.704927 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.705061 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.705276 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.705401 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.705622 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.705758 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.705932 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.706067 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.706235 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.706359 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.706554 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.706680 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.706865 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.706991 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.707186 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.707311 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.707499 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.707631 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.707806 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.707939 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.708178 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.708305 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.708495 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.708620 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.709037 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.709165 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.709375 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.709506 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.709699 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.709823 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.710038 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.710162 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.710372 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.710496 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.710682 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.710880 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.711006 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.711126 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.711286 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.711413 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.711609 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.711743 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.711925 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.712087 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.712264 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.712389 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.712576 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.712713 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.712887 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.713011 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.713198 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.713322 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.713571 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.713679 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.713821 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.713952 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.714130 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.714253 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.714440 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.714565 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.714749 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.714873 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.715058 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.715181 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.715364 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.715490 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.715671 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.715794 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.715984 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.716148 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.716354 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.716479 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.716676 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.716799 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.716993 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.717126 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.717312 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.717436 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.717629 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.717761 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.717941 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.718074 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.718252 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.718386 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.718564 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.718699 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.718875 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.719011 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.719186 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.719310 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.719516 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.719768 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.719911 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.720090 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.720215 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.720336 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.720555 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.720680 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.720870 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.720994 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.721205 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.721348 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.721533 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.721657 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.721844 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.721967 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.722169 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.722294 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.722489 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.722620 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.722801 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.722925 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.723120 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.723243 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.723431 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.723577 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.723758 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.723884 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.724102 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.724232 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.724436 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.724579 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.724760 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.724885 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.725064 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.725187 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.725371 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.725507 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.725677 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.725801 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.725987 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.726111 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.726305 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.726423 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.726614 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.726746 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.726918 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.727049 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.727223 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.727347 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.727531 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.727654 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.727834 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.727966 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.728162 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.728289 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.728467 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.728606 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.728789 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.728923 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.729067 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.729195 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.729370 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.729494 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.729672 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.729806 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.729974 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.730098 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.730272 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.730404 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.730574 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.730707 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.730873 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.730999 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.731181 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.731305 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.731479 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.731612 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.731783 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.731907 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.732108 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.732236 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.732416 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.732543 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.732715 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.732839 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.733087 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.733217 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.733377 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.733510 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.733692 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.733898 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.734031 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.734152 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.734308 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.734436 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.734631 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.734765 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.734939 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.735076 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.735263 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.735413 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.735580 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.735712 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.735897 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.736055 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.736232 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.736355 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.736566 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.736700 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.737436 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.737578 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.737767 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.737894 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.738084 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.738226 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.738394 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.738526 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.738693 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.738811 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.739006 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.739133 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.739336 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.739464 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.739663 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.739791 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.739971 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.740125 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.740329 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.740454 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.740634 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.740761 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.740954 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.741079 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.741274 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.741407 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.741584 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.741710 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.741915 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.742051 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.742224 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.742357 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.742534 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.742658 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.742851 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.742984 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.743161 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.743292 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.743470 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.743594 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.743791 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.743918 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.744130 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.744241 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.744713 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.744801 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.745040 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.745128 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.745349 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.745442 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.745676 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.745761 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.746003 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.746089 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.746348 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.746433 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.746659 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.746756 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.747001 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.747101 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.747329 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.747414 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.747645 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.747730 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.747959 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.748065 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.748294 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.748380 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:38:36.748536 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 11:38:36.748664 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 11:38:36.810637 n-d-849104-4 devstack@n-api.service[110643]: INFO dbcounter [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] Registered counter for database nova_api Jul 12 11:38:36.812463 n-d-849104-4 devstack@n-api.service[110642]: INFO dbcounter [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] Registered counter for database nova_api Jul 12 11:38:36.923149 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_db.sqlalchemy.engines [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:38:36.925492 n-d-849104-4 devstack@n-api.service[110642]: DEBUG oslo_db.sqlalchemy.engines [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:38:36.930249 n-d-849104-4 devstack@n-api.service[110643]: DEBUG dbcounter [-] [110643] Writer thread running {{(pid=110643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:38:36.932061 n-d-849104-4 devstack@n-api.service[110642]: DEBUG dbcounter [-] [110642] Writer thread running {{(pid=110642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:38:36.985583 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.context [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dd950407-7fc7-406c-84b0-4304624ff8c8(cell1) {{(pid=110643) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 11:38:36.988074 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.context [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dd950407-7fc7-406c-84b0-4304624ff8c8(cell1) {{(pid=110642) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 11:38:36.990043 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_concurrency.lockutils [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:38:36.991633 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_concurrency.lockutils [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:38:36.991984 n-d-849104-4 devstack@n-api.service[110642]: DEBUG oslo_concurrency.lockutils [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:38:36.992470 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_concurrency.lockutils [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:38:36.993619 n-d-849104-4 devstack@n-api.service[110642]: DEBUG oslo_concurrency.lockutils [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:38:36.994675 n-d-849104-4 devstack@n-api.service[110642]: DEBUG oslo_concurrency.lockutils [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:38:36.994815 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_concurrency.lockutils [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:38:36.996800 n-d-849104-4 devstack@n-api.service[110642]: DEBUG oslo_concurrency.lockutils [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:38:36.996905 n-d-849104-4 devstack@n-api.service[110643]: INFO dbcounter [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] Registered counter for database nova_cell0 Jul 12 11:38:36.998773 n-d-849104-4 devstack@n-api.service[110642]: INFO dbcounter [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] Registered counter for database nova_cell0 Jul 12 11:38:37.000711 n-d-849104-4 devstack@n-api.service[110643]: INFO dbcounter [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] Registered counter for database nova_cell1 Jul 12 11:38:37.003235 n-d-849104-4 devstack@n-api.service[110642]: INFO dbcounter [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] Registered counter for database nova_cell1 Jul 12 11:38:37.008705 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_db.sqlalchemy.engines [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:38:37.010867 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_db.sqlalchemy.engines [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:38:37.012538 n-d-849104-4 devstack@n-api.service[110642]: DEBUG oslo_db.sqlalchemy.engines [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:38:37.014353 n-d-849104-4 devstack@n-api.service[110642]: DEBUG oslo_db.sqlalchemy.engines [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:38:37.016386 n-d-849104-4 devstack@n-api.service[110643]: DEBUG dbcounter [-] [110643] Writer thread running {{(pid=110643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:38:37.018471 n-d-849104-4 devstack@n-api.service[110643]: DEBUG dbcounter [-] [110643] Writer thread running {{(pid=110643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:38:37.019986 n-d-849104-4 devstack@n-api.service[110642]: DEBUG dbcounter [-] [110642] Writer thread running {{(pid=110642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:38:37.025046 n-d-849104-4 devstack@n-api.service[110642]: DEBUG dbcounter [-] [110642] Writer thread running {{(pid=110642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:38:37.163978 n-d-849104-4 devstack@n-api.service[110643]: INFO dbcounter [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] Registered counter for database nova_cell0 Jul 12 11:38:37.169334 n-d-849104-4 devstack@n-api.service[110642]: INFO dbcounter [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] Registered counter for database nova_cell0 Jul 12 11:38:37.172751 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_db.sqlalchemy.engines [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:38:37.177054 n-d-849104-4 devstack@n-api.service[110642]: DEBUG oslo_db.sqlalchemy.engines [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:38:37.178082 n-d-849104-4 devstack@n-api.service[110643]: DEBUG dbcounter [-] [110643] Writer thread running {{(pid=110643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:38:37.181663 n-d-849104-4 devstack@n-api.service[110642]: DEBUG dbcounter [-] [110642] Writer thread running {{(pid=110642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:38:37.515566 n-d-849104-4 devstack@n-api.service[110643]: WARNING keystonemiddleware.auth_token [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 11:38:37.518849 n-d-849104-4 devstack@n-api.service[110642]: WARNING keystonemiddleware.auth_token [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 11:38:37.523438 n-d-849104-4 devstack@n-api.service[110643]: WARNING keystonemiddleware.auth_token [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 11:38:37.526206 n-d-849104-4 devstack@n-api.service[110642]: WARNING keystonemiddleware.auth_token [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 11:38:37.864975 n-d-849104-4 devstack@n-api.service[110643]: WARNING keystonemiddleware.auth_token [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 11:38:37.871121 n-d-849104-4 devstack@n-api.service[110643]: WARNING keystonemiddleware.auth_token [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 11:38:37.871693 n-d-849104-4 devstack@n-api.service[110642]: WARNING keystonemiddleware.auth_token [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 11:38:37.876390 n-d-849104-4 devstack@n-api.service[110643]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55643acd09c0 pid: 110643 (default app) Jul 12 11:38:37.878258 n-d-849104-4 devstack@n-api.service[110642]: WARNING keystonemiddleware.auth_token [None req-c906a48a-5821-4b89-bd4c-087ecc4404c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 11:38:37.878976 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:38:37.880199 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001737 Jul 12 11:38:37.880604 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Tue Jul 12 11:38:37 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:38:37.883587 n-d-849104-4 devstack@n-api.service[110642]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55643acd09c0 pid: 110642 (default app) Jul 12 11:39:52.826513 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:39:52.827532 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 12 11:39:52.828589 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 930 bytes} [Tue Jul 12 11:39:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:39:52.840704 n-d-849104-4 devstack@n-api.service[110642]: DEBUG dbcounter [-] [110642] Writing DB stats nova_api:SELECT=3 {{(pid=110642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:39:52.841994 n-d-849104-4 devstack@n-api.service[110642]: DEBUG dbcounter [-] [110642] Writing DB stats nova_cell0:SELECT=3 {{(pid=110642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:39:52.842821 n-d-849104-4 devstack@n-api.service[110642]: DEBUG dbcounter [-] [110642] Writing DB stats nova_cell1:SELECT=3 {{(pid=110642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:39:52.844097 n-d-849104-4 devstack@n-api.service[110642]: DEBUG dbcounter [-] [110642] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:39:53.710741 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-57da2528-ac5e-48e2-9fe1-32fdd64ac461 admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:39:53.740272 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-57da2528-ac5e-48e2-9fe1-32fdd64ac461 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.905000 Jul 12 11:39:53.741137 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 1/3] 10.222.0.50 () {60 vars in 1291 bytes} [Tue Jul 12 11:39:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:39:55.949092 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:39:55.950114 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-486db3ff-90da-4d8b-a245-fe02c47063d5 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 12 11:39:55.950523 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 3/4] 10.222.0.50 () {54 vars in 930 bytes} [Tue Jul 12 11:39:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:39:56.438022 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-651a908c-4448-47d6-9201-43262e60d53b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256"}} {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:39:56.459016 n-d-849104-4 devstack@n-api.service[110642]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:39:56.459016 n-d-849104-4 devstack@n-api.service[110642]: warnings.warn(msg) Jul 12 11:39:56.490070 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-651a908c-4448-47d6-9201-43262e60d53b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.533514 Jul 12 11:39:56.490842 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 2/5] 10.222.0.50 () {64 vars in 1282 bytes} [Tue Jul 12 11:39:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:39:56.505601 n-d-849104-4 devstack@n-api.service[110643]: DEBUG dbcounter [-] [110643] Writing DB stats nova_api:SELECT=3 {{(pid=110643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:39:56.506747 n-d-849104-4 devstack@n-api.service[110643]: DEBUG dbcounter [-] [110643] Writing DB stats nova_cell1:SELECT=3 {{(pid=110643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:39:56.508022 n-d-849104-4 devstack@n-api.service[110643]: DEBUG dbcounter [-] [110643] Writing DB stats nova_cell0:SELECT=3 {{(pid=110643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:39:56.509380 n-d-849104-4 devstack@n-api.service[110643]: DEBUG dbcounter [-] [110643] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:39:56.725476 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-2b786a10-7137-4c84-aa66-70be30a6ed2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:39:56.727911 n-d-849104-4 devstack@n-api.service[110643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:39:56.727911 n-d-849104-4 devstack@n-api.service[110643]: warnings.warn(msg) Jul 12 11:39:56.791596 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-2b786a10-7137-4c84-aa66-70be30a6ed2b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291557 Jul 12 11:39:56.804474 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 4/6] 10.222.0.50 () {64 vars in 1335 bytes} [Tue Jul 12 11:39:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:39:59.065133 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-651a908c-4448-47d6-9201-43262e60d53b admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:39:59.066160 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-651a908c-4448-47d6-9201-43262e60d53b admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 12 11:39:59.066568 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 3/7] 10.222.0.50 () {54 vars in 930 bytes} [Tue Jul 12 11:39:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:39:59.863780 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-9ef6569a-1ae4-4570-8cef-b16e90281c6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M"}} {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:39:59.882875 n-d-849104-4 devstack@n-api.service[110643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:39:59.882875 n-d-849104-4 devstack@n-api.service[110643]: warnings.warn(msg) Jul 12 11:39:59.901681 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-9ef6569a-1ae4-4570-8cef-b16e90281c6f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.828911 Jul 12 11:39:59.902249 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 5/8] 10.222.0.50 () {64 vars in 1282 bytes} [Tue Jul 12 11:39:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 11:39:59.914374 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-bad2c064-7b98-4ecf-a014-1e108dba706d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:39:59.916082 n-d-849104-4 devstack@n-api.service[110642]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:39:59.916082 n-d-849104-4 devstack@n-api.service[110642]: warnings.warn(msg) Jul 12 11:39:59.952285 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-bad2c064-7b98-4ecf-a014-1e108dba706d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041562 Jul 12 11:39:59.968058 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 4/9] 10.222.0.50 () {64 vars in 1335 bytes} [Tue Jul 12 11:39:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:40:02.369371 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-9ef6569a-1ae4-4570-8cef-b16e90281c6f admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:02.376572 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-9ef6569a-1ae4-4570-8cef-b16e90281c6f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001736 Jul 12 11:40:02.376572 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 930 bytes} [Tue Jul 12 11:40:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:03.070347 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-e7325b31-872c-42c1-9eb8-0b74fd4faf31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "vcpus": 1, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:03.094281 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-e7325b31-872c-42c1-9eb8-0b74fd4faf31 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.710396 Jul 12 11:40:03.101125 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 5/11] 10.222.0.50 () {64 vars in 1282 bytes} [Tue Jul 12 11:40:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:40:03.108366 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-42bd6e8a-421c-448c-9744-ae7ad0d02a11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:03.139437 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-42bd6e8a-421c-448c-9744-ae7ad0d02a11 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035342 Jul 12 11:40:03.149087 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 7/12] 10.222.0.50 () {64 vars in 1335 bytes} [Tue Jul 12 11:40:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:40:05.585580 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-e7325b31-872c-42c1-9eb8-0b74fd4faf31 admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:05.586709 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-e7325b31-872c-42c1-9eb8-0b74fd4faf31 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Jul 12 11:40:05.587126 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 6/13] 10.222.0.50 () {54 vars in 930 bytes} [Tue Jul 12 11:40:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:06.020003 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-0bf3f4f9-48b4-4256-8b9e-3bcbc9ff5f5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "disk": 10}} {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:06.042668 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-0bf3f4f9-48b4-4256-8b9e-3bcbc9ff5f5f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448448 Jul 12 11:40:06.044152 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 8/14] 10.222.0.50 () {64 vars in 1282 bytes} [Tue Jul 12 11:40:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 11:40:06.056194 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-90d451ed-bc0d-4617-8910-7bf99c75b581 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:06.085032 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-90d451ed-bc0d-4617-8910-7bf99c75b581 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031896 Jul 12 11:40:06.085032 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 7/15] 10.222.0.50 () {64 vars in 1335 bytes} [Tue Jul 12 11:40:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:40:08.325410 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-0bf3f4f9-48b4-4256-8b9e-3bcbc9ff5f5f admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:08.326464 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-0bf3f4f9-48b4-4256-8b9e-3bcbc9ff5f5f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 12 11:40:08.326874 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 9/16] 10.222.0.50 () {54 vars in 930 bytes} [Tue Jul 12 11:40:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:08.783355 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-77c4abcf-7967-4f20-9fed-375cef128ee4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G"}} {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:08.803278 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-77c4abcf-7967-4f20-9fed-375cef128ee4 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.469783 Jul 12 11:40:08.803834 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 8/17] 10.222.0.50 () {64 vars in 1282 bytes} [Tue Jul 12 11:40:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 11:40:08.815809 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-dd2eb620-134b-43f4-8568-94afbe17cf78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:08.839727 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-dd2eb620-134b-43f4-8568-94afbe17cf78 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027741 Jul 12 11:40:08.840842 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 10/18] 10.222.0.50 () {64 vars in 1335 bytes} [Tue Jul 12 11:40:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:40:11.128623 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-77c4abcf-7967-4f20-9fed-375cef128ee4 admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:11.129667 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-77c4abcf-7967-4f20-9fed-375cef128ee4 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 12 11:40:11.130070 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 9/19] 10.222.0.50 () {54 vars in 930 bytes} [Tue Jul 12 11:40:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:11.573455 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-aebf080e-019c-43e4-bac2-205a9a33d946 admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:11.598958 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-aebf080e-019c-43e4-bac2-205a9a33d946 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.462807 Jul 12 11:40:11.612756 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 11/20] 10.222.0.50 () {60 vars in 1291 bytes} [Tue Jul 12 11:40:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:40:13.909615 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-77c4abcf-7967-4f20-9fed-375cef128ee4 admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:13.910938 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-77c4abcf-7967-4f20-9fed-375cef128ee4 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001929 Jul 12 11:40:13.911489 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 10/21] 10.222.0.50 () {54 vars in 930 bytes} [Tue Jul 12 11:40:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:14.364907 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-ef7fb245-18a2-4bad-9d85-e2455f0a18d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "disk": 1, "ram": 512, "vcpus": 1, "id": "1", "os-flavor-access:is_public": true}} {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:14.385755 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-ef7fb245-18a2-4bad-9d85-e2455f0a18d1 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.468012 Jul 12 11:40:14.386431 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 12/22] 10.222.0.50 () {64 vars in 1282 bytes} [Tue Jul 12 11:40:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 11:40:14.400839 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-8165cc5f-7787-4054-a2c3-31a46e360196 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:14.428274 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-8165cc5f-7787-4054-a2c3-31a46e360196 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032133 Jul 12 11:40:14.429429 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 11/23] 10.222.0.50 () {64 vars in 1332 bytes} [Tue Jul 12 11:40:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:40:17.116716 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-ef7fb245-18a2-4bad-9d85-e2455f0a18d1 admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:17.117647 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-ef7fb245-18a2-4bad-9d85-e2455f0a18d1 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 12 11:40:17.118240 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 930 bytes} [Tue Jul 12 11:40:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:17.542542 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-077ee020-441a-4efe-9eb6-686f5ecbc7f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "vcpus": 1, "id": "2", "name": "m1.small"}} {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:17.560592 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-077ee020-441a-4efe-9eb6-686f5ecbc7f5 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.434727 Jul 12 11:40:17.561146 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 12/25] 10.222.0.50 () {64 vars in 1282 bytes} [Tue Jul 12 11:40:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:40:17.575524 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-eb6aa593-5dae-41e4-b99b-85b1f7972bd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:17.598697 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-eb6aa593-5dae-41e4-b99b-85b1f7972bd9 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026808 Jul 12 11:40:17.599270 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 14/26] 10.222.0.50 () {64 vars in 1332 bytes} [Tue Jul 12 11:40:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:40:19.828912 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-077ee020-441a-4efe-9eb6-686f5ecbc7f5 admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:19.830477 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-077ee020-441a-4efe-9eb6-686f5ecbc7f5 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002081 Jul 12 11:40:19.830881 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 13/27] 10.222.0.50 () {54 vars in 930 bytes} [Tue Jul 12 11:40:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:20.223094 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-88cb0220-d64d-47f5-b15a-acf14b45697e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "name": "m1.medium", "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:20.241029 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-88cb0220-d64d-47f5-b15a-acf14b45697e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.404237 Jul 12 11:40:20.241605 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 15/28] 10.222.0.50 () {64 vars in 1282 bytes} [Tue Jul 12 11:40:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 11:40:20.254167 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-7ee0ab6f-36d0-4bc4-a185-60b0c46f32ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:20.276311 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-7ee0ab6f-36d0-4bc4-a185-60b0c46f32ce admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025865 Jul 12 11:40:20.277061 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 14/29] 10.222.0.50 () {64 vars in 1332 bytes} [Tue Jul 12 11:40:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:40:22.509534 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-88cb0220-d64d-47f5-b15a-acf14b45697e admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:22.510570 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-88cb0220-d64d-47f5-b15a-acf14b45697e admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 12 11:40:22.511015 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 16/30] 10.222.0.50 () {54 vars in 930 bytes} [Tue Jul 12 11:40:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:40:22.916155 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-c7db7762-1ccd-497b-b156-5c38230fbf63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "disk": 80, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:22.922467 n-d-849104-4 devstack@n-api.service[110642]: DEBUG dbcounter [-] [110642] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:40:22.938703 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-c7db7762-1ccd-497b-b156-5c38230fbf63 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421237 Jul 12 11:40:22.939258 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 15/31] 10.222.0.50 () {64 vars in 1282 bytes} [Tue Jul 12 11:40:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:40:22.950952 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-6a00c433-c3a3-4c40-9797-1a328614210e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:22.974939 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-6a00c433-c3a3-4c40-9797-1a328614210e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027681 Jul 12 11:40:22.975526 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 17/32] 10.222.0.50 () {64 vars in 1332 bytes} [Tue Jul 12 11:40:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:40:25.205347 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-c7db7762-1ccd-497b-b156-5c38230fbf63 admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:25.206937 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-c7db7762-1ccd-497b-b156-5c38230fbf63 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 Jul 12 11:40:25.207344 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 16/33] 10.222.0.50 () {54 vars in 930 bytes} [Tue Jul 12 11:40:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:25.638439 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-dea03036-b001-4ea0-b26f-77e36ddc3849 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:25.658214 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-dea03036-b001-4ea0-b26f-77e36ddc3849 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.444872 Jul 12 11:40:25.658847 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 18/34] 10.222.0.50 () {64 vars in 1282 bytes} [Tue Jul 12 11:40:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:40:25.671187 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-8fa599f1-17db-404f-bacb-8c49c3673f21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:25.695743 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-8fa599f1-17db-404f-bacb-8c49c3673f21 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028762 Jul 12 11:40:25.696497 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 17/35] 10.222.0.50 () {64 vars in 1332 bytes} [Tue Jul 12 11:40:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:40:49.226909 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-dea03036-b001-4ea0-b26f-77e36ddc3849 admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:49.227952 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-dea03036-b001-4ea0-b26f-77e36ddc3849 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jul 12 11:40:49.228385 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 19/36] 10.222.0.50 () {54 vars in 930 bytes} [Tue Jul 12 11:40:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:49.239407 n-d-849104-4 devstack@n-api.service[110642]: DEBUG dbcounter [-] [110642] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:40:49.613318 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-2284d98a-2264-4124-a902-bb98ab1f0abe admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:49.630729 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-2284d98a-2264-4124-a902-bb98ab1f0abe admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395888 Jul 12 11:40:49.631255 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 18/37] 10.222.0.50 () {60 vars in 1291 bytes} [Tue Jul 12 11:40:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:40:50.675359 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-dea03036-b001-4ea0-b26f-77e36ddc3849 admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:50.676398 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-dea03036-b001-4ea0-b26f-77e36ddc3849 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 12 11:40:50.676797 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 20/38] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Jul 12 11:40:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:51.235065 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-ccee1b75-6c35-4f0e-a284-fb1c69813aa7 admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:51.240719 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.wsgi [None req-ccee1b75-6c35-4f0e-a284-fb1c69813aa7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-ccee1b75-6c35-4f0e-a284-fb1c69813aa7 admin admin] Request method failure captured: Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: Accept: application/json Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: Accept-Encoding: gzip, deflate Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: Connection: keep-alive Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: Content-Length: 0 Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: Host: 10.222.0.50 Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: Openstack-Api-Version: compute 2.90 Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: Openstack-System-Scope: None Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: User-Agent: python-novaclient Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: X-Auth-Token: gAAAAABizV3CFdB56hqS-83HPNxc4JJfH2QoMxC0S8LF5EHG-W2ssOAOiwlyDy1D4gWWYdWF9hWUHjCl6llITtsSc9KteEuZsNty9BVZ_NKpItcceLYBd9u8pS7tfOIs96KrM-bb7GavpN_Qm0HniR09LUWEtx-lfqWAAZuGH-oO9rz6ffSbeHI Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: X-Domain-Id: None Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: X-Domain-Name: None Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: X-Identity-Status: Confirmed Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: X-Is-Admin-Project: True Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: X-Project-Domain-Id: default Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: X-Project-Domain-Name: Default Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: X-Project-Id: 6c96c89b17324e2fa20e746c0ce595b1 Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: X-Project-Name: admin Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: X-Role: admin,reader,member Jul 12 11:40:51.243965 n-d-849104-4 devstack@n-api.service[110642]: X-Roles: admin,reader,member Jul 12 11:40:51.245854 n-d-849104-4 devstack@n-api.service[110642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c96c89b17324e2fa20e746c0ce595b1", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:40:51.245854 n-d-849104-4 devstack@n-api.service[110642]: X-Tenant: admin Jul 12 11:40:51.245854 n-d-849104-4 devstack@n-api.service[110642]: X-Tenant-Id: 6c96c89b17324e2fa20e746c0ce595b1 Jul 12 11:40:51.245854 n-d-849104-4 devstack@n-api.service[110642]: X-Tenant-Name: admin Jul 12 11:40:51.245854 n-d-849104-4 devstack@n-api.service[110642]: X-User: admin Jul 12 11:40:51.245854 n-d-849104-4 devstack@n-api.service[110642]: X-User-Domain-Id: default Jul 12 11:40:51.245854 n-d-849104-4 devstack@n-api.service[110642]: X-User-Domain-Name: Default Jul 12 11:40:51.245854 n-d-849104-4 devstack@n-api.service[110642]: X-User-Id: 7c67d1c6a04645e09ab063f8413f33ab Jul 12 11:40:51.245854 n-d-849104-4 devstack@n-api.service[110642]: X-User-Name: admin Jul 12 11:40:51.245854 n-d-849104-4 devstack@n-api.service[110642]: method: > Jul 12 11:40:51.245854 n-d-849104-4 devstack@n-api.service[110642]: exception: Flavor 42 could not be found. Jul 12 11:40:51.245854 n-d-849104-4 devstack@n-api.service[110642]: action_args: {'id': '42'} Jul 12 11:40:51.245854 n-d-849104-4 devstack@n-api.service[110642]: {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:40:51.245854 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:40:51.246927 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:51.248969 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-ccee1b75-6c35-4f0e-a284-fb1c69813aa7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:40:51.250341 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-ccee1b75-6c35-4f0e-a284-fb1c69813aa7 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.404218 Jul 12 11:40:51.250341 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 19/39] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Jul 12 11:40:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 12 11:40:51.255779 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-bc9578dd-dab3-4f33-ba9b-a83cd8ebaccd admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:51.258760 n-d-849104-4 devstack@n-api.service[110643]: DEBUG dbcounter [-] [110643] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:40:51.278181 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-bc9578dd-dab3-4f33-ba9b-a83cd8ebaccd admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025932 Jul 12 11:40:51.279266 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 21/40] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Jul 12 11:40:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:40:51.295265 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-3b1572a2-ae2a-4791-bcda-938dc713b74b admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:51.315982 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-3b1572a2-ae2a-4791-bcda-938dc713b74b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024864 Jul 12 11:40:51.316540 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 20/41] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Jul 12 11:40:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:40:51.326549 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-9feb7db1-0a14-44a2-90b9-af4716dbe551 admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:51.332752 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.wsgi [None req-9feb7db1-0a14-44a2-90b9-af4716dbe551 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-9feb7db1-0a14-44a2-90b9-af4716dbe551 admin admin] Request method failure captured: Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: Accept: application/json Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: Accept-Encoding: gzip, deflate Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: Connection: keep-alive Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: Content-Length: 0 Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: Host: 10.222.0.50 Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: Openstack-Api-Version: compute 2.90 Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: Openstack-System-Scope: None Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: User-Agent: python-novaclient Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: X-Auth-Token: gAAAAABizV3CFdB56hqS-83HPNxc4JJfH2QoMxC0S8LF5EHG-W2ssOAOiwlyDy1D4gWWYdWF9hWUHjCl6llITtsSc9KteEuZsNty9BVZ_NKpItcceLYBd9u8pS7tfOIs96KrM-bb7GavpN_Qm0HniR09LUWEtx-lfqWAAZuGH-oO9rz6ffSbeHI Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: X-Domain-Id: None Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: X-Domain-Name: None Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: X-Identity-Status: Confirmed Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: X-Is-Admin-Project: True Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: X-Project-Domain-Id: default Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: X-Project-Domain-Name: Default Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: X-Project-Id: 6c96c89b17324e2fa20e746c0ce595b1 Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: X-Project-Name: admin Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: X-Role: admin,reader,member Jul 12 11:40:51.335997 n-d-849104-4 devstack@n-api.service[110643]: X-Roles: admin,reader,member Jul 12 11:40:51.337562 n-d-849104-4 devstack@n-api.service[110643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c96c89b17324e2fa20e746c0ce595b1", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:40:51.337562 n-d-849104-4 devstack@n-api.service[110643]: X-Tenant: admin Jul 12 11:40:51.337562 n-d-849104-4 devstack@n-api.service[110643]: X-Tenant-Id: 6c96c89b17324e2fa20e746c0ce595b1 Jul 12 11:40:51.337562 n-d-849104-4 devstack@n-api.service[110643]: X-Tenant-Name: admin Jul 12 11:40:51.337562 n-d-849104-4 devstack@n-api.service[110643]: X-User: admin Jul 12 11:40:51.337562 n-d-849104-4 devstack@n-api.service[110643]: X-User-Domain-Id: default Jul 12 11:40:51.337562 n-d-849104-4 devstack@n-api.service[110643]: X-User-Domain-Name: Default Jul 12 11:40:51.337562 n-d-849104-4 devstack@n-api.service[110643]: X-User-Id: 7c67d1c6a04645e09ab063f8413f33ab Jul 12 11:40:51.337562 n-d-849104-4 devstack@n-api.service[110643]: X-User-Name: admin Jul 12 11:40:51.337562 n-d-849104-4 devstack@n-api.service[110643]: method: > Jul 12 11:40:51.337562 n-d-849104-4 devstack@n-api.service[110643]: exception: Flavor 42 could not be found. Jul 12 11:40:51.337562 n-d-849104-4 devstack@n-api.service[110643]: action_args: {'id': '42'} Jul 12 11:40:51.337562 n-d-849104-4 devstack@n-api.service[110643]: {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:40:51.337562 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:40:51.338558 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:51.339963 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-9feb7db1-0a14-44a2-90b9-af4716dbe551 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:40:51.341732 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-9feb7db1-0a14-44a2-90b9-af4716dbe551 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015312 Jul 12 11:40:51.341732 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 22/42] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Jul 12 11:40:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 12 11:40:52.297671 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-3b1572a2-ae2a-4791-bcda-938dc713b74b admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:52.298689 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-3b1572a2-ae2a-4791-bcda-938dc713b74b admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 12 11:40:52.299096 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 21/43] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Jul 12 11:40:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:52.810974 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-d7a3c1bc-0d9a-43b3-b8d0-06fc89eb522b admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:52.816344 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.wsgi [None req-d7a3c1bc-0d9a-43b3-b8d0-06fc89eb522b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-d7a3c1bc-0d9a-43b3-b8d0-06fc89eb522b admin admin] Request method failure captured: Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: Accept: application/json Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: Accept-Encoding: gzip, deflate Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: Connection: keep-alive Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: Content-Length: 0 Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: Host: 10.222.0.50 Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: Openstack-Api-Version: compute 2.90 Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: Openstack-System-Scope: None Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: User-Agent: python-novaclient Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: X-Auth-Token: gAAAAABizV3EIfrOAg5ovKwaaeFM5MiM161ICNejsSVSEkkKNwODE3dGYYIHLlG7DZjAivFP3Rf5ePjcXrTLpvdSABZZtOqnzaVwGr0yRpQqnL6WeNCi6w1X6w0pQicfVnMuWC9QHRPGtEoyjNGHOrbYetZiQt7E8D-YdunL9T91Cz6kZ9xeloI Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: X-Domain-Id: None Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: X-Domain-Name: None Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: X-Identity-Status: Confirmed Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: X-Is-Admin-Project: True Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: X-Project-Domain-Id: default Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: X-Project-Domain-Name: Default Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: X-Project-Id: 6c96c89b17324e2fa20e746c0ce595b1 Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: X-Project-Name: admin Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: X-Role: admin,reader,member Jul 12 11:40:52.817851 n-d-849104-4 devstack@n-api.service[110643]: X-Roles: admin,reader,member Jul 12 11:40:52.819377 n-d-849104-4 devstack@n-api.service[110643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c96c89b17324e2fa20e746c0ce595b1", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:40:52.819377 n-d-849104-4 devstack@n-api.service[110643]: X-Tenant: admin Jul 12 11:40:52.819377 n-d-849104-4 devstack@n-api.service[110643]: X-Tenant-Id: 6c96c89b17324e2fa20e746c0ce595b1 Jul 12 11:40:52.819377 n-d-849104-4 devstack@n-api.service[110643]: X-Tenant-Name: admin Jul 12 11:40:52.819377 n-d-849104-4 devstack@n-api.service[110643]: X-User: admin Jul 12 11:40:52.819377 n-d-849104-4 devstack@n-api.service[110643]: X-User-Domain-Id: default Jul 12 11:40:52.819377 n-d-849104-4 devstack@n-api.service[110643]: X-User-Domain-Name: Default Jul 12 11:40:52.819377 n-d-849104-4 devstack@n-api.service[110643]: X-User-Id: 7c67d1c6a04645e09ab063f8413f33ab Jul 12 11:40:52.819377 n-d-849104-4 devstack@n-api.service[110643]: X-User-Name: admin Jul 12 11:40:52.819377 n-d-849104-4 devstack@n-api.service[110643]: method: > Jul 12 11:40:52.819377 n-d-849104-4 devstack@n-api.service[110643]: exception: Flavor 84 could not be found. Jul 12 11:40:52.819377 n-d-849104-4 devstack@n-api.service[110643]: action_args: {'id': '84'} Jul 12 11:40:52.819377 n-d-849104-4 devstack@n-api.service[110643]: {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:40:52.819377 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:40:52.820304 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:52.821437 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-d7a3c1bc-0d9a-43b3-b8d0-06fc89eb522b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:40:52.822753 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-d7a3c1bc-0d9a-43b3-b8d0-06fc89eb522b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.384078 Jul 12 11:40:52.822753 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 23/44] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Jul 12 11:40:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 11:40:52.829157 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-22f21efe-c718-484b-810e-8bafff942980 admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:52.842961 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-22f21efe-c718-484b-810e-8bafff942980 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017638 Jul 12 11:40:52.843482 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 22/45] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Jul 12 11:40:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:40:52.852648 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-7477ca88-5ad4-4cc7-9ac4-4408e32d4ec4 admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:52.867057 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-7477ca88-5ad4-4cc7-9ac4-4408e32d4ec4 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017912 Jul 12 11:40:52.867584 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 24/46] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Jul 12 11:40:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:40:52.876648 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-fc37219f-ca7a-423f-ad95-67b1716fd261 admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:52.881825 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.wsgi [None req-fc37219f-ca7a-423f-ad95-67b1716fd261 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-fc37219f-ca7a-423f-ad95-67b1716fd261 admin admin] Request method failure captured: Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: Accept: application/json Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: Accept-Encoding: gzip, deflate Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: Connection: keep-alive Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: Content-Length: 0 Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: Host: 10.222.0.50 Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: Openstack-Api-Version: compute 2.90 Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: Openstack-System-Scope: None Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: User-Agent: python-novaclient Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: X-Auth-Token: gAAAAABizV3EIfrOAg5ovKwaaeFM5MiM161ICNejsSVSEkkKNwODE3dGYYIHLlG7DZjAivFP3Rf5ePjcXrTLpvdSABZZtOqnzaVwGr0yRpQqnL6WeNCi6w1X6w0pQicfVnMuWC9QHRPGtEoyjNGHOrbYetZiQt7E8D-YdunL9T91Cz6kZ9xeloI Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: X-Domain-Id: None Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: X-Domain-Name: None Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: X-Identity-Status: Confirmed Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: X-Is-Admin-Project: True Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: X-Project-Domain-Id: default Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: X-Project-Domain-Name: Default Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: X-Project-Id: 6c96c89b17324e2fa20e746c0ce595b1 Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: X-Project-Name: admin Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: X-Role: admin,reader,member Jul 12 11:40:52.883311 n-d-849104-4 devstack@n-api.service[110642]: X-Roles: admin,reader,member Jul 12 11:40:52.884813 n-d-849104-4 devstack@n-api.service[110642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c96c89b17324e2fa20e746c0ce595b1", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:40:52.884813 n-d-849104-4 devstack@n-api.service[110642]: X-Tenant: admin Jul 12 11:40:52.884813 n-d-849104-4 devstack@n-api.service[110642]: X-Tenant-Id: 6c96c89b17324e2fa20e746c0ce595b1 Jul 12 11:40:52.884813 n-d-849104-4 devstack@n-api.service[110642]: X-Tenant-Name: admin Jul 12 11:40:52.884813 n-d-849104-4 devstack@n-api.service[110642]: X-User: admin Jul 12 11:40:52.884813 n-d-849104-4 devstack@n-api.service[110642]: X-User-Domain-Id: default Jul 12 11:40:52.884813 n-d-849104-4 devstack@n-api.service[110642]: X-User-Domain-Name: Default Jul 12 11:40:52.884813 n-d-849104-4 devstack@n-api.service[110642]: X-User-Id: 7c67d1c6a04645e09ab063f8413f33ab Jul 12 11:40:52.884813 n-d-849104-4 devstack@n-api.service[110642]: X-User-Name: admin Jul 12 11:40:52.884813 n-d-849104-4 devstack@n-api.service[110642]: method: > Jul 12 11:40:52.884813 n-d-849104-4 devstack@n-api.service[110642]: exception: Flavor 84 could not be found. Jul 12 11:40:52.884813 n-d-849104-4 devstack@n-api.service[110642]: action_args: {'id': '84'} Jul 12 11:40:52.884813 n-d-849104-4 devstack@n-api.service[110642]: {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:40:52.884813 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:40:52.885794 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:52.887107 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-fc37219f-ca7a-423f-ad95-67b1716fd261 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:40:52.888449 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-fc37219f-ca7a-423f-ad95-67b1716fd261 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011459 Jul 12 11:40:52.888449 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 23/47] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Jul 12 11:40:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 11:40:53.843958 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-7477ca88-5ad4-4cc7-9ac4-4408e32d4ec4 admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:53.844988 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-7477ca88-5ad4-4cc7-9ac4-4408e32d4ec4 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 12 11:40:53.845374 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 25/48] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Jul 12 11:40:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:54.484887 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-46ecb1a0-0880-48e7-9fa4-30f6738f0204 admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:54.490518 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.wsgi [None req-46ecb1a0-0880-48e7-9fa4-30f6738f0204 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-46ecb1a0-0880-48e7-9fa4-30f6738f0204 admin admin] Request method failure captured: Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: Accept: application/json Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: Accept-Encoding: gzip, deflate Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: Connection: keep-alive Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: Content-Length: 0 Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: Host: 10.222.0.50 Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: Openstack-Api-Version: compute 2.90 Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: Openstack-System-Scope: None Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: User-Agent: python-novaclient Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: X-Auth-Token: gAAAAABizV3F6FjWvxkwFObakKt3jFQvEB-eSHg1Ta02qNOJKvhofNrMUqT08SrLyq_CifRwPXcCRFRf4ETNauKtZAsRS78-H209109c-0z0MSso7S_TbS4UJy4mrDq5p4IkRC1v7X747f53fDwgTGW3hlqh4L0mVdSkUPB3tx8joRxBpkcPU38 Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: X-Domain-Id: None Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: X-Domain-Name: None Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: X-Identity-Status: Confirmed Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: X-Is-Admin-Project: True Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: X-Project-Domain-Id: default Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: X-Project-Domain-Name: Default Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: X-Project-Id: 6c96c89b17324e2fa20e746c0ce595b1 Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: X-Project-Name: admin Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: X-Role: admin,reader,member Jul 12 11:40:54.492071 n-d-849104-4 devstack@n-api.service[110642]: X-Roles: admin,reader,member Jul 12 11:40:54.493572 n-d-849104-4 devstack@n-api.service[110642]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c96c89b17324e2fa20e746c0ce595b1", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:40:54.493572 n-d-849104-4 devstack@n-api.service[110642]: X-Tenant: admin Jul 12 11:40:54.493572 n-d-849104-4 devstack@n-api.service[110642]: X-Tenant-Id: 6c96c89b17324e2fa20e746c0ce595b1 Jul 12 11:40:54.493572 n-d-849104-4 devstack@n-api.service[110642]: X-Tenant-Name: admin Jul 12 11:40:54.493572 n-d-849104-4 devstack@n-api.service[110642]: X-User: admin Jul 12 11:40:54.493572 n-d-849104-4 devstack@n-api.service[110642]: X-User-Domain-Id: default Jul 12 11:40:54.493572 n-d-849104-4 devstack@n-api.service[110642]: X-User-Domain-Name: Default Jul 12 11:40:54.493572 n-d-849104-4 devstack@n-api.service[110642]: X-User-Id: 7c67d1c6a04645e09ab063f8413f33ab Jul 12 11:40:54.493572 n-d-849104-4 devstack@n-api.service[110642]: X-User-Name: admin Jul 12 11:40:54.493572 n-d-849104-4 devstack@n-api.service[110642]: method: > Jul 12 11:40:54.493572 n-d-849104-4 devstack@n-api.service[110642]: exception: Flavor 451 could not be found. Jul 12 11:40:54.493572 n-d-849104-4 devstack@n-api.service[110642]: action_args: {'id': '451'} Jul 12 11:40:54.493572 n-d-849104-4 devstack@n-api.service[110642]: {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:40:54.493572 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:40:54.494747 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: ERROR nova.api.openstack.wsgi Jul 12 11:40:54.496045 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-46ecb1a0-0880-48e7-9fa4-30f6738f0204 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:40:54.497901 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-46ecb1a0-0880-48e7-9fa4-30f6738f0204 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.504606 Jul 12 11:40:54.497901 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 24/49] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:40:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 506 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 11:40:54.503718 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-92f4d9df-27ed-41e0-87e7-7b1c74a36879 admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:54.517628 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-92f4d9df-27ed-41e0-87e7-7b1c74a36879 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017447 Jul 12 11:40:54.518139 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 26/50] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Jul 12 11:40:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:40:54.527202 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-2c1cd303-e5e1-41b4-8b58-1e45068b6c5c admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:54.541924 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-2c1cd303-e5e1-41b4-8b58-1e45068b6c5c admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018231 Jul 12 11:40:54.542452 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 25/51] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Jul 12 11:40:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:40:54.551645 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-5c1f469c-4d04-41a2-b61b-20f0b8a83dd7 admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:54.556933 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.wsgi [None req-5c1f469c-4d04-41a2-b61b-20f0b8a83dd7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-5c1f469c-4d04-41a2-b61b-20f0b8a83dd7 admin admin] Request method failure captured: Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: Accept: application/json Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: Accept-Encoding: gzip, deflate Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: Connection: keep-alive Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: Content-Length: 0 Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: Host: 10.222.0.50 Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: Openstack-Api-Version: compute 2.90 Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: Openstack-System-Scope: None Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: User-Agent: python-novaclient Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: X-Auth-Token: gAAAAABizV3F6FjWvxkwFObakKt3jFQvEB-eSHg1Ta02qNOJKvhofNrMUqT08SrLyq_CifRwPXcCRFRf4ETNauKtZAsRS78-H209109c-0z0MSso7S_TbS4UJy4mrDq5p4IkRC1v7X747f53fDwgTGW3hlqh4L0mVdSkUPB3tx8joRxBpkcPU38 Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: X-Domain-Id: None Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: X-Domain-Name: None Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: X-Identity-Status: Confirmed Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: X-Is-Admin-Project: True Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: X-Project-Domain-Id: default Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: X-Project-Domain-Name: Default Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: X-Project-Id: 6c96c89b17324e2fa20e746c0ce595b1 Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: X-Project-Name: admin Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: X-Role: admin,reader,member Jul 12 11:40:54.558415 n-d-849104-4 devstack@n-api.service[110643]: X-Roles: admin,reader,member Jul 12 11:40:54.560538 n-d-849104-4 devstack@n-api.service[110643]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c96c89b17324e2fa20e746c0ce595b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c96c89b17324e2fa20e746c0ce595b1", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:40:54.560538 n-d-849104-4 devstack@n-api.service[110643]: X-Tenant: admin Jul 12 11:40:54.560538 n-d-849104-4 devstack@n-api.service[110643]: X-Tenant-Id: 6c96c89b17324e2fa20e746c0ce595b1 Jul 12 11:40:54.560538 n-d-849104-4 devstack@n-api.service[110643]: X-Tenant-Name: admin Jul 12 11:40:54.560538 n-d-849104-4 devstack@n-api.service[110643]: X-User: admin Jul 12 11:40:54.560538 n-d-849104-4 devstack@n-api.service[110643]: X-User-Domain-Id: default Jul 12 11:40:54.560538 n-d-849104-4 devstack@n-api.service[110643]: X-User-Domain-Name: Default Jul 12 11:40:54.560538 n-d-849104-4 devstack@n-api.service[110643]: X-User-Id: 7c67d1c6a04645e09ab063f8413f33ab Jul 12 11:40:54.560538 n-d-849104-4 devstack@n-api.service[110643]: X-User-Name: admin Jul 12 11:40:54.560538 n-d-849104-4 devstack@n-api.service[110643]: method: > Jul 12 11:40:54.560538 n-d-849104-4 devstack@n-api.service[110643]: exception: Flavor 451 could not be found. Jul 12 11:40:54.560538 n-d-849104-4 devstack@n-api.service[110643]: action_args: {'id': '451'} Jul 12 11:40:54.560538 n-d-849104-4 devstack@n-api.service[110643]: {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:40:54.560538 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:40:54.561386 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: ERROR nova.api.openstack.wsgi Jul 12 11:40:54.562591 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-5c1f469c-4d04-41a2-b61b-20f0b8a83dd7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:40:54.563830 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-5c1f469c-4d04-41a2-b61b-20f0b8a83dd7 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011667 Jul 12 11:40:54.563830 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 27/52] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:40:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 11:40:55.515204 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-2c1cd303-e5e1-41b4-8b58-1e45068b6c5c admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:55.516249 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-2c1cd303-e5e1-41b4-8b58-1e45068b6c5c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 12 11:40:55.516648 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 26/53] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Jul 12 11:40:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:56.033020 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-0c30bb27-6837-4f15-bfe2-8aa51920387f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:56.050509 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-0c30bb27-6837-4f15-bfe2-8aa51920387f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.399194 Jul 12 11:40:56.051032 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 28/54] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Jul 12 11:40:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 11:40:57.017373 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-2c1cd303-e5e1-41b4-8b58-1e45068b6c5c admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:57.018423 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-2c1cd303-e5e1-41b4-8b58-1e45068b6c5c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jul 12 11:40:57.018827 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 27/55] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Jul 12 11:40:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:57.534296 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-92a76691-785b-4f74-b499-07eda856c4ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:57.551474 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-92a76691-785b-4f74-b499-07eda856c4ab admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.395271 Jul 12 11:40:57.552013 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 29/56] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Jul 12 11:40:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:40:58.510405 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-2c1cd303-e5e1-41b4-8b58-1e45068b6c5c admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:40:58.511431 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-2c1cd303-e5e1-41b4-8b58-1e45068b6c5c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 12 11:40:58.511830 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 28/57] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Jul 12 11:40:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:40:59.051599 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-e5bea27b-9ffe-4b14-a24a-e3a5071d73b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:40:59.068069 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-e5bea27b-9ffe-4b14-a24a-e3a5071d73b6 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.412629 Jul 12 11:40:59.068612 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 30/58] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Jul 12 11:40:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:41:00.026173 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-2c1cd303-e5e1-41b4-8b58-1e45068b6c5c admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:41:00.027178 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-2c1cd303-e5e1-41b4-8b58-1e45068b6c5c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 12 11:41:00.027571 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 29/59] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Jul 12 11:41:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:41:00.536575 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-70c8bad9-bb68-4ca5-957c-b44cd1f193e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:41:00.555445 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-70c8bad9-bb68-4ca5-957c-b44cd1f193e4 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.393762 Jul 12 11:41:00.556159 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 31/60] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Jul 12 11:41:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:41:01.517994 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-2c1cd303-e5e1-41b4-8b58-1e45068b6c5c admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:41:01.519003 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-2c1cd303-e5e1-41b4-8b58-1e45068b6c5c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 12 11:41:01.519404 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 30/61] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Jul 12 11:41:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:41:02.041621 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-e252db68-f0e6-4c05-964d-161eaa5a9021 admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:41:02.060965 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-e252db68-f0e6-4c05-964d-161eaa5a9021 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407849 Jul 12 11:41:02.061491 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 32/62] 10.222.0.50 () {60 vars in 1202 bytes} [Tue Jul 12 11:41:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:41:53.094687 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-2c1cd303-e5e1-41b4-8b58-1e45068b6c5c admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:41:53.095690 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-2c1cd303-e5e1-41b4-8b58-1e45068b6c5c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 12 11:41:53.096106 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 31/63] 10.222.0.50 () {54 vars in 930 bytes} [Tue Jul 12 11:41:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:41:53.106921 n-d-849104-4 devstack@n-api.service[110643]: DEBUG dbcounter [-] [110643] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:41:53.488356 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-2b3794a6-c05f-4930-8a77-101f6572dd69 admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:41:53.507475 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-2b3794a6-c05f-4930-8a77-101f6572dd69 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405645 Jul 12 11:41:53.508007 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 33/64] 10.222.0.50 () {60 vars in 1291 bytes} [Tue Jul 12 11:41:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:41:53.531779 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-a9398057-6331-40b6-8370-69cd0746b9f6 admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:41:53.535309 n-d-849104-4 devstack@n-api.service[110642]: DEBUG dbcounter [-] [110642] Writing DB stats nova_api:SELECT=14 {{(pid=110642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:41:53.541248 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-a9398057-6331-40b6-8370-69cd0746b9f6 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013148 Jul 12 11:41:53.541781 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 32/65] 10.222.0.50 () {60 vars in 1282 bytes} [Tue Jul 12 11:41:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:41:53.553176 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-da93b6e6-2a9d-49cf-a6f3-015f8366f9e9 admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:41:53.561174 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-da93b6e6-2a9d-49cf-a6f3-015f8366f9e9 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011529 Jul 12 11:41:53.561672 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 34/66] 10.222.0.50 () {60 vars in 1285 bytes} [Tue Jul 12 11:41:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:41:53.572691 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-f3c98c15-dcc2-4231-96dd-20daf1f7a1c4 admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:41:53.580667 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-f3c98c15-dcc2-4231-96dd-20daf1f7a1c4 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011544 Jul 12 11:41:53.581178 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 33/67] 10.222.0.50 () {60 vars in 1285 bytes} [Tue Jul 12 11:41:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:41:53.592219 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-b6f33400-d25f-4f25-add2-0f50ebfac32c admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:41:53.599726 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-b6f33400-d25f-4f25-add2-0f50ebfac32c admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011130 Jul 12 11:41:53.600265 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 35/68] 10.222.0.50 () {60 vars in 1282 bytes} [Tue Jul 12 11:41:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:47:20.766182 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-f3c98c15-dcc2-4231-96dd-20daf1f7a1c4 admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:47:20.767231 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-f3c98c15-dcc2-4231-96dd-20daf1f7a1c4 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 12 11:47:20.767633 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 34/69] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Jul 12 11:47:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:47:20.909375 n-d-849104-4 devstack@n-api.service[110643]: DEBUG dbcounter [-] [110643] Writing DB stats nova_api:SELECT=6 {{(pid=110643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:47:21.050456 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-7486f293-2c2a-436b-ac93-aee899dce017 admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:47:21.051627 n-d-849104-4 devstack@n-api.service[110643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:47:21.051627 n-d-849104-4 devstack@n-api.service[110643]: warnings.warn(msg) Jul 12 11:47:21.052865 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_concurrency.lockutils [None req-7486f293-2c2a-436b-ac93-aee899dce017 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:47:21.053311 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_concurrency.lockutils [None req-7486f293-2c2a-436b-ac93-aee899dce017 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:47:21.054102 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_concurrency.lockutils [None req-7486f293-2c2a-436b-ac93-aee899dce017 admin admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:47:21.054590 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_concurrency.lockutils [None req-7486f293-2c2a-436b-ac93-aee899dce017 admin admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:47:21.095666 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-7486f293-2c2a-436b-ac93-aee899dce017 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.187757 Jul 12 11:47:21.096265 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 36/70] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:47:20 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:47:21.906864 n-d-849104-4 devstack@n-api.service[110642]: DEBUG nova.api.openstack.wsgi [None req-f3c98c15-dcc2-4231-96dd-20daf1f7a1c4 admin admin] Calling method '>' {{(pid=110642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:47:21.907870 n-d-849104-4 devstack@n-api.service[110642]: INFO nova.api.openstack.requestlog [None req-f3c98c15-dcc2-4231-96dd-20daf1f7a1c4 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 12 11:47:21.908317 n-d-849104-4 devstack@n-api.service[110642]: [pid: 110642|app: 0|req: 35/71] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Jul 12 11:47:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:47:22.099387 n-d-849104-4 devstack@n-api.service[110643]: DEBUG nova.api.openstack.wsgi [None req-63902106-169e-44e3-b360-364b22e977a7 admin admin] Calling method '>' {{(pid=110643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:47:22.100597 n-d-849104-4 devstack@n-api.service[110643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:47:22.100597 n-d-849104-4 devstack@n-api.service[110643]: warnings.warn(msg) Jul 12 11:47:22.101798 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_concurrency.lockutils [None req-63902106-169e-44e3-b360-364b22e977a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:47:22.102283 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_concurrency.lockutils [None req-63902106-169e-44e3-b360-364b22e977a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:47:22.103084 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_concurrency.lockutils [None req-63902106-169e-44e3-b360-364b22e977a7 admin admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:47:22.103517 n-d-849104-4 devstack@n-api.service[110643]: DEBUG oslo_concurrency.lockutils [None req-63902106-169e-44e3-b360-364b22e977a7 admin admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:47:22.126857 n-d-849104-4 devstack@n-api.service[110643]: INFO nova.api.openstack.requestlog [None req-63902106-169e-44e3-b360-364b22e977a7 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.078720 Jul 12 11:47:22.127337 n-d-849104-4 devstack@n-api.service[110643]: [pid: 110643|app: 0|req: 37/72] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:47:22 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:48:07.282446 n-d-849104-4 devstack@n-api.service[110641]: Tue Jul 12 11:48:07 2022 - graceful shutdown triggered... Jul 12 11:48:07.282984 n-d-849104-4 devstack@n-api.service[110643]: Gracefully killing worker 2 (pid: 110643)... Jul 12 11:48:07.282571 n-d-849104-4 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 12 11:48:07.283773 n-d-849104-4 devstack@n-api.service[110642]: Gracefully killing worker 1 (pid: 110642)... Jul 12 11:48:08.283567 n-d-849104-4 devstack@n-api.service[110641]: worker 1 buried after 1 seconds Jul 12 11:48:08.284092 n-d-849104-4 devstack@n-api.service[110641]: worker 2 buried after 1 seconds Jul 12 11:48:08.284092 n-d-849104-4 devstack@n-api.service[110641]: goodbye to uWSGI. Jul 12 11:48:08.285281 n-d-849104-4 systemd[1]: devstack@n-api.service: Succeeded. Jul 12 11:48:08.285870 n-d-849104-4 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 12 11:48:08.289347 n-d-849104-4 systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 11:48:08.306027 n-d-849104-4 devstack@n-api.service[125966]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 11:48:08.315458 n-d-849104-4 devstack@n-api.service[125966]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 11:48:08 2022] *** Jul 12 11:48:08.315458 n-d-849104-4 devstack@n-api.service[125966]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 11:48:08.315458 n-d-849104-4 devstack@n-api.service[125966]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 11:48:08.315458 n-d-849104-4 devstack@n-api.service[125966]: nodename: n-d-849104-4 Jul 12 11:48:08.315458 n-d-849104-4 devstack@n-api.service[125966]: machine: x86_64 Jul 12 11:48:08.315458 n-d-849104-4 devstack@n-api.service[125966]: clock source: unix Jul 12 11:48:08.315458 n-d-849104-4 devstack@n-api.service[125966]: pcre jit disabled Jul 12 11:48:08.315458 n-d-849104-4 devstack@n-api.service[125966]: detected number of CPU cores: 4 Jul 12 11:48:08.315458 n-d-849104-4 devstack@n-api.service[125966]: current working directory: / Jul 12 11:48:08.315458 n-d-849104-4 devstack@n-api.service[125966]: detected binary path: /usr/bin/uwsgi-core Jul 12 11:48:08.316291 n-d-849104-4 devstack@n-api.service[125966]: your processes number limit is 47680 Jul 12 11:48:08.316291 n-d-849104-4 devstack@n-api.service[125966]: your memory page size is 4096 bytes Jul 12 11:48:08.316291 n-d-849104-4 devstack@n-api.service[125966]: detected max file descriptor number: 2048 Jul 12 11:48:08.316291 n-d-849104-4 devstack@n-api.service[125966]: lock engine: pthread robust mutexes Jul 12 11:48:08.316291 n-d-849104-4 devstack@n-api.service[125966]: thunder lock: enabled Jul 12 11:48:08.316291 n-d-849104-4 devstack@n-api.service[125966]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 11:48:08.316291 n-d-849104-4 devstack@n-api.service[125966]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 11:48:08.360671 n-d-849104-4 devstack@n-api.service[125966]: Python main interpreter initialized at 0x564ab82549c0 Jul 12 11:48:08.360671 n-d-849104-4 devstack@n-api.service[125966]: python threads support enabled Jul 12 11:48:08.360671 n-d-849104-4 devstack@n-api.service[125966]: your server socket listen backlog is limited to 100 connections Jul 12 11:48:08.360671 n-d-849104-4 devstack@n-api.service[125966]: your mercy for graceful operations on workers is 90 seconds Jul 12 11:48:08.361127 n-d-849104-4 devstack@n-api.service[125966]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 11:48:08.361127 n-d-849104-4 devstack@n-api.service[125966]: *** Operational MODE: preforking *** Jul 12 11:48:08.361369 n-d-849104-4 devstack@n-api.service[125966]: *** uWSGI is running in multiple interpreter mode *** Jul 12 11:48:08.361369 n-d-849104-4 devstack@n-api.service[125966]: spawned uWSGI master process (pid: 125966) Jul 12 11:48:08.361577 n-d-849104-4 systemd[1]: Started Devstack devstack@n-api.service. Jul 12 11:48:08.362174 n-d-849104-4 devstack@n-api.service[125966]: spawned uWSGI worker 1 (pid: 125983, cores: 1) Jul 12 11:48:08.362518 n-d-849104-4 devstack@n-api.service[125966]: spawned uWSGI worker 2 (pid: 125984, cores: 1) Jul 12 11:48:08.364407 n-d-849104-4 devstack@n-api.service[125966]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 11:48:09.027488 n-d-849104-4 devstack@n-api.service[125983]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 11:48:09.031335 n-d-849104-4 devstack@n-api.service[125984]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 11:48:10.230792 n-d-849104-4 devstack@n-api.service[125983]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 11:48:10.230792 n-d-849104-4 devstack@n-api.service[125983]: from cryptography.utils import int_from_bytes Jul 12 11:48:10.231410 n-d-849104-4 devstack@n-api.service[125983]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 11:48:10.231410 n-d-849104-4 devstack@n-api.service[125983]: from cryptography.utils import int_from_bytes Jul 12 11:48:10.232938 n-d-849104-4 devstack@n-api.service[125984]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 11:48:10.232938 n-d-849104-4 devstack@n-api.service[125984]: from cryptography.utils import int_from_bytes Jul 12 11:48:10.233360 n-d-849104-4 devstack@n-api.service[125984]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 11:48:10.233360 n-d-849104-4 devstack@n-api.service[125984]: from cryptography.utils import int_from_bytes Jul 12 11:48:12.552219 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 11:48:12.552793 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 11:48:12.552999 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 11:48:12.553365 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 11:48:12.553657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 11:48:12.554054 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.554322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 11:48:12.554704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.554795 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 11:48:12.554890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.555016 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.555172 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 11:48:12.555355 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.555468 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 11:48:12.555673 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.555786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 11:48:12.556000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.556139 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.556355 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.556514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.556693 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.556794 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.556962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.557066 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.557286 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.557387 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.557618 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.557724 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-849104-4 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.557937 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.558048 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.558248 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.558342 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.558566 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.558665 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.558824 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.558929 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.559136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.559236 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.559461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-849104-4 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.559553 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.559780 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.559882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.560110 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.560310 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.560418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.560727 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.560838 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.561037 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.561135 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.561353 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.561478 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.561665 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.561936 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.562082 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.562218 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.562362 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.562504 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.562636 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.562774 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.562931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.563081 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.563263 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.563407 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.563580 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.563730 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.563976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.564140 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-849104-4 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.564303 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.564449 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.564613 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.564744 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.564936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.565085 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.565244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.565395 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.565638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-849104-4 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.565782 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.565952 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.566083 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.566255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.566399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.566560 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.566699 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.566903 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.567051 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.567239 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.567373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.567565 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.567695 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.567887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.568046 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.568238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.568378 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.568543 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.568707 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.568844 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.568987 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.569184 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.569328 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.569510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.569657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.569820 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.569963 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.570120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.570260 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.570399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.570534 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.570671 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.570965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.571120 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.571321 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.571454 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.571593 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.571757 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.571898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.572107 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.572278 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.572402 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.572544 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.572690 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.572825 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.572959 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.573088 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.573214 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.573351 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.573489 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.573635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.573635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.573894 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.574022 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.574157 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.574326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.574464 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.574595 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.574729 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.574867 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.574995 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.575122 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.575255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.575417 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.575556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.575725 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.575873 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.576051 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.576185 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.576361 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.576505 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.576653 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.576792 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.576975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.577115 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.577290 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.577430 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.577609 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.577743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.577918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.578050 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.578238 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.578378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.578560 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.578692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.578873 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.579010 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.579180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.579322 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.579497 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.579635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.579809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.579942 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.580143 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.580289 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.580465 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.580608 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.580784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.581062 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.581204 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.581361 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.581361 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.581686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.581822 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.581952 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.582079 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.582215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.582349 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.582509 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.582641 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.582779 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.582916 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.583049 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.583175 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.583310 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.583436 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.583571 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.583707 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.583833 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.583999 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.584171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.584312 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.584441 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.584621 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.585284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.585460 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.585592 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.585767 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.585898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.586070 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.586202 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.586377 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.586509 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.586683 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.586827 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.586986 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.587118 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.587289 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.587422 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.587593 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.587796 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.587931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.588093 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.588224 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.588384 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.588513 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.588650 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.588821 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.588953 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.589235 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.589377 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.589513 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.589642 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.589776 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.589911 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.590047 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.590175 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.590310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.590454 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.590590 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.590718 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.590858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.591140 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.591275 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.591415 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.591565 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.591758 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.591895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.592048 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.592178 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.592325 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.592453 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.592587 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.592727 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.592855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.592991 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.593131 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.593259 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.593387 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.593551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.593682 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.593867 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.594000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.594171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.594302 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.594477 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.594609 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.594778 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.594911 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.595080 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.595221 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.595385 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.595525 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.595691 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.595823 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.595992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.596219 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.596351 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.596497 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.596635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.596764 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.596890 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.597017 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.597209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.597354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.597515 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.597661 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.597819 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.597962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.598132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.598278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.598414 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 11:48:12.598574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.598747 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.598878 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.599078 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.599211 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.599422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.599560 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.599738 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.599880 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.600096 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.600232 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.600498 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.601335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.601335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.601607 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.601764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.601967 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.602110 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.602249 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.602249 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.602490 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.602626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.602762 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.602891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.603026 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.603168 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.603359 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.603514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.603658 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.603794 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.603931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.604109 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.604251 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.604421 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.604562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.604741 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.604882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.605061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.605202 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.605373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.605514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.605692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.605834 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.606021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.606155 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.606340 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.606474 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.606655 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.606798 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.606983 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.607120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.607302 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.607435 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.607619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.607758 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.607939 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.608113 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.608284 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.608424 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.608597 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.608736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.608909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.609054 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.609221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.609353 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.609537 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.609668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.609855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.609997 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.610168 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.610306 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.610482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.610612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.610825 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.610970 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.611099 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.611242 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.611515 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.611644 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.611781 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.611936 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.612228 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.612362 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.612496 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.612622 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.612763 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.612899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.613034 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.613169 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.613298 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.613441 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.613582 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.613711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.613838 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.613965 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.614099 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.614240 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.614413 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.614577 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.614706 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.614842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.615004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.615144 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.615352 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.615493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.615622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.615757 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.615886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.616050 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.616268 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.616408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.616599 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.616740 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.616906 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.617052 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.617239 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.617414 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.617543 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.617679 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.617842 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.617984 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.618402 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.618536 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.618717 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.618850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.619033 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.619182 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.619319 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.619452 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.619632 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.619765 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.619937 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.620109 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.620273 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.620405 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.620584 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.620716 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.620890 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.621023 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.621202 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.621339 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.621612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.621743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.621879 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.622013 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.622163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.622362 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.622493 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.622628 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.622771 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.622908 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.623036 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.623171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.623306 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.623444 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.623578 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.623707 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.623884 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.624024 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.624222 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.624369 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.624557 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.624697 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.624890 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.625030 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.625197 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.625342 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.625522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.625654 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.625844 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.625983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.626156 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.626297 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.626441 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.626575 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.626753 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.626886 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.627058 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.627191 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.627363 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.627510 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.627667 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.627799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.627974 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.628143 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.628310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.628452 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.628580 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.628707 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.628883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.629015 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.629186 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.629319 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.629490 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.629623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.629809 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.629949 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.630116 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.630259 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.630418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.630560 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.630727 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.630855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.631011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.631151 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.631352 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.631494 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.631764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.631899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.632054 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.632184 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.632397 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.632648 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.632796 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.633005 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.633136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.633322 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.633561 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.633704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.633951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.634082 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.634276 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.634479 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.634680 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.634917 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.635103 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.635247 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.635389 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.635542 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.635805 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.635950 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.636185 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.636317 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.636531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.636775 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.636928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.637176 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.637294 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.637503 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.637674 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.637809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.637975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.638116 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.638308 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.638439 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.638622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.638762 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.638945 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.639094 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.639252 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.639384 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.639571 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.639714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.639912 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.640069 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.640267 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.640397 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.640587 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.640769 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.640931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.641065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.641206 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.641323 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.641523 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.641650 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.641926 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.642035 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.642144 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.642262 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.642557 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.642790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.642967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.643092 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.643211 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.643328 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.643466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.643595 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.643723 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.643852 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.643979 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.644169 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.644314 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.644456 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.644584 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.644728 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.644858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.644985 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.645207 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.645344 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.645462 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.645589 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.645773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.645906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.646106 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.646238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.646417 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.646560 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.646724 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.646867 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.647034 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.647172 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.647871 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.648005 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.648209 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.648351 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.648520 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.648657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.648827 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.648966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.649134 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.649279 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.649444 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.649574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.649758 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.649888 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.650071 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.650261 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.650428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.650556 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.650683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.650815 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.650953 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.651094 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.651262 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.651405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.651569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.651707 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.651993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.652186 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.652324 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.652452 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.652595 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.652786 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.652917 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.653045 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.653237 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.653368 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.653493 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.653628 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.653767 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.653904 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.654050 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.654190 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.654327 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.654462 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.654599 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.654728 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.654886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.655018 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.655190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.655335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.655492 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.655631 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.655833 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.655965 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.656168 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.656321 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.656459 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.656588 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.656778 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.656918 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.657099 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.657240 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.657411 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.657553 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.657725 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.657864 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.658035 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.658182 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.658345 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.658485 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.658653 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.658791 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.658968 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.659099 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.659277 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.659409 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.659587 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.659864 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.660006 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.660218 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.660408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.660541 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.660680 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.660836 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.660977 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.661145 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.661284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.661455 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.661589 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.661765 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.661910 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.662194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.662327 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.662462 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.662591 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.662734 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.662988 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.663653 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.663798 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.663943 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.664105 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.664261 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.664392 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.664584 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.664725 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.664901 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.665033 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.665215 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.665357 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.665531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.665775 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.665909 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.666125 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.666255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.666435 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.666576 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.667075 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.667221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.667352 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.667492 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.667622 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.667760 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.667897 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.668053 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.668195 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.668375 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.668375 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.668641 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.668770 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.668898 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.669026 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.669164 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.669292 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.669420 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.669537 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.669654 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.669765 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.669889 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.670036 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.670178 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.670404 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.670536 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.670726 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.670866 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.671032 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.671167 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.671343 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.671474 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.671647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.671787 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.671970 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.672372 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.672506 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.672647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.672790 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.672924 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.673118 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.673249 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.673376 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.673503 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.673645 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.673781 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.674007 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.674139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.674393 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.674533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.674717 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.674845 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.675043 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.675171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.675360 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.675562 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.675675 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.675784 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.676003 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.676163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.676317 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.676451 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.676627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.676745 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.676934 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.677056 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.677247 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.677380 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.677555 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.677681 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.677859 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.677985 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.678173 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.678300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.678673 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.678907 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.679385 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.679385 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.679692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.679818 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.680194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.680334 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.680479 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.680609 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.680749 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.680875 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.681084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.681225 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.681396 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.681537 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.681703 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.681843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.682018 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.682150 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.682349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.682493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.682717 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.682821 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.683060 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.683216 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.683372 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.683642 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.683779 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.683979 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.684144 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.684323 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.684568 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.684760 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.684932 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.685072 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.685251 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.685384 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.685584 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.685845 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.685986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.686167 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.686308 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.686512 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.686651 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.686826 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.686980 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.687123 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.687414 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.687546 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.687738 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.687871 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.688084 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.688316 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.688450 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.688676 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.688818 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.688987 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.689166 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.689298 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.689534 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.689674 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.689870 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.690004 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.690217 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.690348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.690531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.690746 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.690888 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.691179 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.691312 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.691489 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.691627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.691856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.692068 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.692203 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.692505 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.692615 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.692835 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.692953 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.693161 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.693275 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.693480 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.693632 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.693800 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.693940 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.694134 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.694254 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.694447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.694580 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.694757 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.694890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.695076 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.695215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.695385 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.695519 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.695691 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.695830 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.696000 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.696164 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.696338 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.696470 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.696816 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.696958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.697205 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.697573 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.697833 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.697927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.700225 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.700402 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.700562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.700728 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.700871 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.701021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.701175 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.701318 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.701457 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.701595 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.701733 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.701877 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.702007 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.702135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.702135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.702385 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.702524 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.702814 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.702814 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.703081 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.703233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.703387 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.703584 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.703728 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.703856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.703991 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.704133 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.704250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.704376 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.704498 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.704610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.704728 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.704844 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.704954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.705073 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.705190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.705300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.705409 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.705518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.705635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.705759 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.705895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.706024 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.706158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.706284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.706418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.706559 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.706696 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.706696 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.706952 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.707088 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.707216 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.707356 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.707492 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.707492 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.707724 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.707859 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.708000 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.708168 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.708305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.708305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.708518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.708628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.708763 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.708891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.709025 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.709160 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.709160 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.709430 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.709567 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.710233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.710384 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.710512 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.710639 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.710766 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.710947 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.711070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.711070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.711326 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.711463 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.711601 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.711785 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.711925 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.712075 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.712197 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.712318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.712448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.712567 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.712686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.712981 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.713103 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.713178 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.713260 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.713395 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.713637 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.713979 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.714083 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.714301 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.714412 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.714613 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.714707 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.714968 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.715067 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.715274 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.715369 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.715578 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.715670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.715891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.715982 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.716253 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.716363 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.716551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.716651 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.716857 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.716949 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.717161 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.717255 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.717483 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.717581 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.717787 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.717879 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.718109 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.718202 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.718444 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.718534 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.718767 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.718874 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.719079 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.719186 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.719409 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.719503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.719739 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.719839 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.720078 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.720188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.720411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.720512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.720744 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.720836 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.721069 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.721157 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.721377 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.721479 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.721691 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.721783 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.722000 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.722090 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.722323 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.722425 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.722648 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.722747 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.722965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.723105 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.723275 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.723396 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.723575 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.723679 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.723898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.724064 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.724215 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.724344 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.724536 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.724720 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.724862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.725002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.725146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.725276 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.726001 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.726136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.726318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.726459 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.726651 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.726784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.726963 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.727096 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.727293 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.727432 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.727614 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.727748 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.727925 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.728084 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.728261 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.728408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.728584 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.728701 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.728914 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.729046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.729233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.729373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.729545 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.729685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.729857 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.729997 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.730169 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.730341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.730514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.730639 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.730819 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.730954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.731144 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.731278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.731477 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.731673 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.731806 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.732142 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.732299 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.732466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.732597 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.732790 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.732929 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.733209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.733352 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.733490 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.733626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.733756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.733964 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.734108 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.734257 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.734384 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.734513 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.734647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.734785 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.734957 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.735100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.735263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.735403 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.735573 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.735713 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.735953 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.736183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.736335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.736462 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.736663 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.736782 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.736974 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.737094 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.737292 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.737420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.737633 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.737751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.738035 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.738174 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.738357 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.738476 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.738666 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.738786 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.738974 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.739094 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.739290 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.739487 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.739679 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.739881 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.740067 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.740200 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.740325 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.740438 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.740554 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.740674 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.740785 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.740895 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.741110 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.741255 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.741418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.741592 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.741745 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.741913 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.742053 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.742245 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.742422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.742556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.742668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.742879 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.743034 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.743556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.743713 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.743854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.744004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.744221 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.744379 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.744538 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.744682 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.744822 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.744978 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.745167 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.745338 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.745607 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.745773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.745918 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.746068 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.746238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.746391 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.746626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.746788 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.746932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.747074 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.747249 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.747425 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.747638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.747802 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.748169 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.748342 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.748487 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.748638 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.748857 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.749016 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.749191 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.749340 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.749491 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.749632 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.749801 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.749953 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.750103 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.750253 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.750490 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.750649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.750877 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.751218 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.751381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.751628 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.751786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.752002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.752187 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.752342 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.752485 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.752696 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.752856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.753107 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.753271 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.753439 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.753746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.753910 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.754065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.754227 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.754467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.754623 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.754778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.754933 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.755090 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.755233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.755379 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.755522 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.755663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.755806 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.755960 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.756187 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.756343 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.756486 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.756652 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.756855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.757011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.757154 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.757303 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.757454 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.757604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.757760 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.757903 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.758048 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.758233 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.758389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.758542 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.758692 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.758841 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.758993 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.759136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.759278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.759428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.759578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.759720 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.759917 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.760096 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.760265 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.760422 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.760572 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.760722 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.760872 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.761015 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.761165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.761341 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.761489 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.761668 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.761825 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.761975 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.762141 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.762338 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.762491 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.762634 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.762782 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.762932 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.763087 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.763314 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.763471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.763613 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.763907 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.764089 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.764260 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.764423 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.764584 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.764735 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.764877 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.765032 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.765175 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.765324 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.765478 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.765626 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.765768 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.765923 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.766067 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.766245 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.766402 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.766554 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.766694 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.766845 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.766995 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.767136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.767279 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.767428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.767578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.767729 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.767871 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.768012 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.768226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.768380 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.768606 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.768759 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.768908 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.769051 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.769200 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.769350 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.769502 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.769651 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.769800 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.769949 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.770099 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.770251 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.770403 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.770544 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.770695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.770837 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.770985 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.771156 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.771320 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.771463 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.771604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.771783 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.771941 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.772129 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.772798 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.772951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.773101 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.773252 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.773430 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.773592 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.773735 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.774027 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.774184 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.774335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.774493 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.774649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.774809 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.774954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.775131 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.775304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.775529 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.775764 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.775948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.776126 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.776283 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.776435 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.776592 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.776735 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.776877 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.777031 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.777181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.777323 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.777478 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.777478 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.778108 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.778265 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.778410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.778562 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.778719 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.778870 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.779013 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.779013 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.779294 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.779436 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.779587 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.779737 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.779879 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.780067 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.780231 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.780384 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.780527 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.780527 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.780812 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.780954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.781095 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.781263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.781487 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.781695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.781845 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.781996 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.782147 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.782304 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.782460 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.782610 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.782759 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.782909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.783051 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.783214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.783371 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.783513 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.783655 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.783797 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.783797 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.784299 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.784299 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.784593 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.784745 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.784886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.785043 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.785194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.785356 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.785506 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.785649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.785791 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.785946 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.785946 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.786230 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.786374 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.786516 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.786665 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.786807 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.786956 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.787108 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.787250 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.787399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.787557 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.787700 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.787892 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.788647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.788755 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.788849 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.788849 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.789040 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.789136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.789231 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.789434 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.789531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.789744 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.789857 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.790066 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.790171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.790372 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.790546 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.790699 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.790849 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.790992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.791141 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.791293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.791453 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.791604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.791749 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.791898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.792074 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.792238 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.792396 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.792547 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.792690 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.792832 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.792975 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.793134 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.793294 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.793436 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.793578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.793727 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.793893 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.794051 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.794354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.794512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.794663 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.794805 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.794947 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.795102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.795256 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.795406 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.795557 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.795709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.795869 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.796020 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.796238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.796391 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.796540 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.796683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.796835 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.796985 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.797146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.797296 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.797458 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.797607 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.797758 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.797901 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.798042 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.798192 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.798384 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.798613 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.798766 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.798916 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.799066 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.799226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.799368 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.799522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.799672 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.799815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.799957 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.800151 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.800316 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.800470 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.800613 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.800754 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.800903 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.801056 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.801212 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.801354 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.801503 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.801646 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.801788 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.801929 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.802080 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.802224 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.802365 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.802514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.802656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.802797 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.802962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.803106 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.803257 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.803399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.803578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.803722 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.803872 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.804023 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.804200 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.804499 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.804655 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.804808 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.804958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.805112 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.805255 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.805396 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.805538 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.805695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.805842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.805991 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.806133 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.806281 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.806425 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.806580 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.806724 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.806875 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.807038 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.807190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.807340 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.807493 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.807635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.807777 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.807926 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.808099 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.808265 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.808416 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.808597 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.808767 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.808929 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.809105 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.809272 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.809421 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.809575 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.809717 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.809858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.810040 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.810203 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.810353 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.810504 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.810646 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.810787 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.810967 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.811126 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.811304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.811461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.811639 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.811797 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.811953 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.812136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.812313 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.812461 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.812625 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.812869 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.813043 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.813195 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.813337 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.813486 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.813627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.813777 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.813936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.814079 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.814228 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.814377 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.814683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.814844 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.815003 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.815158 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.815300 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.815449 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.839844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.840332 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.840545 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.844302 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.844754 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.845004 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.845146 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.845272 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.845397 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.845556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.845954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.846089 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.846214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.846351 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.846476 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.846607 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.846730 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.846853 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.846975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.847097 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.847220 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.847351 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.847490 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.847612 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.847733 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.847854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.848089 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.848227 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.848350 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.848471 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.848471 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 11:48:12.848710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.848710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.848710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.848710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.848710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.848710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.848710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.848710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.849808 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.849808 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 11:48:12.849808 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 11:48:12.986108 n-d-849104-4 devstack@n-api.service[125984]: INFO dbcounter [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] Registered counter for database nova_api Jul 12 11:48:12.987267 n-d-849104-4 devstack@n-api.service[125983]: INFO dbcounter [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] Registered counter for database nova_api Jul 12 11:48:13.009132 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_db.sqlalchemy.engines [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:48:13.010699 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_db.sqlalchemy.engines [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:48:13.017741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writer thread running {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:48:13.017958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writer thread running {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:48:13.076741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.context [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dd950407-7fc7-406c-84b0-4304624ff8c8(cell1) {{(pid=125983) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 11:48:13.076895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.context [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dd950407-7fc7-406c-84b0-4304624ff8c8(cell1) {{(pid=125984) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 11:48:13.080584 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:48:13.080683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:48:13.082146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:48:13.082240 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:48:13.082944 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:48:13.083034 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:48:13.085668 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:48:13.085811 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:48:13.087712 n-d-849104-4 devstack@n-api.service[125983]: INFO dbcounter [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] Registered counter for database nova_cell0 Jul 12 11:48:13.087885 n-d-849104-4 devstack@n-api.service[125984]: INFO dbcounter [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] Registered counter for database nova_cell0 Jul 12 11:48:13.091914 n-d-849104-4 devstack@n-api.service[125983]: INFO dbcounter [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] Registered counter for database nova_cell1 Jul 12 11:48:13.092252 n-d-849104-4 devstack@n-api.service[125984]: INFO dbcounter [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] Registered counter for database nova_cell1 Jul 12 11:48:13.099380 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_db.sqlalchemy.engines [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:48:13.101554 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_db.sqlalchemy.engines [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:48:13.104180 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writer thread running {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:48:13.104841 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_db.sqlalchemy.engines [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:48:13.106086 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_db.sqlalchemy.engines [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:48:13.110903 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writer thread running {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:48:13.247605 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writer thread running {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:48:13.250407 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writer thread running {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:48:13.256473 n-d-849104-4 devstack@n-api.service[125983]: INFO dbcounter [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] Registered counter for database nova_cell0 Jul 12 11:48:13.260059 n-d-849104-4 devstack@n-api.service[125984]: INFO dbcounter [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] Registered counter for database nova_cell0 Jul 12 11:48:13.263940 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_db.sqlalchemy.engines [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:48:13.267833 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_db.sqlalchemy.engines [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 11:48:13.268591 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writer thread running {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:48:13.273267 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writer thread running {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 11:48:13.587014 n-d-849104-4 devstack@n-api.service[125983]: WARNING keystonemiddleware.auth_token [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 11:48:13.591610 n-d-849104-4 devstack@n-api.service[125984]: WARNING keystonemiddleware.auth_token [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 11:48:13.594234 n-d-849104-4 devstack@n-api.service[125983]: WARNING keystonemiddleware.auth_token [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 11:48:13.598808 n-d-849104-4 devstack@n-api.service[125984]: WARNING keystonemiddleware.auth_token [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 11:48:13.934183 n-d-849104-4 devstack@n-api.service[125983]: WARNING keystonemiddleware.auth_token [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 11:48:13.937699 n-d-849104-4 devstack@n-api.service[125984]: WARNING keystonemiddleware.auth_token [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 11:48:13.940133 n-d-849104-4 devstack@n-api.service[125983]: WARNING keystonemiddleware.auth_token [None req-c7568fec-781a-4fda-ba7d-183f92e99465 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 11:48:13.943621 n-d-849104-4 devstack@n-api.service[125984]: WARNING keystonemiddleware.auth_token [None req-796900a8-5f0c-4aa9-9243-2dd52e4b5f4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 11:48:13.946070 n-d-849104-4 devstack@n-api.service[125983]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564ab82549c0 pid: 125983 (default app) Jul 12 11:48:13.951507 n-d-849104-4 devstack@n-api.service[125984]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564ab82549c0 pid: 125984 (default app) Jul 12 11:48:58.435954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=3 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:48:58.436877 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=3 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:48:58.437885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=3 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:48:58.438941 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=3 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:48:59.527482 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:48:59.528450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:48:59.529360 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:48:59.530529 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:48:59.837394 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f670d692-2843-49cc-9435-1821b9601b08 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '.version_select at 0x7f5e112f75e0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:48:59.838793 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:48:59.838793 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:48:59.844932 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f670d692-2843-49cc-9435-1821b9601b08 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dd950407-7fc7-406c-84b0-4304624ff8c8(cell1) {{(pid=125983) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 12 11:48:59.845761 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f670d692-2843-49cc-9435-1821b9601b08 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:48:59.846188 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f670d692-2843-49cc-9435-1821b9601b08 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:48:59.872914 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f670d692-2843-49cc-9435-1821b9601b08 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:48:59.873346 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f670d692-2843-49cc-9435-1821b9601b08 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:48:59.887239 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f670d692-2843-49cc-9435-1821b9601b08 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:48:59.887686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f670d692-2843-49cc-9435-1821b9601b08 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:48:59.893760 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f670d692-2843-49cc-9435-1821b9601b08 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.467884 Jul 12 11:48:59.894667 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1/1] 10.222.0.50 () {58 vars in 1166 bytes} [Tue Jul 12 11:48:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:00.117780 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-262d2702-afdc-486b-9daf-4e1eea4e9015 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:00.119652 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:00.119652 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:00.120906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-262d2702-afdc-486b-9daf-4e1eea4e9015 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.121743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-262d2702-afdc-486b-9daf-4e1eea4e9015 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:00.122804 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-262d2702-afdc-486b-9daf-4e1eea4e9015 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.123649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-262d2702-afdc-486b-9daf-4e1eea4e9015 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:00.166373 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-262d2702-afdc-486b-9daf-4e1eea4e9015 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.270577 Jul 12 11:49:00.168201 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 2/2] 10.222.0.50 () {58 vars in 1175 bytes} [Tue Jul 12 11:48:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:00.271804 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8a242be4-fbf2-4ae4-89fd-9f4fef9f43be tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-67990818", "id": 620280029, "os-flavor-access:is_public": "True"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:00.289672 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:00.289672 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:00.320865 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8a242be4-fbf2-4ae4-89fd-9f4fef9f43be tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.152860 Jul 12 11:49:00.321439 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 3/3] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:00 2022] POST /compute/v2.1/flavors => generated 425 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:00.351414 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a3a26c12-b7f1-4944-9aaf-a82190fc3352 tempest-AZAdminV2TestJSON-420985578 tempest-AZAdminV2TestJSON-420985578-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:00.353496 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3a26c12-b7f1-4944-9aaf-a82190fc3352 tempest-AZAdminV2TestJSON-420985578 tempest-AZAdminV2TestJSON-420985578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.354004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3a26c12-b7f1-4944-9aaf-a82190fc3352 tempest-AZAdminV2TestJSON-420985578 tempest-AZAdminV2TestJSON-420985578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:00.354802 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3a26c12-b7f1-4944-9aaf-a82190fc3352 tempest-AZAdminV2TestJSON-420985578 tempest-AZAdminV2TestJSON-420985578-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.355234 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3a26c12-b7f1-4944-9aaf-a82190fc3352 tempest-AZAdminV2TestJSON-420985578 tempest-AZAdminV2TestJSON-420985578-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:00.370944 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1374210797", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:00.396939 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a3a26c12-b7f1-4944-9aaf-a82190fc3352 tempest-AZAdminV2TestJSON-420985578 tempest-AZAdminV2TestJSON-420985578-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.874832 Jul 12 11:49:00.397430 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1/4] 10.222.0.50 () {58 vars in 1163 bytes} [Tue Jul 12 11:48:59 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:00.450178 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fac07079-c44c-4d2d-8ae8-672843ad72b9 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Calling method '.version_select at 0x7f5e11214f70>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:00.452601 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:00.452601 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:00.459461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fac07079-c44c-4d2d-8ae8-672843ad72b9 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dd950407-7fc7-406c-84b0-4304624ff8c8(cell1) {{(pid=125984) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 12 11:49:00.460290 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fac07079-c44c-4d2d-8ae8-672843ad72b9 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.460739 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fac07079-c44c-4d2d-8ae8-672843ad72b9 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:00.486471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fac07079-c44c-4d2d-8ae8-672843ad72b9 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.486913 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fac07079-c44c-4d2d-8ae8-672843ad72b9 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:00.499495 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fac07079-c44c-4d2d-8ae8-672843ad72b9 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.499952 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fac07079-c44c-4d2d-8ae8-672843ad72b9 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:00.506513 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fac07079-c44c-4d2d-8ae8-672843ad72b9 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.108079 Jul 12 11:49:00.507094 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 2/5] 10.222.0.50 () {60 vars in 1207 bytes} [Tue Jul 12 11:49:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:49:00.512255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c8744f87-b20e-4881-af10-d9401f403633 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1003986227", "name": "tempest-test_aggregate-835831469"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:00.544747 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:00.544747 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:00.545795 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.aggregate [None req-c8744f87-b20e-4881-af10-d9401f403633 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Generated uuid df1a9e55-c3ff-4f86-be99-dc3a5b0cd8ea for aggregate {{(pid=125984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:00.615678 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c8744f87-b20e-4881-af10-d9401f403633 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.107342 Jul 12 11:49:00.620183 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 3/6] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Jul 12 11:49:00 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:00.629810 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] validate_networks() for None {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:49:00.673092 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2ac23bb9-8adb-4f0e-9fed-92d5d2b1d6af tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1196746549", "id": 1999974428, "os-flavor-access:is_public": "False"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:00.674605 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:00.674605 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:00.704430 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2ac23bb9-8adb-4f0e-9fed-92d5d2b1d6af tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.082857 Jul 12 11:49:00.705020 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 4/7] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:00 2022] POST /compute/v2.1/flavors => generated 431 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:00.756238 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a74ce399-157c-4905-a6e6-8ddb2d3cd988 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Calling method '.version_select at 0x7f5e11175790>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:00.757045 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:00.757045 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:00.758209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a74ce399-157c-4905-a6e6-8ddb2d3cd988 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.758657 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a74ce399-157c-4905-a6e6-8ddb2d3cd988 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:00.774693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a74ce399-157c-4905-a6e6-8ddb2d3cd988 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.775148 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a74ce399-157c-4905-a6e6-8ddb2d3cd988 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:00.784873 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a74ce399-157c-4905-a6e6-8ddb2d3cd988 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.785323 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a74ce399-157c-4905-a6e6-8ddb2d3cd988 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:00.791238 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a74ce399-157c-4905-a6e6-8ddb2d3cd988 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.085273 Jul 12 11:49:00.791803 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 5/8] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:00.799756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a930adb2-728e-4c7a-86b5-b09fe91346cd tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:00.800562 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:00.800562 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:00.825284 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a930adb2-728e-4c7a-86b5-b09fe91346cd tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/620280029" status: 202 len: 0 microversion: 2.1 time: 0.029177 Jul 12 11:49:00.825852 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 6/9] 10.222.0.50 () {58 vars in 1157 bytes} [Tue Jul 12 11:49:00 2022] DELETE /compute/v2.1/flavors/620280029 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:00.830171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-242563a2-8619-4ebc-8b9b-067860ef14d6 tempest-AZAdminV2TestJSON-420985578 tempest-AZAdminV2TestJSON-420985578-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:00.830923 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:00.830923 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:00.832023 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-242563a2-8619-4ebc-8b9b-067860ef14d6 tempest-AZAdminV2TestJSON-420985578 tempest-AZAdminV2TestJSON-420985578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.832581 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-242563a2-8619-4ebc-8b9b-067860ef14d6 tempest-AZAdminV2TestJSON-420985578 tempest-AZAdminV2TestJSON-420985578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:00.833422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-242563a2-8619-4ebc-8b9b-067860ef14d6 tempest-AZAdminV2TestJSON-420985578 tempest-AZAdminV2TestJSON-420985578-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.833862 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-242563a2-8619-4ebc-8b9b-067860ef14d6 tempest-AZAdminV2TestJSON-420985578 tempest-AZAdminV2TestJSON-420985578-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:00.857987 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-242563a2-8619-4ebc-8b9b-067860ef14d6 tempest-AZAdminV2TestJSON-420985578 tempest-AZAdminV2TestJSON-420985578-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.031103 Jul 12 11:49:00.858586 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 7/10] 10.222.0.50 () {58 vars in 1184 bytes} [Tue Jul 12 11:49:00 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:00.862794 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6372acf3-4d5a-4730-8a02-b12db7e7a039 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:00.863548 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:00.863548 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:00.876374 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6372acf3-4d5a-4730-8a02-b12db7e7a039 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.016742 Jul 12 11:49:00.876942 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 8/11] 10.222.0.50 () {58 vars in 1142 bytes} [Tue Jul 12 11:49:00 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:00.882702 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-91b36c35-5a7e-4bfd-bf37-53181cddd9e6 tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e1b0c2b3bd15421196529bc146d988fd"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:00.882702 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:00.882702 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:00.944388 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:49:00.945172 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:49:00.947512 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:49:00.948136 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:49:00.948560 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:49:00.962970 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.963558 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:00.964687 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.965129 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:00.967235 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-91b36c35-5a7e-4bfd-bf37-53181cddd9e6 tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1999974428/action" status: 200 len: 97 microversion: 2.1 time: 0.089114 Jul 12 11:49:00.968099 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 9/12] 10.222.0.50 () {60 vars in 1199 bytes} [Tue Jul 12 11:49:00 2022] POST /compute/v2.1/flavors/1999974428/action => generated 97 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:00.978187 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-78f5c6f4-d707-4997-be76-039f6755d3b1 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Calling method '.version_select at 0x7f5e100bd700>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:00.979994 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:00.979994 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:00.988268 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78f5c6f4-d707-4997-be76-039f6755d3b1 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:00.988785 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78f5c6f4-d707-4997-be76-039f6755d3b1 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.005311 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Getting quotas for project 959f0f9676134a43b59b24a174df0df8. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:49:01.009198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78f5c6f4-d707-4997-be76-039f6755d3b1 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.009663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78f5c6f4-d707-4997-be76-039f6755d3b1 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.012523 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Getting quotas for user a1398a8a39da4db08f1ae1ae223d13ce and project 959f0f9676134a43b59b24a174df0df8. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:49:01.020137 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78f5c6f4-d707-4997-be76-039f6755d3b1 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.020625 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78f5c6f4-d707-4997-be76-039f6755d3b1 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.026842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:49:01.026994 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-78f5c6f4-d707-4997-be76-039f6755d3b1 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.053636 Jul 12 11:49:01.027775 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 10/13] 10.222.0.50 () {58 vars in 1166 bytes} [Tue Jul 12 11:49:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:01.029619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:49:01.037180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bef0a5ff-a380-409e-aade-bc2298a75783 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:01.065526 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bef0a5ff-a380-409e-aade-bc2298a75783 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036663 Jul 12 11:49:01.066117 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 11/14] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:01.070536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9676b10b-5fbe-4e6f-bc14-2fd89f39c7c6 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849104-4"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:01.072002 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:01.072002 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:01.082323 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9676b10b-5fbe-4e6f-bc14-2fd89f39c7c6 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.082784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9676b10b-5fbe-4e6f-bc14-2fd89f39c7c6 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.131098 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a58c0ad0-ca00-4749-87a8-a3de9f9e71fd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.808537 Jul 12 11:49:01.132070 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 4/15] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:49:01.345239 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c7bf30df-8669-4861-a369-4a11199f13f9 tempest-FlavorsAccessTestJSON-1280825322 tempest-FlavorsAccessTestJSON-1280825322-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:01.382315 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c7bf30df-8669-4861-a369-4a11199f13f9 tempest-FlavorsAccessTestJSON-1280825322 tempest-FlavorsAccessTestJSON-1280825322-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.249239 Jul 12 11:49:01.392789 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 5/16] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:01 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:01.398208 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d233feec-a9a9-4e13-aefe-fd3aed635ce4 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Calling method '.version_select at 0x7f5e10876ca0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:01.399339 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:01.399339 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:01.401012 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d233feec-a9a9-4e13-aefe-fd3aed635ce4 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.401652 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d233feec-a9a9-4e13-aefe-fd3aed635ce4 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.417555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d233feec-a9a9-4e13-aefe-fd3aed635ce4 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.418017 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d233feec-a9a9-4e13-aefe-fd3aed635ce4 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.429427 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d233feec-a9a9-4e13-aefe-fd3aed635ce4 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.430147 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d233feec-a9a9-4e13-aefe-fd3aed635ce4 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.436689 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d233feec-a9a9-4e13-aefe-fd3aed635ce4 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.042575 Jul 12 11:49:01.437749 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 6/17] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:01.456686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cff6b9ec-aaf3-4840-b990-2226c6b134cb tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-335661785", "id": 1980171220, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:01.459287 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:01.459287 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:01.494263 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cff6b9ec-aaf3-4840-b990-2226c6b134cb tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.055262 Jul 12 11:49:01.498158 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 7/18] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:01 2022] POST /compute/v2.1/flavors => generated 416 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:01.505051 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1c26f386-8709-4972-a2f9-26689fce1638 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:01.505682 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1c26f386-8709-4972-a2f9-26689fce1638 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:01.593692 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1c26f386-8709-4972-a2f9-26689fce1638 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:01.608403 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1c26f386-8709-4972-a2f9-26689fce1638 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1220 microversion: 2.1 time: 0.112301 Jul 12 11:49:01.608972 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 8/19] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:01 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:01.613890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1d5feb37-78af-43cc-812b-50be7488353e tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e1b0c2b3bd15421196529bc146d988fd"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:01.615548 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:01.615548 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:01.653489 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9676b10b-5fbe-4e6f-bc14-2fd89f39c7c6 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 0.586167 Jul 12 11:49:01.654105 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 12/20] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Jul 12 11:49:01 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:01.672983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-26bc5a9c-a611-4210-989a-5f32eb44ba2b tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Calling method '.version_select at 0x7f5e100cfc10>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:01.674059 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:01.674059 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:01.675440 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26bc5a9c-a611-4210-989a-5f32eb44ba2b tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.675947 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26bc5a9c-a611-4210-989a-5f32eb44ba2b tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.698407 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26bc5a9c-a611-4210-989a-5f32eb44ba2b tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.699167 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26bc5a9c-a611-4210-989a-5f32eb44ba2b tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.707593 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-26bc5a9c-a611-4210-989a-5f32eb44ba2b tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.052336 Jul 12 11:49:01.709372 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 13/21] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:01 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:01.714732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5092df82-578f-4645-a551-39342a906266 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:01.741039 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5092df82-578f-4645-a551-39342a906266 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.030454 Jul 12 11:49:01.741641 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 14/22] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:01 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:01.747813 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-638b7c43-dfc8-471c-bc74-b6bf395e5ef0 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Calling method '.version_select at 0x7f5e10074d30>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:01.749095 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:01.749095 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:01.750481 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-638b7c43-dfc8-471c-bc74-b6bf395e5ef0 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.751110 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-638b7c43-dfc8-471c-bc74-b6bf395e5ef0 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.784818 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-638b7c43-dfc8-471c-bc74-b6bf395e5ef0 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.041361 Jul 12 11:49:01.785648 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 15/23] 10.222.0.50 () {58 vars in 1178 bytes} [Tue Jul 12 11:49:01 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:01.790732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c8ba7d25-f1cb-4f58-8f53-7814616f4fe2 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:01.791565 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:01.791565 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:01.819246 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c8ba7d25-f1cb-4f58-8f53-7814616f4fe2 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1980171220" status: 202 len: 0 microversion: 2.1 time: 0.032211 Jul 12 11:49:01.820200 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 16/24] 10.222.0.50 () {58 vars in 1160 bytes} [Tue Jul 12 11:49:01 2022] DELETE /compute/v2.1/flavors/1980171220 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:01.827087 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-51d5fa6b-3b9f-44a1-8a67-46699caf140e tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Calling method '.version_select at 0x7f5e10074c10>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:01.827938 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:01.827938 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:01.829802 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51d5fa6b-3b9f-44a1-8a67-46699caf140e tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.830258 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51d5fa6b-3b9f-44a1-8a67-46699caf140e tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.846975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51d5fa6b-3b9f-44a1-8a67-46699caf140e tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.847417 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51d5fa6b-3b9f-44a1-8a67-46699caf140e tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.849276 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1d5feb37-78af-43cc-812b-50be7488353e tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1999974428/action" status: 200 len: 21 microversion: 2.1 time: 0.239029 Jul 12 11:49:01.850184 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 9/25] 10.222.0.50 () {60 vars in 1199 bytes} [Tue Jul 12 11:49:01 2022] POST /compute/v2.1/flavors/1999974428/action => generated 21 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:01.863426 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51d5fa6b-3b9f-44a1-8a67-46699caf140e tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.864656 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51d5fa6b-3b9f-44a1-8a67-46699caf140e tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.872383 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-51d5fa6b-3b9f-44a1-8a67-46699caf140e tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050859 Jul 12 11:49:01.873167 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 17/26] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:01.878278 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f37c7664-8cbd-498a-84c7-48c3c6c0e035 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:01.900349 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f37c7664-8cbd-498a-84c7-48c3c6c0e035 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025943 Jul 12 11:49:01.901379 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 18/27] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:01.916143 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e7afa6df-caf8-4ec2-af12-8a255709e09d tempest-FlavorsAccessTestJSON-1280825322 tempest-FlavorsAccessTestJSON-1280825322-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:01.919595 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1260579967", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "availability_zone": "tempest-test_az-1003986227"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:01.931684 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.932169 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.932983 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.933417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.951716 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e7afa6df-caf8-4ec2-af12-8a255709e09d tempest-FlavorsAccessTestJSON-1280825322 tempest-FlavorsAccessTestJSON-1280825322-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048904 Jul 12 11:49:01.961093 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 19/28] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:01.966932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-171cf5f9-c505-4b23-be35-4d5221f0fc1d tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Calling method '.version_select at 0x7f5e10074af0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:01.968342 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:01.968342 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:01.970094 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-171cf5f9-c505-4b23-be35-4d5221f0fc1d tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.970906 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-171cf5f9-c505-4b23-be35-4d5221f0fc1d tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.987438 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-171cf5f9-c505-4b23-be35-4d5221f0fc1d tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:01.987901 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-171cf5f9-c505-4b23-be35-4d5221f0fc1d tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:01.995271 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-171cf5f9-c505-4b23-be35-4d5221f0fc1d tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.032638 Jul 12 11:49:01.995865 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 20/29] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:01 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:02.018662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c5372ca0-a53a-4cea-b4ca-56ccad70beb9 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1369276483", "id": 1413159295, "os-flavor-access:is_public": "True"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:02.019191 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] validate_networks() for None {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:49:02.020578 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:02.020578 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:02.037984 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c5372ca0-a53a-4cea-b4ca-56ccad70beb9 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.024725 Jul 12 11:49:02.038704 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 21/30] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:01 2022] POST /compute/v2.1/flavors => generated 429 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:02.043325 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f23e6709-3bf0-4457-ac0f-189c94df1bf0 tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.044092 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:02.044092 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:02.066444 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f23e6709-3bf0-4457-ac0f-189c94df1bf0 tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1999974428" status: 202 len: 0 microversion: 2.1 time: 0.026604 Jul 12 11:49:02.068049 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 22/31] 10.222.0.50 () {58 vars in 1160 bytes} [Tue Jul 12 11:49:02 2022] DELETE /compute/v2.1/flavors/1999974428 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:02.073037 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-93c138fa-8464-443b-abf4-5d634a862737 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Calling method '.version_select at 0x7f5e0b7e14c0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.073833 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:02.073833 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:02.075010 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-93c138fa-8464-443b-abf4-5d634a862737 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:02.075593 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-93c138fa-8464-443b-abf4-5d634a862737 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:02.091967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-93c138fa-8464-443b-abf4-5d634a862737 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:02.092534 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-93c138fa-8464-443b-abf4-5d634a862737 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:02.100631 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-93c138fa-8464-443b-abf4-5d634a862737 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.031548 Jul 12 11:49:02.108005 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 23/32] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:02 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:02.108005 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c22ae754-14e9-4722-9d80-9a02b4be21bb tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.108005 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:02.108005 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:02.113443 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=11 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:02.133449 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c22ae754-14e9-4722-9d80-9a02b4be21bb tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1413159295" status: 202 len: 0 microversion: 2.1 time: 0.030725 Jul 12 11:49:02.134452 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 24/33] 10.222.0.50 () {58 vars in 1160 bytes} [Tue Jul 12 11:49:02 2022] DELETE /compute/v2.1/flavors/1413159295 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:02.139938 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-60463042-4324-4bec-b736-ad6b8da75461 tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.161082 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-60463042-4324-4bec-b736-ad6b8da75461 tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024828 Jul 12 11:49:02.162311 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 25/34] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:02.167678 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-13685c0d-5bfd-4e3f-bbff-0d8c92b4f0d0 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Calling method '.version_select at 0x7f5e10074af0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.168841 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:02.168841 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:02.170386 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-13685c0d-5bfd-4e3f-bbff-0d8c92b4f0d0 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:02.171160 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-13685c0d-5bfd-4e3f-bbff-0d8c92b4f0d0 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:02.194043 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-13685c0d-5bfd-4e3f-bbff-0d8c92b4f0d0 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:02.195136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-13685c0d-5bfd-4e3f-bbff-0d8c92b4f0d0 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:02.209571 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-13685c0d-5bfd-4e3f-bbff-0d8c92b4f0d0 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:02.210155 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-13685c0d-5bfd-4e3f-bbff-0d8c92b4f0d0 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:02.221294 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-13685c0d-5bfd-4e3f-bbff-0d8c92b4f0d0 tempest-HypervisorAdminTestJSON-947969064 tempest-HypervisorAdminTestJSON-947969064-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=125984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 11:49:02.222968 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8873acaf-9098-4c08-bef7-1025c3574cfb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:02.223712 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8873acaf-9098-4c08-bef7-1025c3574cfb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:02.224588 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8873acaf-9098-4c08-bef7-1025c3574cfb None None] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:02.225023 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8873acaf-9098-4c08-bef7-1025c3574cfb None None] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:02.236583 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.compute.rpcapi [None req-8873acaf-9098-4c08-bef7-1025c3574cfb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 11:49:02.237454 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8873acaf-9098-4c08-bef7-1025c3574cfb None None] Releasing lock "compute-rpcapi-router" {{(pid=125984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 11:49:02.284594 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8873acaf-9098-4c08-bef7-1025c3574cfb None None] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.119731 Jul 12 11:49:02.286480 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 26/35] 10.222.0.50 () {58 vars in 1172 bytes} [Tue Jul 12 11:49:02 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:02.291803 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a6c0fa84-6e85-4b35-93e3-b16c12cbc2ef tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.321821 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a6c0fa84-6e85-4b35-93e3-b16c12cbc2ef tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034048 Jul 12 11:49:02.322778 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 27/36] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:02.328189 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f58f7bb2-f0b5-4319-ba32-f49ac077d830 tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1126035351", "id": 165812193, "os-flavor-access:is_public": "False"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:02.329802 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:02.329802 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:02.354467 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f58f7bb2-f0b5-4319-ba32-f49ac077d830 tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.030501 Jul 12 11:49:02.360270 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 28/37] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:02 2022] POST /compute/v2.1/flavors => generated 428 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:02.363089 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-eb31b0e9-9dc3-43a0-a104-61e3654c54ca tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-659831379", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:02.391476 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-eb31b0e9-9dc3-43a0-a104-61e3654c54ca tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.034142 Jul 12 11:49:02.397704 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 29/38] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:02 2022] POST /compute/v2.1/flavors => generated 506 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:02.397885 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4003c3d8-2735-4a75-acdb-50cb74ada8f3 tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.398781 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:02.398781 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:02.414379 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:49:02.414806 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:49:02.415285 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:49:02.415701 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:49:02.416149 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:49:02.417096 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4003c3d8-2735-4a75-acdb-50cb74ada8f3 tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/165812193/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.023258 Jul 12 11:49:02.418029 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 30/39] 10.222.0.50 () {58 vars in 1205 bytes} [Tue Jul 12 11:49:02 2022] GET /compute/v2.1/flavors/165812193/os-flavor-access => generated 21 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:02.422752 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8c9701ef-b95f-4253-b887-c7edf64ada9c tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.424434 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:02.424434 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:02.433001 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:02.434150 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:02.435085 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:02.435537 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:02.452145 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8c9701ef-b95f-4253-b887-c7edf64ada9c tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/de215e6b-48d7-4e75-b863-81a16e004ea2" status: 202 len: 0 microversion: 2.1 time: 0.032423 Jul 12 11:49:02.457034 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 31/40] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:49:02 2022] DELETE /compute/v2.1/flavors/de215e6b-48d7-4e75-b863-81a16e004ea2 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:02.459706 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Getting quotas for project 5c437ce2735840ce8bf6729ba3cceae3. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:49:02.465094 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Getting quotas for user 9960b163a93241a7961e242c60f704b6 and project 5c437ce2735840ce8bf6729ba3cceae3. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:49:02.465579 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-07b7092a-42a7-45bb-bcd5-7db7270d4c82 tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.488772 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-07b7092a-42a7-45bb-bcd5-7db7270d4c82 tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/165812193" status: 202 len: 0 microversion: 2.1 time: 0.029804 Jul 12 11:49:02.491184 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 32/41] 10.222.0.50 () {58 vars in 1157 bytes} [Tue Jul 12 11:49:02 2022] DELETE /compute/v2.1/flavors/165812193 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:02.494980 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:49:02.497169 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-aa09e1ea-9525-43d5-a520-87351ca6606c tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.498027 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:49:02.516327 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-aa09e1ea-9525-43d5-a520-87351ca6606c tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023762 Jul 12 11:49:02.517307 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 33/42] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:02.547995 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-14a7106a-72e6-4f7b-b4ad-9da6f1d5723f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696614 Jul 12 11:49:02.550844 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 10/43] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:49:02.557894 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f6ae081e-f9cd-4ab7-858d-662e016d42ff tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2118226178", "id": "70152c13-5e6c-4f60-8344-d9aec7a0390c", "os-flavor-access:is_public": "True"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:02.559912 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bc5e695d-d304-4029-a30c-f7158d490466 tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.560604 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:02.560604 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:02.578032 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f6ae081e-f9cd-4ab7-858d-662e016d42ff tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.024865 Jul 12 11:49:02.579035 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 11/44] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:02 2022] POST /compute/v2.1/flavors => generated 507 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:02.589422 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bc5e695d-d304-4029-a30c-f7158d490466 tempest-FlavorsAccessTestJSON-122841348 tempest-FlavorsAccessTestJSON-122841348-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5488 microversion: 2.1 time: 0.063549 Jul 12 11:49:02.591394 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-db131850-1453-42b2-9adb-7af7d5285039 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.592593 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-db131850-1453-42b2-9adb-7af7d5285039 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:02.603991 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 34/45] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:02 2022] GET /compute/v2.1/flavors/detail => generated 5488 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:02.610216 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2456715d-059a-4f7e-b86f-bec3c2b939a7 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.646768 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2456715d-059a-4f7e-b86f-bec3c2b939a7 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/70152c13-5e6c-4f60-8344-d9aec7a0390c" status: 202 len: 0 microversion: 2.1 time: 0.041483 Jul 12 11:49:02.650333 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 35/46] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:49:02 2022] DELETE /compute/v2.1/flavors/70152c13-5e6c-4f60-8344-d9aec7a0390c => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:02.657112 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-786573cd-8f10-4cf9-8535-3a6ffd95ab74 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.664135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-786573cd-8f10-4cf9-8535-3a6ffd95ab74 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:02.682727 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-786573cd-8f10-4cf9-8535-3a6ffd95ab74 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:02.683111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-786573cd-8f10-4cf9-8535-3a6ffd95ab74 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:02.683976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-786573cd-8f10-4cf9-8535-3a6ffd95ab74 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:02.684384 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-786573cd-8f10-4cf9-8535-3a6ffd95ab74 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:02.744917 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-db131850-1453-42b2-9adb-7af7d5285039 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:02.753403 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-db131850-1453-42b2-9adb-7af7d5285039 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1243 microversion: 2.1 time: 0.167290 Jul 12 11:49:02.757108 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 12/47] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:02 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1243 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:02.768477 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-48744e82-6af4-4923-9091-d9b1d2ed6dbc tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.824838 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-48744e82-6af4-4923-9091-d9b1d2ed6dbc tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066411 Jul 12 11:49:02.830914 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 13/48] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:02.847815 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6e5d170c-2d33-4f35-bfca-b9c24ccf4c10 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-719742435", "id": 1450180143, "os-flavor-access:is_public": "True"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:02.850294 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:02.850294 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:02.886547 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6e5d170c-2d33-4f35-bfca-b9c24ccf4c10 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.039879 Jul 12 11:49:02.889224 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 14/49] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:02 2022] POST /compute/v2.1/flavors => generated 413 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:49:02.900393 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1f7cad21-c0c8-4d39-ad39-b81dd4ba209d tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:02.916463 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1f7cad21-c0c8-4d39-ad39-b81dd4ba209d tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1450180143" status: 200 len: 413 microversion: 2.1 time: 0.019893 Jul 12 11:49:02.919546 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 15/50] 10.222.0.50 () {58 vars in 1157 bytes} [Tue Jul 12 11:49:02 2022] GET /compute/v2.1/flavors/1450180143 => generated 413 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:49:03.287958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-513e6bfa-8a11-45a6-937a-048f6fddc740 tempest-FlavorsAdminTestJSON-1948258969 tempest-FlavorsAdminTestJSON-1948258969-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:03.326245 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-513e6bfa-8a11-45a6-937a-048f6fddc740 tempest-FlavorsAdminTestJSON-1948258969 tempest-FlavorsAdminTestJSON-1948258969-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.399644 Jul 12 11:49:03.334003 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 16/51] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:02 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:03.346313 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d2052071-4af9-4104-864c-9b17952b5a53 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:03.347070 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:03.347070 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:03.382148 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d2052071-4af9-4104-864c-9b17952b5a53 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1450180143" status: 202 len: 0 microversion: 2.1 time: 0.038268 Jul 12 11:49:03.383353 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 17/52] 10.222.0.50 () {58 vars in 1160 bytes} [Tue Jul 12 11:49:03 2022] DELETE /compute/v2.1/flavors/1450180143 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:03.401364 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-064b98ef-9f35-40cd-b9ce-decec2ae6b9c tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:03.439464 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-064b98ef-9f35-40cd-b9ce-decec2ae6b9c tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051085 Jul 12 11:49:03.444697 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 18/53] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:03.462345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8f4e6ef8-e679-4a77-bd64-8ed33f759c42 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1116016452", "id": 1648792788, "os-flavor-access:is_public": "False"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:03.482122 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=11,nova_api:DELETE=4 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:03.485640 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8f4e6ef8-e679-4a77-bd64-8ed33f759c42 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.027030 Jul 12 11:49:03.493602 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 19/54] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:03 2022] POST /compute/v2.1/flavors => generated 430 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:03.500855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bebd5533-dbd1-40eb-a44e-eadd555da732 tempest-FlavorsAdminTestJSON-1948258969 tempest-FlavorsAdminTestJSON-1948258969-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "1648792788"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:03.519444 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-bebd5533-dbd1-40eb-a44e-eadd555da732 tempest-FlavorsAdminTestJSON-1948258969 tempest-FlavorsAdminTestJSON-1948258969-project] HTTP exception thrown: Flavor 1648792788 could not be found. Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bebd5533-dbd1-40eb-a44e-eadd555da732 tempest-FlavorsAdminTestJSON-1948258969 tempest-FlavorsAdminTestJSON-1948258969-project] Request method failure captured: Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 107 Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-pfpItfDcVyZciadaCRKUj5CbGcfwsFh8xQDSvR1gBmEe9mYnqIwW8C8nu9XkKhJT46ENS_t_cH2_PDy_oQJeBei2Im7qPbpVZCik9tqoprd4a4rNc7686q7BWIfM1Y8W0CAzXBb0BcQjSxcoUx3NkgLm0KycY5Z8u6yWlqJ5nV0I Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 3dc6a7ec194f4e71b61a58e60c1abb5e Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-FlavorsAdminTestJSON-1948258969 Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:03.525763 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:03.526955 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3dc6a7ec194f4e71b61a58e60c1abb5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3dc6a7ec194f4e71b61a58e60c1abb5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3dc6a7ec194f4e71b61a58e60c1abb5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3dc6a7ec194f4e71b61a58e60c1abb5e", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:03.526955 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-FlavorsAdminTestJSON-1948258969 Jul 12 11:49:03.526955 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 3dc6a7ec194f4e71b61a58e60c1abb5e Jul 12 11:49:03.526955 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1948258969 Jul 12 11:49:03.526955 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-FlavorsAdminTestJSON-1948258969-project Jul 12 11:49:03.526955 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:03.526955 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:03.526955 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 89bc190febfb49b7aa9bf93cef953518 Jul 12 11:49:03.526955 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-FlavorsAdminTestJSON-1948258969-project Jul 12 11:49:03.526955 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:49:03.526955 n-d-849104-4 devstack@n-api.service[125983]: {"server": {"name": "test", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "1648792788"}} Jul 12 11:49:03.526955 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:03.526955 n-d-849104-4 devstack@n-api.service[125983]: exception: Flavor 1648792788 could not be found. Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '5ee904a7-466a-46fc-89be-d728bca3527e', 'flavorRef': '1648792788'}}} Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1648792788 could not be found. Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:03.527601 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1648792788 could not be found. Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:03.528609 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:03.529604 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:03.529604 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:03.529604 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:03.529604 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1648792788 could not be found. Jul 12 11:49:03.529604 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:03.530852 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bebd5533-dbd1-40eb-a44e-eadd555da732 tempest-FlavorsAdminTestJSON-1948258969 tempest-FlavorsAdminTestJSON-1948258969-project] Returning 400 to user: Flavor 1648792788 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:03.532501 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bebd5533-dbd1-40eb-a44e-eadd555da732 tempest-FlavorsAdminTestJSON-1948258969 tempest-FlavorsAdminTestJSON-1948258969-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.036116 Jul 12 11:49:03.534856 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 20/55] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:03 2022] POST /compute/v2.1/servers => generated 81 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 12 11:49:03.548870 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-96d7b7fc-fcfc-4c63-9979-dbd566c343de tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:03.594682 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-96d7b7fc-fcfc-4c63-9979-dbd566c343de tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1648792788" status: 202 len: 0 microversion: 2.1 time: 0.055558 Jul 12 11:49:03.595548 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 21/56] 10.222.0.50 () {58 vars in 1160 bytes} [Tue Jul 12 11:49:03 2022] DELETE /compute/v2.1/flavors/1648792788 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 11:49:03.607928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ea5a7359-7f89-4faa-9d8f-425daec07fba tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:03.657400 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ea5a7359-7f89-4faa-9d8f-425daec07fba tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054827 Jul 12 11:49:03.671027 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 22/57] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:03.690888 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f7588d6c-847d-45c7-9d0e-4b530842207b tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2010942258", "id": 736417023, "os-flavor-access:is_public": "False"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:03.732933 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f7588d6c-847d-45c7-9d0e-4b530842207b tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.049479 Jul 12 11:49:03.735590 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 23/58] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:03 2022] POST /compute/v2.1/flavors => generated 412 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:03.752665 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b8e3c40f-64bd-4802-9177-8601634668bd tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1673239041", "id": 1004077886, "os-flavor-access:is_public": "True"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:03.796044 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b8e3c40f-64bd-4802-9177-8601634668bd tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.052395 Jul 12 11:49:03.797104 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 24/59] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:03 2022] POST /compute/v2.1/flavors => generated 414 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:03.809845 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b9283cdb-f5a7-49b0-84c1-50da0708309d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:03.812319 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b9283cdb-f5a7-49b0-84c1-50da0708309d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:03.877836 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-786573cd-8f10-4cf9-8535-3a6ffd95ab74 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:03.909640 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-786573cd-8f10-4cf9-8535-3a6ffd95ab74 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1224 microversion: 2.1 time: 1.257851 Jul 12 11:49:03.910443 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 36/60] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:02 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1224 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:03.917890 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a689f5af-0fda-40f1-a19a-535a16524e8b tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:03.938672 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a689f5af-0fda-40f1-a19a-535a16524e8b tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.024201 Jul 12 11:49:03.940157 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 37/61] 10.222.0.50 () {58 vars in 1168 bytes} [Tue Jul 12 11:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:03.953657 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-507db8b9-767d-47a2-a506-7c7009d1721b tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:03.975254 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-507db8b9-767d-47a2-a506-7c7009d1721b tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.026881 Jul 12 11:49:03.978199 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 38/62] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Jul 12 11:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:03.990503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e9d1f961-1da3-45a4-9887-8116b716b62c tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.017230 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e9d1f961-1da3-45a4-9887-8116b716b62c tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.031864 Jul 12 11:49:04.018316 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 39/63] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Jul 12 11:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:49:04.038819 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7fd1d6ee-1aff-444a-903d-a69b02c5422d tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.051919 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7fd1d6ee-1aff-444a-903d-a69b02c5422d tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.025036 Jul 12 11:49:04.052842 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 40/64] 10.222.0.50 () {58 vars in 1168 bytes} [Tue Jul 12 11:49:04 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:04.070027 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2b81048b-4094-4f72-98ae-932b0b826cb8 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.110313 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2b81048b-4094-4f72-98ae-932b0b826cb8 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.045375 Jul 12 11:49:04.113005 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 41/65] 10.222.0.50 () {58 vars in 1168 bytes} [Tue Jul 12 11:49:04 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:04.129183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1b4a9895-2f51-42a6-850d-2c9b0a43f9fd tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.135646 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b9283cdb-f5a7-49b0-84c1-50da0708309d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:04.151515 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b9283cdb-f5a7-49b0-84c1-50da0708309d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1243 microversion: 2.1 time: 0.353365 Jul 12 11:49:04.165570 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 25/66] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:03 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1243 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:04.174474 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1b4a9895-2f51-42a6-850d-2c9b0a43f9fd tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.050171 Jul 12 11:49:04.174474 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 42/67] 10.222.0.50 () {58 vars in 1174 bytes} [Tue Jul 12 11:49:04 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:04.189176 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-075a622f-e07d-43d6-a66b-1b1af0a66f6d tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.209830 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-075a622f-e07d-43d6-a66b-1b1af0a66f6d tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.024233 Jul 12 11:49:04.210881 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 26/68] 10.222.0.50 () {58 vars in 1172 bytes} [Tue Jul 12 11:49:04 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:04.226230 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-89e2e074-347f-49aa-9e43-d3a7d584de38 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.247860 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-89e2e074-347f-49aa-9e43-d3a7d584de38 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.026293 Jul 12 11:49:04.249076 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 43/69] 10.222.0.50 () {58 vars in 1168 bytes} [Tue Jul 12 11:49:04 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:04.268198 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b307f1b2-89ab-48c5-ad7b-7ace2d86d722 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.269119 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:04.269119 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:04.291526 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b307f1b2-89ab-48c5-ad7b-7ace2d86d722 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1004077886" status: 202 len: 0 microversion: 2.1 time: 0.028607 Jul 12 11:49:04.293905 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 27/70] 10.222.0.50 () {58 vars in 1160 bytes} [Tue Jul 12 11:49:04 2022] DELETE /compute/v2.1/flavors/1004077886 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:04.302533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6c239820-d482-4789-b9d0-33b781c4b157 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.325528 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6c239820-d482-4789-b9d0-33b781c4b157 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026765 Jul 12 11:49:04.326071 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 44/71] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:04.353072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cb8d1e98-c397-4b89-80a2-289e636de1d4 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.390783 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cb8d1e98-c397-4b89-80a2-289e636de1d4 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/736417023" status: 202 len: 0 microversion: 2.1 time: 0.053163 Jul 12 11:49:04.391442 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 28/72] 10.222.0.50 () {58 vars in 1157 bytes} [Tue Jul 12 11:49:04 2022] DELETE /compute/v2.1/flavors/736417023 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:04.402084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-addca7e6-768a-4a7c-99d9-a2c1e8b2f0db tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.458303 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-addca7e6-768a-4a7c-99d9-a2c1e8b2f0db tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062288 Jul 12 11:49:04.460580 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 45/73] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:04.477135 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-913a88bf-2d82-4d95-af2e-425a9b87ff49 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-915185827", "id": 1199064092, "os-flavor-access:is_public": "False"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:04.478615 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:04.478615 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:04.499126 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-913a88bf-2d82-4d95-af2e-425a9b87ff49 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.026342 Jul 12 11:49:04.500762 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 29/74] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:04 2022] POST /compute/v2.1/flavors => generated 414 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:04.512293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2eb6e383-44a2-4f1a-aefe-9a6b49b5b89d tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.547346 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2eb6e383-44a2-4f1a-aefe-9a6b49b5b89d tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039995 Jul 12 11:49:04.552121 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 46/75] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:04.570470 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7fad0a62-9bac-4ce3-a952-e73356ec76eb tempest-FlavorsAdminTestJSON-1948258969 tempest-FlavorsAdminTestJSON-1948258969-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.629066 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7fad0a62-9bac-4ce3-a952-e73356ec76eb tempest-FlavorsAdminTestJSON-1948258969 tempest-FlavorsAdminTestJSON-1948258969-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061204 Jul 12 11:49:04.633134 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 30/76] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:04.649443 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-16004692-0b31-4cc4-9b4d-155400e6399a tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.650383 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:04.650383 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:04.680586 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-16004692-0b31-4cc4-9b4d-155400e6399a tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1199064092" status: 202 len: 0 microversion: 2.1 time: 0.038022 Jul 12 11:49:04.682416 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 47/77] 10.222.0.50 () {58 vars in 1160 bytes} [Tue Jul 12 11:49:04 2022] DELETE /compute/v2.1/flavors/1199064092 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:04.692971 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-916d8a44-731b-4241-8155-45cf6ce408db tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.731737 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-916d8a44-731b-4241-8155-45cf6ce408db tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044215 Jul 12 11:49:04.732001 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 31/78] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:04.748932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cd240786-65b3-4ebf-b744-f3b796b21b6c tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1878051376", "id": 1060012532, "os-flavor-access:is_public": "True"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:04.750378 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:04.750378 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:04.775578 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cd240786-65b3-4ebf-b744-f3b796b21b6c tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.030495 Jul 12 11:49:04.780445 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 48/79] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:04 2022] POST /compute/v2.1/flavors => generated 414 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:04.790427 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cd12516c-8be9-4123-984a-cc85d960f602 tempest-FlavorsAdminTestJSON-1948258969 tempest-FlavorsAdminTestJSON-1948258969-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.817777 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cd12516c-8be9-4123-984a-cc85d960f602 tempest-FlavorsAdminTestJSON-1948258969 tempest-FlavorsAdminTestJSON-1948258969-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.033612 Jul 12 11:49:04.820208 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 32/80] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:04 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:04.835469 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6d76e43f-d8dc-431f-9205-493023f3c32a tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.863987 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6d76e43f-d8dc-431f-9205-493023f3c32a tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1060012532" status: 202 len: 0 microversion: 2.1 time: 0.032526 Jul 12 11:49:04.878260 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 49/81] 10.222.0.50 () {58 vars in 1160 bytes} [Tue Jul 12 11:49:04 2022] DELETE /compute/v2.1/flavors/1060012532 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:04.886617 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-be6874b0-da02-4def-8580-6417c7fd5766 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.931930 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-be6874b0-da02-4def-8580-6417c7fd5766 tempest-FlavorsAdminTestJSON-1983773507 tempest-FlavorsAdminTestJSON-1983773507-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048920 Jul 12 11:49:04.935008 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 33/82] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:04.941545 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3a473a2e-3828-4fe2-a36e-765a196d24fe tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:04.946693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3a473a2e-3828-4fe2-a36e-765a196d24fe tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:04.968458 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3a473a2e-3828-4fe2-a36e-765a196d24fe tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:04.970019 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3a473a2e-3828-4fe2-a36e-765a196d24fe tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:04.971268 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3a473a2e-3828-4fe2-a36e-765a196d24fe tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:04.971738 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3a473a2e-3828-4fe2-a36e-765a196d24fe tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:05.175023 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8d66b3c3-ea28-4a36-9b40-17324a5c4582 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:05.175592 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8d66b3c3-ea28-4a36-9b40-17324a5c4582 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:05.192440 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8d66b3c3-ea28-4a36-9b40-17324a5c4582 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:05.192440 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8d66b3c3-ea28-4a36-9b40-17324a5c4582 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:05.192870 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8d66b3c3-ea28-4a36-9b40-17324a5c4582 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:05.193332 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8d66b3c3-ea28-4a36-9b40-17324a5c4582 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:05.195407 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3a473a2e-3828-4fe2-a36e-765a196d24fe tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:05.205043 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3a473a2e-3828-4fe2-a36e-765a196d24fe tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1278 microversion: 2.1 time: 0.280716 Jul 12 11:49:05.209148 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 50/83] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:04 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1278 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:05.420473 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8d66b3c3-ea28-4a36-9b40-17324a5c4582 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:05.438156 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8d66b3c3-ea28-4a36-9b40-17324a5c4582 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1297 microversion: 2.1 time: 0.271551 Jul 12 11:49:05.450020 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 34/84] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:05 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1297 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:06.226064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d825b81e-3f27-461f-bb8d-34394bf90f46 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:06.227304 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d825b81e-3f27-461f-bb8d-34394bf90f46 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:06.240605 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d825b81e-3f27-461f-bb8d-34394bf90f46 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:06.242846 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d825b81e-3f27-461f-bb8d-34394bf90f46 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:06.246793 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d825b81e-3f27-461f-bb8d-34394bf90f46 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:06.247992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d825b81e-3f27-461f-bb8d-34394bf90f46 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:06.472495 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-df107ecc-c6be-4c5b-b34d-fbd8ca72d122 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:06.476105 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-df107ecc-c6be-4c5b-b34d-fbd8ca72d122 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:06.505950 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-df107ecc-c6be-4c5b-b34d-fbd8ca72d122 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:06.506642 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-df107ecc-c6be-4c5b-b34d-fbd8ca72d122 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:06.507644 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-df107ecc-c6be-4c5b-b34d-fbd8ca72d122 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:06.509926 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-df107ecc-c6be-4c5b-b34d-fbd8ca72d122 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:06.712403 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-df107ecc-c6be-4c5b-b34d-fbd8ca72d122 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:06.740558 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-df107ecc-c6be-4c5b-b34d-fbd8ca72d122 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1297 microversion: 2.1 time: 0.286139 Jul 12 11:49:06.743536 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 35/85] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:06 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1297 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:07.544757 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d825b81e-3f27-461f-bb8d-34394bf90f46 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:07.567577 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d825b81e-3f27-461f-bb8d-34394bf90f46 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 1.335135 Jul 12 11:49:07.578451 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 51/86] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:06 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:07.761501 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-47676c5b-9c0b-4590-8c8f-13830e119ec4 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:07.763149 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-47676c5b-9c0b-4590-8c8f-13830e119ec4 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:07.776727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47676c5b-9c0b-4590-8c8f-13830e119ec4 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:07.786278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47676c5b-9c0b-4590-8c8f-13830e119ec4 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:07.788168 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47676c5b-9c0b-4590-8c8f-13830e119ec4 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:07.792268 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47676c5b-9c0b-4590-8c8f-13830e119ec4 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:07.984760 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-47676c5b-9c0b-4590-8c8f-13830e119ec4 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:07.986701 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-47676c5b-9c0b-4590-8c8f-13830e119ec4 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1297 microversion: 2.1 time: 0.227903 Jul 12 11:49:07.987385 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 36/87] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:07 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1297 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:08.587398 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8d6c4faa-160d-4763-8861-38ca63510e66 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:08.588197 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8d6c4faa-160d-4763-8861-38ca63510e66 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:08.599943 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8d6c4faa-160d-4763-8861-38ca63510e66 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:08.604069 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8d6c4faa-160d-4763-8861-38ca63510e66 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:08.610069 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8d6c4faa-160d-4763-8861-38ca63510e66 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:08.610869 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8d6c4faa-160d-4763-8861-38ca63510e66 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:08.973756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3000f03a-2e54-4c5d-9b6d-58917d03ac24 tempest-AZAdminNegativeTestJSON-395950205 tempest-AZAdminNegativeTestJSON-395950205-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:08.978794 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:08.978794 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:08.979872 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3000f03a-2e54-4c5d-9b6d-58917d03ac24 tempest-AZAdminNegativeTestJSON-395950205 tempest-AZAdminNegativeTestJSON-395950205-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '063ec9d4f4074a0484e3f75156911d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdfd2293312412d875ec78afef40f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3000f03a-2e54-4c5d-9b6d-58917d03ac24 tempest-AZAdminNegativeTestJSON-395950205 tempest-AZAdminNegativeTestJSON-395950205-project] Request method failure captured: Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV-xFthyVEypvFXXJAXYgAid82fNkhSyQpPM_SapNtfzyh8YuZTBKYM022I5PPgfU8ahkg9tD_OFs6Tm4NfgcYLvUnU_TLJX_6D4sfVkDEUaNHpqXV1ScQyoCnveKSWNkPqDs6UJdtVFvFHya43bIIf7XZPGXbSkHBIWAqR3KTLYsRI Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 6cdfd2293312412d875ec78afef40f75 Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-AZAdminNegativeTestJSON-395950205 Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:09.023141 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:09.025220 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6cdfd2293312412d875ec78afef40f75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6cdfd2293312412d875ec78afef40f75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6cdfd2293312412d875ec78afef40f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6cdfd2293312412d875ec78afef40f75", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:09.025220 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-AZAdminNegativeTestJSON-395950205 Jul 12 11:49:09.025220 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 6cdfd2293312412d875ec78afef40f75 Jul 12 11:49:09.025220 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-395950205 Jul 12 11:49:09.025220 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-AZAdminNegativeTestJSON-395950205-project Jul 12 11:49:09.025220 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:09.025220 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:09.025220 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 063ec9d4f4074a0484e3f75156911d02 Jul 12 11:49:09.025220 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-AZAdminNegativeTestJSON-395950205-project Jul 12 11:49:09.025220 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:09.025220 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 12 11:49:09.025220 n-d-849104-4 devstack@n-api.service[125984]: action_args: {} Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:09.026471 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:09.027903 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3000f03a-2e54-4c5d-9b6d-58917d03ac24 tempest-AZAdminNegativeTestJSON-395950205 tempest-AZAdminNegativeTestJSON-395950205-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:09.030732 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3000f03a-2e54-4c5d-9b6d-58917d03ac24 tempest-AZAdminNegativeTestJSON-395950205 tempest-AZAdminNegativeTestJSON-395950205-project] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.745173 Jul 12 11:49:09.031481 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 52/88] 10.222.0.50 () {58 vars in 1184 bytes} [Tue Jul 12 11:49:08 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 750 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 12 11:49:09.055163 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8d6c4faa-160d-4763-8861-38ca63510e66 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:09.057550 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e18ad456-c30c-4f43-a4a9-75ab04e5dbe1 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:09.058251 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e18ad456-c30c-4f43-a4a9-75ab04e5dbe1 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:09.063665 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8d6c4faa-160d-4763-8861-38ca63510e66 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 0.481917 Jul 12 11:49:09.077403 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 37/89] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:08 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:09.091130 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e18ad456-c30c-4f43-a4a9-75ab04e5dbe1 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:09.091599 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e18ad456-c30c-4f43-a4a9-75ab04e5dbe1 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:09.114468 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e18ad456-c30c-4f43-a4a9-75ab04e5dbe1 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:09.114936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e18ad456-c30c-4f43-a4a9-75ab04e5dbe1 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:09.849274 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e18ad456-c30c-4f43-a4a9-75ab04e5dbe1 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:09.879245 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e18ad456-c30c-4f43-a4a9-75ab04e5dbe1 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.825255 Jul 12 11:49:09.881823 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 53/90] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:09 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:10.095648 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f18f6712-3085-4c83-8b89-88a6126915db tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:10.096280 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f18f6712-3085-4c83-8b89-88a6126915db tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:10.129121 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f18f6712-3085-4c83-8b89-88a6126915db tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:10.129963 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f18f6712-3085-4c83-8b89-88a6126915db tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:10.133747 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f18f6712-3085-4c83-8b89-88a6126915db tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:10.135403 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f18f6712-3085-4c83-8b89-88a6126915db tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:10.903152 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-89378a46-d8b3-41df-a00b-a169de5f6912 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:10.903875 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-89378a46-d8b3-41df-a00b-a169de5f6912 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:10.920553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-89378a46-d8b3-41df-a00b-a169de5f6912 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:10.922331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-89378a46-d8b3-41df-a00b-a169de5f6912 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:10.928299 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-89378a46-d8b3-41df-a00b-a169de5f6912 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:10.929208 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-89378a46-d8b3-41df-a00b-a169de5f6912 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:11.478139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f18f6712-3085-4c83-8b89-88a6126915db tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:11.496605 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f18f6712-3085-4c83-8b89-88a6126915db tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 1.415063 Jul 12 11:49:11.499088 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 38/91] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:10 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:11.742765 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-89378a46-d8b3-41df-a00b-a169de5f6912 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:11.753160 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-89378a46-d8b3-41df-a00b-a169de5f6912 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.854625 Jul 12 11:49:11.753756 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 54/92] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:10 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:12.168019 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-43b00261-bd6d-49f5-aefb-fb8fa47a012c req-9e877c78-5faf-4f36-8756-27be441d721b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "409e75a9-6ee8-4705-9f27-97989ba439a2", "tag": "5660c4c5-a274-499b-a33f-0b775b8ebc8e"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:12.201792 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-43b00261-bd6d-49f5-aefb-fb8fa47a012c req-9e877c78-5faf-4f36-8756-27be441d721b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:12.206313 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-43b00261-bd6d-49f5-aefb-fb8fa47a012c req-9e877c78-5faf-4f36-8756-27be441d721b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:12.287400 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-43b00261-bd6d-49f5-aefb-fb8fa47a012c req-9e877c78-5faf-4f36-8756-27be441d721b service nova] Creating event network-changed:5660c4c5-a274-499b-a33f-0b775b8ebc8e for instance 409e75a9-6ee8-4705-9f27-97989ba439a2 on n-h1-849104-4 Jul 12 11:49:12.290717 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-43b00261-bd6d-49f5-aefb-fb8fa47a012c req-9e877c78-5faf-4f36-8756-27be441d721b service nova] Acquired lock "compute-rpcapi-router" {{(pid=125983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 11:49:12.293020 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-46a7578a-ad97-43d2-9998-7c2b65a4596c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:12.297833 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-46a7578a-ad97-43d2-9998-7c2b65a4596c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:12.299338 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-46a7578a-ad97-43d2-9998-7c2b65a4596c None None] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:12.301782 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-46a7578a-ad97-43d2-9998-7c2b65a4596c None None] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:12.341704 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.compute.rpcapi [None req-46a7578a-ad97-43d2-9998-7c2b65a4596c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 11:49:12.349086 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-46a7578a-ad97-43d2-9998-7c2b65a4596c None None] Releasing lock "compute-rpcapi-router" {{(pid=125983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 11:49:12.407822 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-46a7578a-ad97-43d2-9998-7c2b65a4596c None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.907154 Jul 12 11:49:12.409097 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 39/93] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:12.501582 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:12.515475 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8ba377e4-b039-47d3-82f4-770034b12b8b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:12.517940 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8ba377e4-b039-47d3-82f4-770034b12b8b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:12.533073 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ba377e4-b039-47d3-82f4-770034b12b8b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:12.537529 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ba377e4-b039-47d3-82f4-770034b12b8b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:12.539660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ba377e4-b039-47d3-82f4-770034b12b8b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:12.547784 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ba377e4-b039-47d3-82f4-770034b12b8b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:13.061175 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-83678376-f913-417f-8487-a8cb6f6e64dc tempest-FlavorMetadataValidation-787127971 tempest-FlavorMetadataValidation-787127971-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-526186828", "id": 1662772604, "os-flavor-access:is_public": "True"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:13.064528 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:13.064528 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:13.114776 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=16,nova_api:INSERT=4 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:13.127502 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-83678376-f913-417f-8487-a8cb6f6e64dc tempest-FlavorMetadataValidation-787127971 tempest-FlavorMetadataValidation-787127971-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.631594 Jul 12 11:49:13.134601 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 55/94] 10.222.0.50 () {62 vars in 1187 bytes} [Tue Jul 12 11:49:12 2022] POST /compute/v2.1/flavors => generated 470 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:49:13.161260 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5a057730-6a74-4a3c-89c1-6acdb26e0865 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:13.166883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5a057730-6a74-4a3c-89c1-6acdb26e0865 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:13.205137 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a057730-6a74-4a3c-89c1-6acdb26e0865 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:13.205572 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a057730-6a74-4a3c-89c1-6acdb26e0865 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:13.206404 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a057730-6a74-4a3c-89c1-6acdb26e0865 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:13.206845 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a057730-6a74-4a3c-89c1-6acdb26e0865 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:13.664151 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8ba377e4-b039-47d3-82f4-770034b12b8b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:13.690636 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8ba377e4-b039-47d3-82f4-770034b12b8b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 1.176017 Jul 12 11:49:13.704648 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 40/95] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:12 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:13.710528 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-66aeff1f-9237-4092-af1d-09c51115d3f1 tempest-FlavorMetadataValidation-787127971 tempest-FlavorMetadataValidation-787127971-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:13.714083 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:13.714083 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:14.154143 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=18 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:14.347360 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-66aeff1f-9237-4092-af1d-09c51115d3f1 tempest-FlavorMetadataValidation-787127971 tempest-FlavorMetadataValidation-787127971-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1662772604/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.640985 Jul 12 11:49:14.349960 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 41/96] 10.222.0.50 () {62 vars in 1264 bytes} [Tue Jul 12 11:49:13 2022] POST /compute/v2.1/flavors/1662772604/os-extra_specs => generated 62 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:14.428128 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5a057730-6a74-4a3c-89c1-6acdb26e0865 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:14.453309 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5a057730-6a74-4a3c-89c1-6acdb26e0865 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 1.314950 Jul 12 11:49:14.454304 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 56/97] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:13 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:14.492383 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f868accf-17fe-49b6-96ac-0a84bc650649 tempest-FlavorMetadataValidation-787127971 tempest-FlavorMetadataValidation-787127971-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:14.495074 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:14.495074 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:14.560992 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f868accf-17fe-49b6-96ac-0a84bc650649 tempest-FlavorMetadataValidation-787127971 tempest-FlavorMetadataValidation-787127971-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1662772604" status: 202 len: 0 microversion: 2.86 time: 0.088140 Jul 12 11:49:14.570367 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 57/98] 10.222.0.50 () {60 vars in 1201 bytes} [Tue Jul 12 11:49:14 2022] DELETE /compute/v2.1/flavors/1662772604 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:49:14.589380 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-64d2ef54-a3f6-4c6a-ad1a-153581630166 tempest-FlavorMetadataValidation-787127971 tempest-FlavorMetadataValidation-787127971-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:14.659718 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-64d2ef54-a3f6-4c6a-ad1a-153581630166 tempest-FlavorMetadataValidation-787127971 tempest-FlavorMetadataValidation-787127971-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.087339 Jul 12 11:49:14.681346 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 58/99] 10.222.0.50 () {60 vars in 1186 bytes} [Tue Jul 12 11:49:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:49:14.712324 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4b51264a-5ec8-41c0-8b70-05fddb35df4b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:14.713196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4b51264a-5ec8-41c0-8b70-05fddb35df4b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:14.729202 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b51264a-5ec8-41c0-8b70-05fddb35df4b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:14.737303 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b51264a-5ec8-41c0-8b70-05fddb35df4b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:14.739406 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b51264a-5ec8-41c0-8b70-05fddb35df4b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:14.742946 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b51264a-5ec8-41c0-8b70-05fddb35df4b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:15.018198 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-0e966188-b1f4-4cc5-b8f5-ac09d9ed4416 req-57308aa3-39b2-406b-884b-c888f294a81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4298b8-89e6-4f58-a781-f850dab332a7", "tag": "e214e74f-a4a8-464c-9444-ac4d68d3ec0f"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:15.041381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-0e966188-b1f4-4cc5-b8f5-ac09d9ed4416 req-57308aa3-39b2-406b-884b-c888f294a81b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:15.042337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-0e966188-b1f4-4cc5-b8f5-ac09d9ed4416 req-57308aa3-39b2-406b-884b-c888f294a81b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:15.071905 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-0e966188-b1f4-4cc5-b8f5-ac09d9ed4416 req-57308aa3-39b2-406b-884b-c888f294a81b service nova] Creating event network-changed:e214e74f-a4a8-464c-9444-ac4d68d3ec0f for instance dd4298b8-89e6-4f58-a781-f850dab332a7 on n-h2-849104-4 Jul 12 11:49:15.095780 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-0e966188-b1f4-4cc5-b8f5-ac09d9ed4416 req-57308aa3-39b2-406b-884b-c888f294a81b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.739271 Jul 12 11:49:15.103310 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 42/100] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:15.471726 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4c9c4fca-239d-4688-962b-3334316a2f71 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:15.472558 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4c9c4fca-239d-4688-962b-3334316a2f71 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:15.487348 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4c9c4fca-239d-4688-962b-3334316a2f71 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:15.489819 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4c9c4fca-239d-4688-962b-3334316a2f71 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:15.493848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4c9c4fca-239d-4688-962b-3334316a2f71 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:15.498501 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4c9c4fca-239d-4688-962b-3334316a2f71 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:15.583180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4b51264a-5ec8-41c0-8b70-05fddb35df4b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:15.595502 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4b51264a-5ec8-41c0-8b70-05fddb35df4b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 0.886640 Jul 12 11:49:15.607291 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 59/101] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:14 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:15.880494 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4c9c4fca-239d-4688-962b-3334316a2f71 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:15.893049 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4c9c4fca-239d-4688-962b-3334316a2f71 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.425916 Jul 12 11:49:15.916867 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 43/102] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:15 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:15.965380 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bae58840-c639-4aed-a277-5845136bc75e tempest-FlavorsV261TestJSON-206547191 tempest-FlavorsV261TestJSON-206547191-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1367684821", "id": 91585114, "os-flavor-access:is_public": "True"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:15.967012 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:15.967012 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:16.016289 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bae58840-c639-4aed-a277-5845136bc75e tempest-FlavorsV261TestJSON-206547191 tempest-FlavorsV261TestJSON-206547191-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 462 microversion: 2.61 time: 0.403056 Jul 12 11:49:16.030272 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 60/103] 10.222.0.50 () {62 vars in 1187 bytes} [Tue Jul 12 11:49:15 2022] POST /compute/v2.1/flavors => generated 462 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:49:16.489183 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a8c232df-1070-4782-b8d8-7024f1972926 tempest-FlavorsV261TestJSON-2058192679 tempest-FlavorsV261TestJSON-2058192679-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:16.511271 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a8c232df-1070-4782-b8d8-7024f1972926 tempest-FlavorsV261TestJSON-2058192679 tempest-FlavorsV261TestJSON-2058192679-project] 10.222.0.50 "GET /compute/v2.1/flavors/91585114" status: 200 len: 462 microversion: 2.61 time: 0.485857 Jul 12 11:49:16.521583 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 44/104] 10.222.0.50 () {60 vars in 1192 bytes} [Tue Jul 12 11:49:16 2022] GET /compute/v2.1/flavors/91585114 => generated 462 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:49:16.529238 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b04fa585-9d1c-49d9-af87-7e1eaf324849 tempest-FlavorsV261TestJSON-206547191 tempest-FlavorsV261TestJSON-206547191-project-admin] Action: 'update', calling method: .version_select at 0x7f5e116b0a60>, body: {"flavor": {"description": "new"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:16.553300 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:16.553300 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:16.614350 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b04fa585-9d1c-49d9-af87-7e1eaf324849 tempest-FlavorsV261TestJSON-206547191 tempest-FlavorsV261TestJSON-206547191-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/91585114" status: 200 len: 463 microversion: 2.61 time: 0.091356 Jul 12 11:49:16.619960 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 61/105] 10.222.0.50 () {62 vars in 1212 bytes} [Tue Jul 12 11:49:16 2022] PUT /compute/v2.1/flavors/91585114 => generated 463 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:49:16.628768 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-02f7ee39-48d7-498c-ae02-baf785279105 tempest-FlavorsV261TestJSON-2058192679 tempest-FlavorsV261TestJSON-2058192679-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:16.630400 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f01b2150-947b-495e-9383-f973498e02e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:16.631242 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f01b2150-947b-495e-9383-f973498e02e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:16.674395 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f01b2150-947b-495e-9383-f973498e02e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:16.680205 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f01b2150-947b-495e-9383-f973498e02e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:16.681299 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f01b2150-947b-495e-9383-f973498e02e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:16.681625 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-02f7ee39-48d7-498c-ae02-baf785279105 tempest-FlavorsV261TestJSON-2058192679 tempest-FlavorsV261TestJSON-2058192679-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6244 microversion: 2.61 time: 0.057487 Jul 12 11:49:16.682189 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f01b2150-947b-495e-9383-f973498e02e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:16.696275 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 62/106] 10.222.0.50 () {60 vars in 1186 bytes} [Tue Jul 12 11:49:16 2022] GET /compute/v2.1/flavors/detail => generated 6244 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:49:16.726805 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-743f5981-4ba4-4033-8d05-38f2063250ef tempest-FlavorsV261TestJSON-2058192679 tempest-FlavorsV261TestJSON-2058192679-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:16.826804 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-743f5981-4ba4-4033-8d05-38f2063250ef tempest-FlavorsV261TestJSON-2058192679 tempest-FlavorsV261TestJSON-2058192679-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3151 microversion: 2.61 time: 0.130938 Jul 12 11:49:16.835340 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 63/107] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Jul 12 11:49:16 2022] GET /compute/v2.1/flavors => generated 3151 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:49:16.866879 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7135ef7f-1829-4756-8439-a78a4e6ca92f tempest-FlavorsV261TestJSON-206547191 tempest-FlavorsV261TestJSON-206547191-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:16.867767 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:16.867767 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:16.914009 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f01b2150-947b-495e-9383-f973498e02e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:16.928710 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f01b2150-947b-495e-9383-f973498e02e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 0.315555 Jul 12 11:49:16.938745 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 45/108] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:16 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:16.945301 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d3f7babf-efdf-4942-bb88-65577bc0120c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:16.947601 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d3f7babf-efdf-4942-bb88-65577bc0120c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:16.958275 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d3f7babf-efdf-4942-bb88-65577bc0120c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:16.958820 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d3f7babf-efdf-4942-bb88-65577bc0120c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:16.959746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d3f7babf-efdf-4942-bb88-65577bc0120c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:16.960424 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d3f7babf-efdf-4942-bb88-65577bc0120c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:16.963249 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7135ef7f-1829-4756-8439-a78a4e6ca92f tempest-FlavorsV261TestJSON-206547191 tempest-FlavorsV261TestJSON-206547191-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/91585114" status: 202 len: 0 microversion: 2.61 time: 0.117410 Jul 12 11:49:16.972167 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 64/109] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Jul 12 11:49:16 2022] DELETE /compute/v2.1/flavors/91585114 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:49:16.977495 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-73dbf8fc-4460-4dfd-9243-83abc5a74ca4 tempest-FlavorsV261TestJSON-206547191 tempest-FlavorsV261TestJSON-206547191-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:17.091337 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-73dbf8fc-4460-4dfd-9243-83abc5a74ca4 tempest-FlavorsV261TestJSON-206547191 tempest-FlavorsV261TestJSON-206547191-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.117814 Jul 12 11:49:17.099722 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 65/110] 10.222.0.50 () {60 vars in 1186 bytes} [Tue Jul 12 11:49:16 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:49:17.364602 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d3f7babf-efdf-4942-bb88-65577bc0120c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:17.373863 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d3f7babf-efdf-4942-bb88-65577bc0120c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.442168 Jul 12 11:49:17.378030 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 46/111] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:16 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:17.948670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1f3591da-c735-4302-a3d1-061809bcaf4e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:17.950030 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1f3591da-c735-4302-a3d1-061809bcaf4e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:17.974045 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1f3591da-c735-4302-a3d1-061809bcaf4e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:17.974839 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1f3591da-c735-4302-a3d1-061809bcaf4e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:17.977450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1f3591da-c735-4302-a3d1-061809bcaf4e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:17.979326 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1f3591da-c735-4302-a3d1-061809bcaf4e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:18.056905 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:18.398846 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6631828a-c832-4dba-ad4a-0aedc6556307 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:18.401151 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6631828a-c832-4dba-ad4a-0aedc6556307 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:18.431738 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6631828a-c832-4dba-ad4a-0aedc6556307 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:18.433841 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6631828a-c832-4dba-ad4a-0aedc6556307 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:18.444539 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6631828a-c832-4dba-ad4a-0aedc6556307 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:18.446598 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6631828a-c832-4dba-ad4a-0aedc6556307 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:18.880500 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1f3591da-c735-4302-a3d1-061809bcaf4e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:18.896679 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1f3591da-c735-4302-a3d1-061809bcaf4e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 0.953196 Jul 12 11:49:18.900397 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 66/112] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:17 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:18.955260 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6631828a-c832-4dba-ad4a-0aedc6556307 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:18.969530 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6631828a-c832-4dba-ad4a-0aedc6556307 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.577407 Jul 12 11:49:18.977095 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 47/113] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:18 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:19.916555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-44aef87c-f5b9-4752-bdfa-af0a8e6d30af tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:19.918361 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-44aef87c-f5b9-4752-bdfa-af0a8e6d30af tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:19.932343 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9acd513b-0e86-4ceb-8ae9-76bee42e0222 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Action: 'update', calling method: .version_select at 0x7f5e0af2caf0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:19.935269 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:19.935269 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:19.937295 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9acd513b-0e86-4ceb-8ae9-76bee42e0222 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:19.938018 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9acd513b-0e86-4ceb-8ae9-76bee42e0222 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:19.969204 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-44aef87c-f5b9-4752-bdfa-af0a8e6d30af tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:19.970184 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-44aef87c-f5b9-4752-bdfa-af0a8e6d30af tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:19.972167 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-44aef87c-f5b9-4752-bdfa-af0a8e6d30af tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:19.975883 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-44aef87c-f5b9-4752-bdfa-af0a8e6d30af tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:19.979306 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9acd513b-0e86-4ceb-8ae9-76bee42e0222 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:19.986181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9acd513b-0e86-4ceb-8ae9-76bee42e0222 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:20.041636 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-9acd513b-0e86-4ceb-8ae9-76bee42e0222 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] HTTP exception thrown: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9acd513b-0e86-4ceb-8ae9-76bee42e0222 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Request method failure captured: Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: request: PUT /compute/v2.1/os-services/523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 HTTP/1.1 Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 56 Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV-_1nhyKWr1l3bCqKOVap_lsEAiIFYGgXGhL3UwwUdUAW6UscYPstlQ48Favn5vxsRSBkGGCXrIn2HLHSD0xmYDnIYRKrQX2kJlPKCkFueNCLn7uKKYALRJZTfLURvripPZgHhtnUEKEhJ1yqHgC8n2gU9rTZud0mBrOUh41jPUar0 Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: X-Openstack-Nova-Api-Version: 2.53 Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: c8bfb239de544615814e82fd219b64aa Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1433396059 Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:49:20.065318 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:49:20.066853 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8bfb239de544615814e82fd219b64aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8bfb239de544615814e82fd219b64aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8bfb239de544615814e82fd219b64aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8bfb239de544615814e82fd219b64aa", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:20.066853 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1433396059 Jul 12 11:49:20.066853 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: c8bfb239de544615814e82fd219b64aa Jul 12 11:49:20.066853 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1433396059 Jul 12 11:49:20.066853 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin Jul 12 11:49:20.066853 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:20.066853 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:20.066853 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 12d5ac0f29a24575b35110f8ae06d583 Jul 12 11:49:20.066853 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin Jul 12 11:49:20.066853 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:49:20.066853 n-d-849104-4 devstack@n-api.service[125984]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 12 11:49:20.066853 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:49:20.066853 n-d-849104-4 devstack@n-api.service[125984]: exception: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.067978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:20.069221 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:20.070562 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:20.070562 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.070562 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.072090 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9acd513b-0e86-4ceb-8ae9-76bee42e0222 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Returning 404 to user: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:20.074704 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9acd513b-0e86-4ceb-8ae9-76bee42e0222 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9" status: 404 len: 110 microversion: 2.53 time: 0.399998 Jul 12 11:49:20.076586 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 67/114] 10.222.0.50 () {62 vars in 1308 bytes} [Tue Jul 12 11:49:19 2022] PUT /compute/v2.1/os-services/523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 => generated 110 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:49:20.089110 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b07e5d0c-6032-45f7-9f65-d1ca56b8defa tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:20.090243 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b07e5d0c-6032-45f7-9f65-d1ca56b8defa tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:20.109802 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b07e5d0c-6032-45f7-9f65-d1ca56b8defa tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:20.111405 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b07e5d0c-6032-45f7-9f65-d1ca56b8defa tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:20.113493 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b07e5d0c-6032-45f7-9f65-d1ca56b8defa tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:20.116738 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b07e5d0c-6032-45f7-9f65-d1ca56b8defa tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:20.545768 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b07e5d0c-6032-45f7-9f65-d1ca56b8defa tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:20.557259 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b07e5d0c-6032-45f7-9f65-d1ca56b8defa tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.479197 Jul 12 11:49:20.565195 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 68/115] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:20 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:20.573848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3dea4221-92c2-44ea-885a-fa76f5cf4296 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Action: 'update', calling method: .version_select at 0x7f5e0ad55670>, body: {"status": "disabled"} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:20.581551 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:20.581551 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:20.589311 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3dea4221-92c2-44ea-885a-fa76f5cf4296 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:20.589984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3dea4221-92c2-44ea-885a-fa76f5cf4296 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:20.608937 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3dea4221-92c2-44ea-885a-fa76f5cf4296 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:20.610453 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3dea4221-92c2-44ea-885a-fa76f5cf4296 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:20.631328 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-44aef87c-f5b9-4752-bdfa-af0a8e6d30af tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:20.651931 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-3dea4221-92c2-44ea-885a-fa76f5cf4296 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] HTTP exception thrown: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3dea4221-92c2-44ea-885a-fa76f5cf4296 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Request method failure captured: Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: request: PUT /compute/v2.1/os-services/523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 HTTP/1.1 Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 22 Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV-_1nhyKWr1l3bCqKOVap_lsEAiIFYGgXGhL3UwwUdUAW6UscYPstlQ48Favn5vxsRSBkGGCXrIn2HLHSD0xmYDnIYRKrQX2kJlPKCkFueNCLn7uKKYALRJZTfLURvripPZgHhtnUEKEhJ1yqHgC8n2gU9rTZud0mBrOUh41jPUar0 Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: X-Openstack-Nova-Api-Version: 2.53 Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: c8bfb239de544615814e82fd219b64aa Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1433396059 Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:49:20.655784 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:49:20.657976 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8bfb239de544615814e82fd219b64aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8bfb239de544615814e82fd219b64aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8bfb239de544615814e82fd219b64aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8bfb239de544615814e82fd219b64aa", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:20.657976 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1433396059 Jul 12 11:49:20.657976 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: c8bfb239de544615814e82fd219b64aa Jul 12 11:49:20.657976 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1433396059 Jul 12 11:49:20.657976 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin Jul 12 11:49:20.657976 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:20.657976 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:20.657976 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 12d5ac0f29a24575b35110f8ae06d583 Jul 12 11:49:20.657976 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin Jul 12 11:49:20.657976 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:49:20.657976 n-d-849104-4 devstack@n-api.service[125984]: {"status": "disabled"} Jul 12 11:49:20.657976 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:49:20.657976 n-d-849104-4 devstack@n-api.service[125984]: exception: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.657976 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9', 'body': {'status': 'disabled'}} Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:20.659422 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:20.660631 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:20.663206 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.663206 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.675709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3dea4221-92c2-44ea-885a-fa76f5cf4296 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Returning 404 to user: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:20.686208 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3dea4221-92c2-44ea-885a-fa76f5cf4296 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9" status: 404 len: 110 microversion: 2.53 time: 0.119372 Jul 12 11:49:20.691134 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 69/116] 10.222.0.50 () {62 vars in 1308 bytes} [Tue Jul 12 11:49:20 2022] PUT /compute/v2.1/os-services/523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 => generated 110 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:49:20.693110 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-44aef87c-f5b9-4752-bdfa-af0a8e6d30af tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 0.773541 Jul 12 11:49:20.694492 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 48/117] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:19 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:20.714305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-735c1e56-5cfa-49b7-b618-d47345e178a6 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Action: 'update', calling method: .version_select at 0x7f5e0ad65ee0>, body: {"status": "enabled"} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:20.730561 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-735c1e56-5cfa-49b7-b618-d47345e178a6 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:20.740344 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-735c1e56-5cfa-49b7-b618-d47345e178a6 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:20.762968 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-735c1e56-5cfa-49b7-b618-d47345e178a6 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:20.763854 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-735c1e56-5cfa-49b7-b618-d47345e178a6 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:20.772742 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-735c1e56-5cfa-49b7-b618-d47345e178a6 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] HTTP exception thrown: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-735c1e56-5cfa-49b7-b618-d47345e178a6 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Request method failure captured: Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: request: PUT /compute/v2.1/os-services/523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 HTTP/1.1 Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 21 Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV-_1nhyKWr1l3bCqKOVap_lsEAiIFYGgXGhL3UwwUdUAW6UscYPstlQ48Favn5vxsRSBkGGCXrIn2HLHSD0xmYDnIYRKrQX2kJlPKCkFueNCLn7uKKYALRJZTfLURvripPZgHhtnUEKEhJ1yqHgC8n2gU9rTZud0mBrOUh41jPUar0 Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: X-Openstack-Nova-Api-Version: 2.53 Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: c8bfb239de544615814e82fd219b64aa Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1433396059 Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:49:20.778852 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:49:20.783243 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8bfb239de544615814e82fd219b64aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8bfb239de544615814e82fd219b64aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8bfb239de544615814e82fd219b64aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8bfb239de544615814e82fd219b64aa", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:20.783243 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1433396059 Jul 12 11:49:20.783243 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: c8bfb239de544615814e82fd219b64aa Jul 12 11:49:20.783243 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1433396059 Jul 12 11:49:20.783243 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin Jul 12 11:49:20.783243 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:20.783243 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:20.783243 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 12d5ac0f29a24575b35110f8ae06d583 Jul 12 11:49:20.783243 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin Jul 12 11:49:20.783243 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:49:20.783243 n-d-849104-4 devstack@n-api.service[125984]: {"status": "enabled"} Jul 12 11:49:20.783243 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:49:20.783243 n-d-849104-4 devstack@n-api.service[125984]: exception: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.783243 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9', 'body': {'status': 'enabled'}} Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:20.784100 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:20.785950 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:20.789071 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. Jul 12 11:49:20.789071 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:20.789071 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-735c1e56-5cfa-49b7-b618-d47345e178a6 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Returning 404 to user: Service 523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:20.790531 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-735c1e56-5cfa-49b7-b618-d47345e178a6 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9" status: 404 len: 110 microversion: 2.53 time: 0.084611 Jul 12 11:49:20.792627 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 70/118] 10.222.0.50 () {62 vars in 1308 bytes} [Tue Jul 12 11:49:20 2022] PUT /compute/v2.1/os-services/523ddf6c-40ce-4ea8-bf04-9e8ec3b7dde9 => generated 110 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:49:20.809143 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bdebf3dc-4b88-4423-a41a-64c97b9ace66 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:20.816488 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:20.816488 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:20.825275 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bdebf3dc-4b88-4423-a41a-64c97b9ace66 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:20.825855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bdebf3dc-4b88-4423-a41a-64c97b9ace66 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:20.826796 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bdebf3dc-4b88-4423-a41a-64c97b9ace66 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:20.827390 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bdebf3dc-4b88-4423-a41a-64c97b9ace66 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:20.900262 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bdebf3dc-4b88-4423-a41a-64c97b9ace66 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.090088 Jul 12 11:49:20.907292 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 49/119] 10.222.0.50 () {60 vars in 1177 bytes} [Tue Jul 12 11:49:20 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:49:20.912497 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fc86eefe-4958-4ebe-a74a-93b082387f55 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:20.914074 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:20.914074 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:20.916578 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc86eefe-4958-4ebe-a74a-93b082387f55 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:20.917164 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc86eefe-4958-4ebe-a74a-93b082387f55 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:20.922809 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc86eefe-4958-4ebe-a74a-93b082387f55 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:20.923487 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc86eefe-4958-4ebe-a74a-93b082387f55 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:20.979410 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fc86eefe-4958-4ebe-a74a-93b082387f55 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.070643 Jul 12 11:49:20.990946 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 71/120] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Jul 12 11:49:20 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1261 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:49:21.000164 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1d55bd90-82e6-4d53-bdfa-adfd106683e0 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:21.001199 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:21.001199 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:21.003095 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d55bd90-82e6-4d53-bdfa-adfd106683e0 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:21.003748 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d55bd90-82e6-4d53-bdfa-adfd106683e0 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:21.005229 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d55bd90-82e6-4d53-bdfa-adfd106683e0 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:21.005609 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d55bd90-82e6-4d53-bdfa-adfd106683e0 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:21.043826 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=9,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:21.079473 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1d55bd90-82e6-4d53-bdfa-adfd106683e0 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.085387 Jul 12 11:49:21.080133 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 50/121] 10.222.0.50 () {60 vars in 1177 bytes} [Tue Jul 12 11:49:20 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:49:21.092143 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fb48d947-bf67-48e8-ae9f-0b1499a50bad tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:21.093833 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:21.093833 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:21.095155 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb48d947-bf67-48e8-ae9f-0b1499a50bad tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:21.095620 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb48d947-bf67-48e8-ae9f-0b1499a50bad tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:21.112667 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb48d947-bf67-48e8-ae9f-0b1499a50bad tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:21.114102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb48d947-bf67-48e8-ae9f-0b1499a50bad tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:21.192432 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fb48d947-bf67-48e8-ae9f-0b1499a50bad tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-849104-4&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.103998 Jul 12 11:49:21.197314 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 72/122] 10.222.0.50 () {60 vars in 1234 bytes} [Tue Jul 12 11:49:21 2022] GET /compute/v2.1/os-services?host=n-d-849104-4&binary=xxx => generated 16 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:21.210331 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8f279ac6-b499-419e-9b55-f741ff386492 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:21.211808 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:21.211808 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:21.213417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8f279ac6-b499-419e-9b55-f741ff386492 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:21.214470 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8f279ac6-b499-419e-9b55-f741ff386492 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:21.215497 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8f279ac6-b499-419e-9b55-f741ff386492 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:21.218395 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8f279ac6-b499-419e-9b55-f741ff386492 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:21.280209 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8f279ac6-b499-419e-9b55-f741ff386492 tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.074352 Jul 12 11:49:21.285354 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 51/123] 10.222.0.50 () {60 vars in 1177 bytes} [Tue Jul 12 11:49:21 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:49:21.297059 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-62cbb187-67b2-47fa-937d-fcb8ebae477b tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:21.298862 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:21.298862 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:21.300386 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-62cbb187-67b2-47fa-937d-fcb8ebae477b tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:21.301351 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-62cbb187-67b2-47fa-937d-fcb8ebae477b tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:21.302330 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-62cbb187-67b2-47fa-937d-fcb8ebae477b tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:21.303112 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-62cbb187-67b2-47fa-937d-fcb8ebae477b tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:21.356198 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-62cbb187-67b2-47fa-937d-fcb8ebae477b tempest-ServicesAdminNegativeV253TestJSON-1433396059 tempest-ServicesAdminNegativeV253TestJSON-1433396059-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.062531 Jul 12 11:49:21.357402 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 73/124] 10.222.0.50 () {60 vars in 1238 bytes} [Tue Jul 12 11:49:21 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:21.583385 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a7846fe0-3e2c-4ba7-8674-294bbe2a5629 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:21.584319 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a7846fe0-3e2c-4ba7-8674-294bbe2a5629 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:21.600384 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7846fe0-3e2c-4ba7-8674-294bbe2a5629 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:21.603986 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7846fe0-3e2c-4ba7-8674-294bbe2a5629 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:21.606003 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7846fe0-3e2c-4ba7-8674-294bbe2a5629 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:21.607170 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7846fe0-3e2c-4ba7-8674-294bbe2a5629 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:21.928442 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a7846fe0-3e2c-4ba7-8674-294bbe2a5629 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:21.936995 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a7846fe0-3e2c-4ba7-8674-294bbe2a5629 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.358395 Jul 12 11:49:21.941235 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 74/125] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:21 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:21.958406 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7ac8aa23-96ef-43bd-9bdb-0499cf9c8edf tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:21.964008 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7ac8aa23-96ef-43bd-9bdb-0499cf9c8edf tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:21.985202 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ac8aa23-96ef-43bd-9bdb-0499cf9c8edf tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:21.987485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ac8aa23-96ef-43bd-9bdb-0499cf9c8edf tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:21.989931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ac8aa23-96ef-43bd-9bdb-0499cf9c8edf tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:21.992595 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ac8aa23-96ef-43bd-9bdb-0499cf9c8edf tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:22.078657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-448f3dc0-0bcc-4977-8e51-996caa2e3f7b tempest-ServicesAdminNegativeV253TestJSON-592579296 tempest-ServicesAdminNegativeV253TestJSON-592579296-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:22.080581 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:22.080581 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:22.082044 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-448f3dc0-0bcc-4977-8e51-996caa2e3f7b tempest-ServicesAdminNegativeV253TestJSON-592579296 tempest-ServicesAdminNegativeV253TestJSON-592579296-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '86442dd30d094d20a599c4f43c47b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15331bfa2bbc4425afb367926b0cffa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-448f3dc0-0bcc-4977-8e51-996caa2e3f7b tempest-ServicesAdminNegativeV253TestJSON-592579296 tempest-ServicesAdminNegativeV253TestJSON-592579296-project] Request method failure captured: Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-8aPUF3rg1ys4Bx_DHQYcqcw70c1_eh4dWvHXaS3U-7nHLhKIlftVq_rOMS8ax1V8MAcJWhRDqXBZ0MpurKLMxFe3Q_jeQNITaNfoIxYFJRjzB8if1cjW0VFoTwb7gABw1HakcLqf587u5-0WC2XRcZ8fP03g1urja4ZegQcHt6dc Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: X-Openstack-Nova-Api-Version: 2.53 Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 15331bfa2bbc4425afb367926b0cffa6 Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-592579296 Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:22.089358 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:22.090731 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/15331bfa2bbc4425afb367926b0cffa6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/15331bfa2bbc4425afb367926b0cffa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/15331bfa2bbc4425afb367926b0cffa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_15331bfa2bbc4425afb367926b0cffa6", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:22.090731 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-592579296 Jul 12 11:49:22.090731 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 15331bfa2bbc4425afb367926b0cffa6 Jul 12 11:49:22.090731 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-592579296 Jul 12 11:49:22.090731 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServicesAdminNegativeV253TestJSON-592579296-project Jul 12 11:49:22.090731 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:22.090731 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:22.090731 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 86442dd30d094d20a599c4f43c47b910 Jul 12 11:49:22.090731 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-592579296-project Jul 12 11:49:22.090731 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:22.090731 n-d-849104-4 devstack@n-api.service[125983]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 12 11:49:22.090731 n-d-849104-4 devstack@n-api.service[125983]: action_args: {} Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:22.091420 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 12 11:49:22.092402 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:22.098771 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-448f3dc0-0bcc-4977-8e51-996caa2e3f7b tempest-ServicesAdminNegativeV253TestJSON-592579296 tempest-ServicesAdminNegativeV253TestJSON-592579296-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:22.105456 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-448f3dc0-0bcc-4977-8e51-996caa2e3f7b tempest-ServicesAdminNegativeV253TestJSON-592579296 tempest-ServicesAdminNegativeV253TestJSON-592579296-project] 10.222.0.50 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.739540 Jul 12 11:49:22.115591 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 52/126] 10.222.0.50 () {60 vars in 1177 bytes} [Tue Jul 12 11:49:21 2022] GET /compute/v2.1/os-services => generated 112 bytes in 750 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:49:22.642371 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7ac8aa23-96ef-43bd-9bdb-0499cf9c8edf tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:22.655798 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7ac8aa23-96ef-43bd-9bdb-0499cf9c8edf tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 0.706374 Jul 12 11:49:22.664125 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 75/127] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:21 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:22.959999 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5753a543-64f0-4c92-8ee9-02b206a2416c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:22.961375 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5753a543-64f0-4c92-8ee9-02b206a2416c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:22.968482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5753a543-64f0-4c92-8ee9-02b206a2416c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:22.969672 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5753a543-64f0-4c92-8ee9-02b206a2416c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:22.970463 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5753a543-64f0-4c92-8ee9-02b206a2416c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:22.970897 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5753a543-64f0-4c92-8ee9-02b206a2416c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:22.984847 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:23.389325 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5753a543-64f0-4c92-8ee9-02b206a2416c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:23.408963 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5753a543-64f0-4c92-8ee9-02b206a2416c tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.453170 Jul 12 11:49:23.417006 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 53/128] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:22 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:23.468077 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-88ae2b5e-6184-480b-9242-f73a1c379efb tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-254563106", "ram": 512, "vcpus": 1, "disk": 10, "id": 726562755, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:23.469756 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:23.469756 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:23.498606 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-88ae2b5e-6184-480b-9242-f73a1c379efb tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.260301 Jul 12 11:49:23.500241 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 76/129] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:23 2022] POST /compute/v2.1/flavors => generated 412 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:23.515174 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5e638a83-c154-4d6d-acff-177ba22b0297 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:23.517282 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:23.517282 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:23.573205 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5e638a83-c154-4d6d-acff-177ba22b0297 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/726562755/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065552 Jul 12 11:49:23.579417 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 54/130] 10.222.0.50 () {60 vars in 1220 bytes} [Tue Jul 12 11:49:23 2022] POST /compute/v2.1/flavors/726562755/os-extra_specs => generated 66 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:23.678971 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-652191c0-6269-4ecd-b73b-67c4500b42e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:23.679861 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-652191c0-6269-4ecd-b73b-67c4500b42e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:23.687664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-652191c0-6269-4ecd-b73b-67c4500b42e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:23.688079 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-652191c0-6269-4ecd-b73b-67c4500b42e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:23.693070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-652191c0-6269-4ecd-b73b-67c4500b42e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:23.693854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-652191c0-6269-4ecd-b73b-67c4500b42e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:23.897162 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2de2c134-b902-499f-a662-07e7a0062fc0 tempest-FlavorsExtraSpecsTestJSON-379625040 tempest-FlavorsExtraSpecsTestJSON-379625040-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:23.921236 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2de2c134-b902-499f-a662-07e7a0062fc0 tempest-FlavorsExtraSpecsTestJSON-379625040 tempest-FlavorsExtraSpecsTestJSON-379625040-project] 10.222.0.50 "GET /compute/v2.1/flavors/726562755/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.340858 Jul 12 11:49:23.927378 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 77/131] 10.222.0.50 () {58 vars in 1199 bytes} [Tue Jul 12 11:49:23 2022] GET /compute/v2.1/flavors/726562755/os-extra_specs => generated 66 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:23.932536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6d7657ca-04d6-44b7-99a2-2354731fbf8d tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:23.934189 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:23.934189 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:23.961743 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6d7657ca-04d6-44b7-99a2-2354731fbf8d tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/726562755/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032865 Jul 12 11:49:23.967536 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 78/132] 10.222.0.50 () {60 vars in 1220 bytes} [Tue Jul 12 11:49:23 2022] POST /compute/v2.1/flavors/726562755/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 11:49:23.976854 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-987d9359-33e1-4494-9dba-f2572d3b2071 tempest-FlavorsExtraSpecsTestJSON-379625040 tempest-FlavorsExtraSpecsTestJSON-379625040-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:23.992213 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-987d9359-33e1-4494-9dba-f2572d3b2071 tempest-FlavorsExtraSpecsTestJSON-379625040 tempest-FlavorsExtraSpecsTestJSON-379625040-project] 10.222.0.50 "GET /compute/v2.1/flavors/726562755/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.022527 Jul 12 11:49:23.993710 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 79/133] 10.222.0.50 () {58 vars in 1241 bytes} [Tue Jul 12 11:49:23 2022] GET /compute/v2.1/flavors/726562755/os-extra_specs/hw:numa_nodes => generated 22 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:24.012638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b8606ded-a583-41c6-83d4-8ff202defeb0 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:24.045673 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b8606ded-a583-41c6-83d4-8ff202defeb0 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/726562755/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044791 Jul 12 11:49:24.046804 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 80/134] 10.222.0.50 () {60 vars in 1220 bytes} [Tue Jul 12 11:49:23 2022] POST /compute/v2.1/flavors/726562755/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 11:49:24.055010 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-652191c0-6269-4ecd-b73b-67c4500b42e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:24.062442 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fdb2ade2-d34f-4732-a486-ee92702d48a5 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:24.067190 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-652191c0-6269-4ecd-b73b-67c4500b42e5 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 0.392714 Jul 12 11:49:24.079855 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fdb2ade2-d34f-4732-a486-ee92702d48a5 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/726562755/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023402 Jul 12 11:49:24.081195 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 81/135] 10.222.0.50 () {58 vars in 1199 bytes} [Tue Jul 12 11:49:24 2022] GET /compute/v2.1/flavors/726562755/os-extra_specs => generated 66 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:24.082671 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 55/136] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:23 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:24.091382 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8b99730e-93f3-4a3d-94cb-33e5a5ebf828 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:24.093961 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:24.093961 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:24.145970 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8b99730e-93f3-4a3d-94cb-33e5a5ebf828 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/726562755/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.059366 Jul 12 11:49:24.148014 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 82/137] 10.222.0.50 () {60 vars in 1261 bytes} [Tue Jul 12 11:49:24 2022] PUT /compute/v2.1/flavors/726562755/os-extra_specs/hw:numa_nodes => generated 22 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:24.158049 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-430bfbf2-8299-41c7-9abf-cc9b2cb288f3 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:24.194989 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-430bfbf2-8299-41c7-9abf-cc9b2cb288f3 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/726562755/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043201 Jul 12 11:49:24.195883 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 56/138] 10.222.0.50 () {58 vars in 1199 bytes} [Tue Jul 12 11:49:24 2022] GET /compute/v2.1/flavors/726562755/os-extra_specs => generated 66 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:24.206163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ed97ce9d-c29b-4706-bd51-2f1b138782ac tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:24.206950 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:24.206950 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:24.210732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=6,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:SAVEPOINT=6,nova_api:RELEASE=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:24.259218 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ed97ce9d-c29b-4706-bd51-2f1b138782ac tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/726562755/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.057039 Jul 12 11:49:24.259940 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 83/139] 10.222.0.50 () {58 vars in 1244 bytes} [Tue Jul 12 11:49:24 2022] DELETE /compute/v2.1/flavors/726562755/os-extra_specs/hw:numa_nodes => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:24.267930 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2d7dea13-916f-4f40-88df-86644d10c8e4 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:24.279116 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:24.279116 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:24.323389 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2d7dea13-916f-4f40-88df-86644d10c8e4 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/726562755/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.059309 Jul 12 11:49:24.324457 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 57/140] 10.222.0.50 () {58 vars in 1244 bytes} [Tue Jul 12 11:49:24 2022] DELETE /compute/v2.1/flavors/726562755/os-extra_specs/hw:cpu_policy => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 12 11:49:24.333009 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-11b2b6f6-0df1-474a-a518-cecec57dff03 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:24.343613 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-11b2b6f6-0df1-474a-a518-cecec57dff03 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/726562755/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014797 Jul 12 11:49:24.344262 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 84/141] 10.222.0.50 () {58 vars in 1199 bytes} [Tue Jul 12 11:49:24 2022] GET /compute/v2.1/flavors/726562755/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 11:49:24.358184 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2843c99b-9499-4382-83e9-146fea110e7f tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:24.360916 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:24.360916 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:24.409141 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2843c99b-9499-4382-83e9-146fea110e7f tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/726562755" status: 202 len: 0 microversion: 2.1 time: 0.056812 Jul 12 11:49:24.412754 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 58/142] 10.222.0.50 () {58 vars in 1157 bytes} [Tue Jul 12 11:49:24 2022] DELETE /compute/v2.1/flavors/726562755 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:24.420138 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c74fadbf-af71-4020-86e2-c003bafd3cb3 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:24.453881 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c74fadbf-af71-4020-86e2-c003bafd3cb3 tempest-FlavorsExtraSpecsTestJSON-1249490030 tempest-FlavorsExtraSpecsTestJSON-1249490030-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037246 Jul 12 11:49:24.455537 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 59/143] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:24.461564 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-329c7a0d-ad5c-4dd8-a65c-69419b824f94 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:24.462399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-329c7a0d-ad5c-4dd8-a65c-69419b824f94 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:24.486772 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-329c7a0d-ad5c-4dd8-a65c-69419b824f94 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:24.487566 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-329c7a0d-ad5c-4dd8-a65c-69419b824f94 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:24.488915 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-329c7a0d-ad5c-4dd8-a65c-69419b824f94 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:24.489572 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-329c7a0d-ad5c-4dd8-a65c-69419b824f94 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:24.837832 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5be65a9b-9a9a-4f3d-8e3b-4a25dcfd42bb tempest-InstanceUsageAuditLogNegativeTestJSON-704633435 tempest-InstanceUsageAuditLogNegativeTestJSON-704633435-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:24.838759 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:24.838759 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:24.842694 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-5be65a9b-9a9a-4f3d-8e3b-4a25dcfd42bb tempest-InstanceUsageAuditLogNegativeTestJSON-704633435 tempest-InstanceUsageAuditLogNegativeTestJSON-704633435-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 12 11:49:24.854238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-329c7a0d-ad5c-4dd8-a65c-69419b824f94 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5be65a9b-9a9a-4f3d-8e3b-4a25dcfd42bb tempest-InstanceUsageAuditLogNegativeTestJSON-704633435 tempest-InstanceUsageAuditLogNegativeTestJSON-704633435-project-admin] Request method failure captured: Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_E6C66GZL7ne5uEsbWSpr59ZXHc9yVafCgYqeRrztRm2mpaIl5OqdMU9n_rSxOyI9exK5e3lecPcIYBxvYthuOH0vA_UUUNkjBQn_r-i1BWhFWg-Ym2z72Vag73jsid9VkqXSh5cotkjdNw7AZRAN0gcDMaGnA1u_OG2Z9AsDjq1g Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: c4b53f89e59e40158a9684956c6d3f41 Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-704633435 Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:49:24.856975 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:49:24.858204 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c4b53f89e59e40158a9684956c6d3f41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c4b53f89e59e40158a9684956c6d3f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c4b53f89e59e40158a9684956c6d3f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c4b53f89e59e40158a9684956c6d3f41", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:24.858204 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-704633435 Jul 12 11:49:24.858204 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: c4b53f89e59e40158a9684956c6d3f41 Jul 12 11:49:24.858204 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-704633435 Jul 12 11:49:24.858204 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-704633435-project-admin Jul 12 11:49:24.858204 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:24.858204 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:24.858204 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 2b25aef9fcea40d2b470fcdfa9e8461d Jul 12 11:49:24.858204 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-704633435-project-admin Jul 12 11:49:24.858204 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:24.858204 n-d-849104-4 devstack@n-api.service[125984]: exception: Invalid timestamp for date invalid_time Jul 12 11:49:24.858204 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'invalid_time'} Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:24.858826 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 12 11:49:24.860338 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 12 11:49:24.860338 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 12 11:49:24.860338 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:24.860338 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:24.860338 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:24.860338 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:24.860338 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:24.860338 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:24.860338 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:24.860338 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:24.860338 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 12 11:49:24.860338 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:24.860338 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5be65a9b-9a9a-4f3d-8e3b-4a25dcfd42bb tempest-InstanceUsageAuditLogNegativeTestJSON-704633435 tempest-InstanceUsageAuditLogNegativeTestJSON-704633435-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:24.860338 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5be65a9b-9a9a-4f3d-8e3b-4a25dcfd42bb tempest-InstanceUsageAuditLogNegativeTestJSON-704633435 tempest-InstanceUsageAuditLogNegativeTestJSON-704633435-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.471045 Jul 12 11:49:24.862858 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 85/144] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 11:49:24 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 475 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 12 11:49:24.872438 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-329c7a0d-ad5c-4dd8-a65c-69419b824f94 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.415273 Jul 12 11:49:24.873595 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 60/145] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:24 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:25.089063 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-59983ecb-4dd9-43b7-9530-7d253f3ae9b9 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:25.090013 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-59983ecb-4dd9-43b7-9530-7d253f3ae9b9 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:25.098829 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-59983ecb-4dd9-43b7-9530-7d253f3ae9b9 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:25.099960 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-59983ecb-4dd9-43b7-9530-7d253f3ae9b9 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:25.102811 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-59983ecb-4dd9-43b7-9530-7d253f3ae9b9 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:25.106912 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-59983ecb-4dd9-43b7-9530-7d253f3ae9b9 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:25.344605 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4cfbeb07-3e10-4e83-bd26-5ffd165aa643 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:25.346421 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:25.346421 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:25.348241 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4cfbeb07-3e10-4e83-bd26-5ffd165aa643 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'cfdab28ed5154af8b8a29f711f7546ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464b0be168a944c78a983bf0bbad9a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4cfbeb07-3e10-4e83-bd26-5ffd165aa643 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072-project] Request method failure captured: Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_D_iTZZOw_Ynw_tsP7b1Mir419krzbxABWuFSEXebs_k9FOgJY5tLG3ZEupOaRXHtDgkm6jvwJr4g0d5STAmlQrOicP1KHs8ZTPLEiJ8fkmBvlUk74O3J1YMo_vtrfQIqLr0PEi2BXzulNZ5R1ERfsdUjuJs4-OHJJL7hK92TAVtc Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 464b0be168a944c78a983bf0bbad9a46 Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:25.351601 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:25.352947 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/464b0be168a944c78a983bf0bbad9a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/464b0be168a944c78a983bf0bbad9a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/464b0be168a944c78a983bf0bbad9a46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_464b0be168a944c78a983bf0bbad9a46", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:25.352947 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 Jul 12 11:49:25.352947 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 464b0be168a944c78a983bf0bbad9a46 Jul 12 11:49:25.352947 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 Jul 12 11:49:25.352947 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-857671072-project Jul 12 11:49:25.352947 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:25.352947 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:25.352947 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: cfdab28ed5154af8b8a29f711f7546ee Jul 12 11:49:25.352947 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-857671072-project Jul 12 11:49:25.352947 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:25.352947 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: action_args: {} Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:25.353545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:25.354601 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4cfbeb07-3e10-4e83-bd26-5ffd165aa643 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:25.355496 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4cfbeb07-3e10-4e83-bd26-5ffd165aa643 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072-project] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.486791 Jul 12 11:49:25.359608 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 86/146] 10.222.0.50 () {58 vars in 1184 bytes} [Tue Jul 12 11:49:24 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 490 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 12 11:49:25.369713 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cb815779-21fc-4f7b-95b2-b248838d9b10 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:25.373710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cb815779-21fc-4f7b-95b2-b248838d9b10 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'cfdab28ed5154af8b8a29f711f7546ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464b0be168a944c78a983bf0bbad9a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cb815779-21fc-4f7b-95b2-b248838d9b10 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072-project] Request method failure captured: Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-12%2011:49:25 HTTP/1.1 Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_D_iTZZOw_Ynw_tsP7b1Mir419krzbxABWuFSEXebs_k9FOgJY5tLG3ZEupOaRXHtDgkm6jvwJr4g0d5STAmlQrOicP1KHs8ZTPLEiJ8fkmBvlUk74O3J1YMo_vtrfQIqLr0PEi2BXzulNZ5R1ERfsdUjuJs4-OHJJL7hK92TAVtc Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 464b0be168a944c78a983bf0bbad9a46 Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:25.380820 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:25.381890 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/464b0be168a944c78a983bf0bbad9a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/464b0be168a944c78a983bf0bbad9a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/464b0be168a944c78a983bf0bbad9a46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_464b0be168a944c78a983bf0bbad9a46", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:25.381890 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 Jul 12 11:49:25.381890 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 464b0be168a944c78a983bf0bbad9a46 Jul 12 11:49:25.381890 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 Jul 12 11:49:25.381890 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-857671072-project Jul 12 11:49:25.381890 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:25.381890 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:25.381890 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: cfdab28ed5154af8b8a29f711f7546ee Jul 12 11:49:25.381890 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-857671072-project Jul 12 11:49:25.381890 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:25.381890 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '2022-07-12 11:49:25'} Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:25.382441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:25.383477 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cb815779-21fc-4f7b-95b2-b248838d9b10 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:25.385071 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cb815779-21fc-4f7b-95b2-b248838d9b10 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072 tempest-InstanceUsageAuditLogNegativeTestJSON-857671072-project] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-12 11:49:25" status: 403 len: 128 microversion: 2.1 time: 0.021676 Jul 12 11:49:25.385979 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 87/147] 10.222.0.50 () {58 vars in 1250 bytes} [Tue Jul 12 11:49:25 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-12%2011%3A49%3A25 => generated 128 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:25.434920 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-59983ecb-4dd9-43b7-9530-7d253f3ae9b9 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:25.448129 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-59983ecb-4dd9-43b7-9530-7d253f3ae9b9 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 0.364209 Jul 12 11:49:25.458458 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 61/148] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:25 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:25.889686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b7b93cd3-1e15-4c67-9543-ea34f861196f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:25.890963 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b7b93cd3-1e15-4c67-9543-ea34f861196f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:25.903491 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7b93cd3-1e15-4c67-9543-ea34f861196f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:25.904445 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7b93cd3-1e15-4c67-9543-ea34f861196f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:25.905594 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7b93cd3-1e15-4c67-9543-ea34f861196f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:25.907592 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7b93cd3-1e15-4c67-9543-ea34f861196f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:26.193058 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b7b93cd3-1e15-4c67-9543-ea34f861196f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:26.207082 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b7b93cd3-1e15-4c67-9543-ea34f861196f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.318434 Jul 12 11:49:26.215480 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 88/149] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:25 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:26.466527 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8c2173b5-7c93-431b-a0fe-97ad9914842a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:26.467893 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8c2173b5-7c93-431b-a0fe-97ad9914842a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:26.477534 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c2173b5-7c93-431b-a0fe-97ad9914842a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:26.479041 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c2173b5-7c93-431b-a0fe-97ad9914842a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:26.482192 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c2173b5-7c93-431b-a0fe-97ad9914842a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:26.482899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c2173b5-7c93-431b-a0fe-97ad9914842a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:26.890336 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8c2173b5-7c93-431b-a0fe-97ad9914842a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:26.912283 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8c2173b5-7c93-431b-a0fe-97ad9914842a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 0.446942 Jul 12 11:49:26.915493 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 62/150] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:26 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:27.223789 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-88a451ee-a1d0-4071-ab90-a1407fb50f1d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:27.225211 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-88a451ee-a1d0-4071-ab90-a1407fb50f1d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:27.242666 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-88a451ee-a1d0-4071-ab90-a1407fb50f1d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:27.244438 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-88a451ee-a1d0-4071-ab90-a1407fb50f1d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:27.247250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-88a451ee-a1d0-4071-ab90-a1407fb50f1d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:27.248089 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-88a451ee-a1d0-4071-ab90-a1407fb50f1d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:27.600331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-88a451ee-a1d0-4071-ab90-a1407fb50f1d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:27.615158 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-88a451ee-a1d0-4071-ab90-a1407fb50f1d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.393012 Jul 12 11:49:27.616666 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 89/151] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:27 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:27.943247 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-183a0a78-c26b-4986-bbcb-16431b88b3cd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:27.944229 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-183a0a78-c26b-4986-bbcb-16431b88b3cd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:27.953891 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-183a0a78-c26b-4986-bbcb-16431b88b3cd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:27.955782 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-183a0a78-c26b-4986-bbcb-16431b88b3cd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:27.957505 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-183a0a78-c26b-4986-bbcb-16431b88b3cd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:27.958046 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-183a0a78-c26b-4986-bbcb-16431b88b3cd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:28.190609 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-183a0a78-c26b-4986-bbcb-16431b88b3cd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:28.199749 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-183a0a78-c26b-4986-bbcb-16431b88b3cd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 0.270691 Jul 12 11:49:28.210151 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 63/152] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:27 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:28.634382 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e38a7970-48b2-4cec-8cca-eff40887b40b tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:28.635227 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e38a7970-48b2-4cec-8cca-eff40887b40b tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:28.649591 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e38a7970-48b2-4cec-8cca-eff40887b40b tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:28.650120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e38a7970-48b2-4cec-8cca-eff40887b40b tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:28.653549 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e38a7970-48b2-4cec-8cca-eff40887b40b tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:28.654246 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e38a7970-48b2-4cec-8cca-eff40887b40b tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:29.027812 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e38a7970-48b2-4cec-8cca-eff40887b40b tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:29.054083 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e38a7970-48b2-4cec-8cca-eff40887b40b tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.423516 Jul 12 11:49:29.060543 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 90/153] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:28 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:29.217776 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c64b4872-5513-46cc-ab84-e7abc2065a9d tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:29.219014 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c64b4872-5513-46cc-ab84-e7abc2065a9d tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:29.225458 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c64b4872-5513-46cc-ab84-e7abc2065a9d tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:29.226248 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c64b4872-5513-46cc-ab84-e7abc2065a9d tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:29.227239 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c64b4872-5513-46cc-ab84-e7abc2065a9d tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:29.227909 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c64b4872-5513-46cc-ab84-e7abc2065a9d tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:29.467223 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c64b4872-5513-46cc-ab84-e7abc2065a9d tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:29.478856 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c64b4872-5513-46cc-ab84-e7abc2065a9d tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 0.265169 Jul 12 11:49:29.479946 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 64/154] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:29 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:29.881643 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-10438a31-5264-48d7-94f2-113ee5e6f990 tempest-TenantUsagesNegativeTestJSON-766694086 tempest-TenantUsagesNegativeTestJSON-766694086-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-11T11%3A49%3A29.606815&end=2022-07-13T11%3A49%3A29.606815" status: 404 len: 112 microversion: - time: 0.268572 Jul 12 11:49:29.883782 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 91/155] 10.222.0.50 () {58 vars in 1315 bytes} [Tue Jul 12 11:49:29 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-11T11%3A49%3A29.606815&end=2022-07-13T11%3A49%3A29.606815 => generated 112 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 11:49:29.895456 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9a09f31a-0392-459a-9358-67d077741190 tempest-TenantUsagesNegativeTestJSON-766694086 tempest-TenantUsagesNegativeTestJSON-766694086-project-admin] Calling method '.version_select at 0x7f5e0bedc310>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:29.908707 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-9a09f31a-0392-459a-9358-67d077741190 tempest-TenantUsagesNegativeTestJSON-766694086 tempest-TenantUsagesNegativeTestJSON-766694086-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9a09f31a-0392-459a-9358-67d077741190 tempest-TenantUsagesNegativeTestJSON-766694086 tempest-TenantUsagesNegativeTestJSON-766694086-project-admin] Request method failure captured: Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-simple-tenant-usage/f795206424984a55864e34737eaa096e?start=2022-07-13T11%3A49%3A29.606815&end=2022-07-11T11%3A49%3A29.606815 HTTP/1.1 Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_JzxjGOpOPBmQ1ABBbp-9kGgHgXfcbwE7PDWFxHqcPCVNE0WZDzl9fctXPoOxZfInQfu17FBFQsGhaFrJ_X9yesb5Y00FgqLfBq42Y__SDRbpxeGufYxfLcEYibXAQVpNJvM0ksYY0hSECG91B29ypgkLkL6RTucOBLD8VA7Xqk3k Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 83ae4b30856b4520a080d13ac68c47c3 Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-766694086 Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:49:29.912777 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:49:29.914072 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/83ae4b30856b4520a080d13ac68c47c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/83ae4b30856b4520a080d13ac68c47c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/83ae4b30856b4520a080d13ac68c47c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_83ae4b30856b4520a080d13ac68c47c3", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:29.914072 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-766694086 Jul 12 11:49:29.914072 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 83ae4b30856b4520a080d13ac68c47c3 Jul 12 11:49:29.914072 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-766694086 Jul 12 11:49:29.914072 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-TenantUsagesNegativeTestJSON-766694086-project-admin Jul 12 11:49:29.914072 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:29.914072 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:29.914072 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: f80c57b362174777865df5c9ba961a98 Jul 12 11:49:29.914072 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-766694086-project-admin Jul 12 11:49:29.914072 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:49:29.914072 n-d-849104-4 devstack@n-api.service[125983]: exception: Invalid start time. The start time cannot occur after the end time. Jul 12 11:49:29.914072 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'f795206424984a55864e34737eaa096e'} Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 12 11:49:29.914728 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 12 11:49:29.915711 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:29.915711 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:29.915711 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:29.915711 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:29.915711 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:29.915711 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:29.915711 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:29.915711 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:29.915711 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 12 11:49:29.915711 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:29.917001 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9a09f31a-0392-459a-9358-67d077741190 tempest-TenantUsagesNegativeTestJSON-766694086 tempest-TenantUsagesNegativeTestJSON-766694086-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:29.917891 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9a09f31a-0392-459a-9358-67d077741190 tempest-TenantUsagesNegativeTestJSON-766694086 tempest-TenantUsagesNegativeTestJSON-766694086-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/f795206424984a55864e34737eaa096e?start=2022-07-13T11%3A49%3A29.606815&end=2022-07-11T11%3A49%3A29.606815" status: 400 len: 111 microversion: 2.1 time: 0.028318 Jul 12 11:49:29.920599 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 65/156] 10.222.0.50 () {58 vars in 1411 bytes} [Tue Jul 12 11:49:29 2022] GET /compute/v2.1/os-simple-tenant-usage/f795206424984a55864e34737eaa096e?start=2022-07-13T11%3A49%3A29.606815&end=2022-07-11T11%3A49%3A29.606815 => generated 111 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:49:30.337781 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-4255ad66-4334-4353-9a4d-a97e8164dab0 req-1afa748c-5d7b-461d-9b7b-9d291be2d546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409e75a9-6ee8-4705-9f27-97989ba439a2", "name": "network-vif-plugged", "status": "completed", "tag": "5660c4c5-a274-499b-a33f-0b775b8ebc8e"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:30.354708 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4255ad66-4334-4353-9a4d-a97e8164dab0 req-1afa748c-5d7b-461d-9b7b-9d291be2d546 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:30.355159 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4255ad66-4334-4353-9a4d-a97e8164dab0 req-1afa748c-5d7b-461d-9b7b-9d291be2d546 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:30.384525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a71088ee-c6d2-4737-8dfc-37412cfa03ab tempest-TenantUsagesNegativeTestJSON-233207868 tempest-TenantUsagesNegativeTestJSON-233207868-project] Calling method '.version_select at 0x7f5e0acc2ee0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:30.386898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a71088ee-c6d2-4737-8dfc-37412cfa03ab tempest-TenantUsagesNegativeTestJSON-233207868 tempest-TenantUsagesNegativeTestJSON-233207868-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '449307eb14a641d387645290b6b32b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795206424984a55864e34737eaa096e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:30.392313 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-4255ad66-4334-4353-9a4d-a97e8164dab0 req-1afa748c-5d7b-461d-9b7b-9d291be2d546 service nova] Creating event network-vif-plugged:5660c4c5-a274-499b-a33f-0b775b8ebc8e for instance 409e75a9-6ee8-4705-9f27-97989ba439a2 on n-h1-849104-4 Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a71088ee-c6d2-4737-8dfc-37412cfa03ab tempest-TenantUsagesNegativeTestJSON-233207868 tempest-TenantUsagesNegativeTestJSON-233207868-project] Request method failure captured: Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-11T11%3A49%3A29.606815&end=2022-07-13T11%3A49%3A29.606815&detailed=1 HTTP/1.1 Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_IpPnKK5f0DrsriId2XPo0w2RdNwBqvphna-WrAmulhkz6zvKk6EVm7xTbdBorokbhVSsJ7ew4cIn1EPgM0-4RAVkiZcsoqoeJ4MafTwbnfp8F4x_O0mCN8tEJdmUcbP0EsAHS_VpwsyqInDBUxTsGt8IMZnhAQe-EneKiNT4qwaA Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: f795206424984a55864e34737eaa096e Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-233207868 Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:30.393228 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:30.395072 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f795206424984a55864e34737eaa096e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f795206424984a55864e34737eaa096e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f795206424984a55864e34737eaa096e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f795206424984a55864e34737eaa096e", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:30.395072 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-233207868 Jul 12 11:49:30.395072 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: f795206424984a55864e34737eaa096e Jul 12 11:49:30.395072 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-233207868 Jul 12 11:49:30.395072 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-TenantUsagesNegativeTestJSON-233207868-project Jul 12 11:49:30.395072 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:30.395072 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:30.395072 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 449307eb14a641d387645290b6b32b2d Jul 12 11:49:30.395072 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-233207868-project Jul 12 11:49:30.395072 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:49:30.395072 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 12 11:49:30.395072 n-d-849104-4 devstack@n-api.service[125984]: action_args: {} Jul 12 11:49:30.395072 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:30.395807 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:30.397248 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:30.398522 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 12 11:49:30.398522 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:30.398522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a71088ee-c6d2-4737-8dfc-37412cfa03ab tempest-TenantUsagesNegativeTestJSON-233207868 tempest-TenantUsagesNegativeTestJSON-233207868-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:30.398522 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a71088ee-c6d2-4737-8dfc-37412cfa03ab tempest-TenantUsagesNegativeTestJSON-233207868 tempest-TenantUsagesNegativeTestJSON-233207868-project] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-11T11%3A49%3A29.606815&end=2022-07-13T11%3A49%3A29.606815&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.468861 Jul 12 11:49:30.398522 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 92/157] 10.222.0.50 () {58 vars in 1334 bytes} [Tue Jul 12 11:49:29 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-11T11%3A49%3A29.606815&end=2022-07-13T11%3A49%3A29.606815&detailed=1 => generated 123 bytes in 472 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:30.406385 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-4255ad66-4334-4353-9a4d-a97e8164dab0 req-1afa748c-5d7b-461d-9b7b-9d291be2d546 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.368918 Jul 12 11:49:30.407043 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 66/158] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:49:30.413090 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d6df5db7-e350-4ae7-937e-32909d9d74c0 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:30.413886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d6df5db7-e350-4ae7-937e-32909d9d74c0 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:30.425092 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6df5db7-e350-4ae7-937e-32909d9d74c0 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:30.426918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6df5db7-e350-4ae7-937e-32909d9d74c0 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:30.429000 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6df5db7-e350-4ae7-937e-32909d9d74c0 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:30.429971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6df5db7-e350-4ae7-937e-32909d9d74c0 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:30.498719 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e54d088d-f0eb-4c0b-8d3f-319e987ba42c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:30.499825 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e54d088d-f0eb-4c0b-8d3f-319e987ba42c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:30.510402 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e54d088d-f0eb-4c0b-8d3f-319e987ba42c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:30.511349 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e54d088d-f0eb-4c0b-8d3f-319e987ba42c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:30.518816 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e54d088d-f0eb-4c0b-8d3f-319e987ba42c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:30.521578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e54d088d-f0eb-4c0b-8d3f-319e987ba42c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:30.945458 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d6df5db7-e350-4ae7-937e-32909d9d74c0 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:30.979367 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d6df5db7-e350-4ae7-937e-32909d9d74c0 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.577277 Jul 12 11:49:30.981138 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 93/159] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:30 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:31.174914 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e54d088d-f0eb-4c0b-8d3f-319e987ba42c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:31.185275 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e54d088d-f0eb-4c0b-8d3f-319e987ba42c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 0.689738 Jul 12 11:49:31.197379 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 67/160] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:30 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:31.615419 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=12 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:32.001271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d7a7aef8-3354-4ecf-bb62-ed3dfa74ab8d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:32.002298 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d7a7aef8-3354-4ecf-bb62-ed3dfa74ab8d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:32.006977 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=16 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:32.030745 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7a7aef8-3354-4ecf-bb62-ed3dfa74ab8d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:32.034684 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7a7aef8-3354-4ecf-bb62-ed3dfa74ab8d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:32.037674 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7a7aef8-3354-4ecf-bb62-ed3dfa74ab8d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:32.039931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7a7aef8-3354-4ecf-bb62-ed3dfa74ab8d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:32.412088 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e5e7850a-9332-4787-8067-40793e8a6cd0 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2081160707", "ram": 512, "vcpus": 1, "disk": 10, "id": 397315413, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:32.414182 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:32.414182 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:32.455565 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e5e7850a-9332-4787-8067-40793e8a6cd0 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.849664 Jul 12 11:49:32.463038 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 94/161] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:31 2022] POST /compute/v2.1/flavors => generated 413 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:32.472507 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6a6d2606-e477-480e-8a33-f56b9fcb2b48 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:32.477458 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6a6d2606-e477-480e-8a33-f56b9fcb2b48 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:32.510211 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a6d2606-e477-480e-8a33-f56b9fcb2b48 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:32.515275 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a6d2606-e477-480e-8a33-f56b9fcb2b48 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:32.516807 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a6d2606-e477-480e-8a33-f56b9fcb2b48 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:32.521785 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a6d2606-e477-480e-8a33-f56b9fcb2b48 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:32.638831 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d7a7aef8-3354-4ecf-bb62-ed3dfa74ab8d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:32.654708 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d7a7aef8-3354-4ecf-bb62-ed3dfa74ab8d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.660794 Jul 12 11:49:32.685011 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 68/162] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:31 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:32.956623 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6a6d2606-e477-480e-8a33-f56b9fcb2b48 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:32.977980 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6a6d2606-e477-480e-8a33-f56b9fcb2b48 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1320 microversion: 2.1 time: 0.513896 Jul 12 11:49:32.995232 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 95/163] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:32 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1320 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:33.016250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-2c5dca91-9b6e-40b2-990c-044c380a46cb req-75cd9007-6b4a-42df-a2d3-688964f9144c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4298b8-89e6-4f58-a781-f850dab332a7", "name": "network-vif-plugged", "status": "completed", "tag": "e214e74f-a4a8-464c-9444-ac4d68d3ec0f"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:33.033780 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-2c5dca91-9b6e-40b2-990c-044c380a46cb req-75cd9007-6b4a-42df-a2d3-688964f9144c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:33.034222 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-2c5dca91-9b6e-40b2-990c-044c380a46cb req-75cd9007-6b4a-42df-a2d3-688964f9144c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:33.064137 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-2c5dca91-9b6e-40b2-990c-044c380a46cb req-75cd9007-6b4a-42df-a2d3-688964f9144c service nova] Creating event network-vif-plugged:e214e74f-a4a8-464c-9444-ac4d68d3ec0f for instance dd4298b8-89e6-4f58-a781-f850dab332a7 on n-h2-849104-4 Jul 12 11:49:33.073581 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-2c5dca91-9b6e-40b2-990c-044c380a46cb req-75cd9007-6b4a-42df-a2d3-688964f9144c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073743 Jul 12 11:49:33.074490 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 96/164] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:33.367015 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fcde3f2d-bef5-47d5-993c-3b185de5318d tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:33.386583 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-fcde3f2d-bef5-47d5-993c-3b185de5318d tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] HTTP exception thrown: Flavor 397315413 has no extra specs with key hw:cpu_thread_policy. Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fcde3f2d-bef5-47d5-993c-3b185de5318d tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Request method failure captured: Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/flavors/397315413/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_JRmZyNIzpXjQbqmAekv_c00YPqlcQyBeJex27Eg2TEGV3Y6ozduSyry21geAg3oAcBWcG8R5lu0pvhLC05zIvCTuCeicvP05quUjfN93hwsk9GqWIMBn6R48yurK4IDLgm_WGZ-Rev0qovWycd-SgHqY31lRJjaL_OSPbcThq8Zo Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: b627f7dd7f1f4c78bf60072e450c4910 Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:33.389638 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:33.390840 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b627f7dd7f1f4c78bf60072e450c4910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b627f7dd7f1f4c78bf60072e450c4910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b627f7dd7f1f4c78bf60072e450c4910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b627f7dd7f1f4c78bf60072e450c4910", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:33.390840 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 Jul 12 11:49:33.390840 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: b627f7dd7f1f4c78bf60072e450c4910 Jul 12 11:49:33.390840 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 Jul 12 11:49:33.390840 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project Jul 12 11:49:33.390840 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:33.390840 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:33.390840 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 5bda6e95b8c244b8beaee35224828be1 Jul 12 11:49:33.390840 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project Jul 12 11:49:33.390840 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:33.390840 n-d-849104-4 devstack@n-api.service[125983]: exception: Flavor 397315413 has no extra specs with key hw:cpu_thread_policy. Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'flavor_id': '397315413', 'id': 'hw:cpu_thread_policy'} Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 397315413 has no extra specs with key hw:cpu_thread_policy. Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:33.391427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.392874 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:33.392874 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:33.392874 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:33.392874 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:33.392874 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:33.392874 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 397315413 has no extra specs with key hw:cpu_thread_policy. Jul 12 11:49:33.392874 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.392874 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fcde3f2d-bef5-47d5-993c-3b185de5318d tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Returning 404 to user: Flavor 397315413 has no extra specs with key hw:cpu_thread_policy. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:33.392874 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fcde3f2d-bef5-47d5-993c-3b185de5318d tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] 10.222.0.50 "GET /compute/v2.1/flavors/397315413/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.704938 Jul 12 11:49:33.403031 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 69/165] 10.222.0.50 () {58 vars in 1262 bytes} [Tue Jul 12 11:49:32 2022] GET /compute/v2.1/flavors/397315413/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 717 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:33.412976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-52ac3348-7b9f-41d7-8989-ed89156f5950 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:33.421049 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:33.421049 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:33.422411 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-52ac3348-7b9f-41d7-8989-ed89156f5950 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '5bda6e95b8c244b8beaee35224828be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627f7dd7f1f4c78bf60072e450c4910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-52ac3348-7b9f-41d7-8989-ed89156f5950 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Request method failure captured: Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/flavors/397315413/os-extra_specs HTTP/1.1 Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 66 Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_JRmZyNIzpXjQbqmAekv_c00YPqlcQyBeJex27Eg2TEGV3Y6ozduSyry21geAg3oAcBWcG8R5lu0pvhLC05zIvCTuCeicvP05quUjfN93hwsk9GqWIMBn6R48yurK4IDLgm_WGZ-Rev0qovWycd-SgHqY31lRJjaL_OSPbcThq8Zo Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: b627f7dd7f1f4c78bf60072e450c4910 Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:33.425208 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:33.427147 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b627f7dd7f1f4c78bf60072e450c4910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b627f7dd7f1f4c78bf60072e450c4910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b627f7dd7f1f4c78bf60072e450c4910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b627f7dd7f1f4c78bf60072e450c4910", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:33.427147 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 Jul 12 11:49:33.427147 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: b627f7dd7f1f4c78bf60072e450c4910 Jul 12 11:49:33.427147 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 Jul 12 11:49:33.427147 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project Jul 12 11:49:33.427147 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:33.427147 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:33.427147 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 5bda6e95b8c244b8beaee35224828be1 Jul 12 11:49:33.427147 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project Jul 12 11:49:33.427147 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:49:33.427147 n-d-849104-4 devstack@n-api.service[125984]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 12 11:49:33.427147 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'flavor_id': '397315413', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:33.427904 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 12 11:49:33.429876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.437629 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-52ac3348-7b9f-41d7-8989-ed89156f5950 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:33.438629 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-52ac3348-7b9f-41d7-8989-ed89156f5950 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] 10.222.0.50 "POST /compute/v2.1/flavors/397315413/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.031540 Jul 12 11:49:33.451065 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 97/166] 10.222.0.50 () {60 vars in 1220 bytes} [Tue Jul 12 11:49:33 2022] POST /compute/v2.1/flavors/397315413/os-extra_specs => generated 124 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:33.462219 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e41651a2-8d35-4eb7-bac5-57531554f315 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:33.465452 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:33.465452 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:33.525678 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e41651a2-8d35-4eb7-bac5-57531554f315 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/397315413/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.068517 Jul 12 11:49:33.526827 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 70/167] 10.222.0.50 () {60 vars in 1220 bytes} [Tue Jul 12 11:49:33 2022] POST /compute/v2.1/flavors/397315413/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:33.544242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4417fdb4-89aa-473f-b2a4-dbb93e1a111b tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:33.545669 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:33.545669 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:33.546805 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4417fdb4-89aa-473f-b2a4-dbb93e1a111b tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '5bda6e95b8c244b8beaee35224828be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627f7dd7f1f4c78bf60072e450c4910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4417fdb4-89aa-473f-b2a4-dbb93e1a111b tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Request method failure captured: Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/flavors/397315413/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_JRmZyNIzpXjQbqmAekv_c00YPqlcQyBeJex27Eg2TEGV3Y6ozduSyry21geAg3oAcBWcG8R5lu0pvhLC05zIvCTuCeicvP05quUjfN93hwsk9GqWIMBn6R48yurK4IDLgm_WGZ-Rev0qovWycd-SgHqY31lRJjaL_OSPbcThq8Zo Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: b627f7dd7f1f4c78bf60072e450c4910 Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:33.549400 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:33.551653 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b627f7dd7f1f4c78bf60072e450c4910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b627f7dd7f1f4c78bf60072e450c4910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b627f7dd7f1f4c78bf60072e450c4910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b627f7dd7f1f4c78bf60072e450c4910", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:33.551653 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 Jul 12 11:49:33.551653 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: b627f7dd7f1f4c78bf60072e450c4910 Jul 12 11:49:33.551653 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 Jul 12 11:49:33.551653 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project Jul 12 11:49:33.551653 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:33.551653 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:33.551653 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 5bda6e95b8c244b8beaee35224828be1 Jul 12 11:49:33.551653 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project Jul 12 11:49:33.551653 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:33.551653 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'flavor_id': '397315413', 'id': 'hw:numa_nodes'} Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:33.552700 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.554722 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4417fdb4-89aa-473f-b2a4-dbb93e1a111b tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:33.556588 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4417fdb4-89aa-473f-b2a4-dbb93e1a111b tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] 10.222.0.50 "DELETE /compute/v2.1/flavors/397315413/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018851 Jul 12 11:49:33.556588 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 98/168] 10.222.0.50 () {58 vars in 1244 bytes} [Tue Jul 12 11:49:33 2022] DELETE /compute/v2.1/flavors/397315413/os-extra_specs/hw:numa_nodes => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:33.569879 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-14db31f1-b14a-44de-9f1e-aed4bbf2270c tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:33.648660 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-14db31f1-b14a-44de-9f1e-aed4bbf2270c tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/397315413/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.082832 Jul 12 11:49:33.649266 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 71/169] 10.222.0.50 () {60 vars in 1220 bytes} [Tue Jul 12 11:49:33 2022] POST /compute/v2.1/flavors/397315413/os-extra_specs => generated 66 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:33.664946 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5091881d-a447-409d-ab15-62cc01de5d52 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:33.669422 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:33.669422 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:33.672786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5091881d-a447-409d-ab15-62cc01de5d52 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '5bda6e95b8c244b8beaee35224828be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627f7dd7f1f4c78bf60072e450c4910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:33.681478 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1059f500-7eee-4630-a449-a7e183b654ff tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5091881d-a447-409d-ab15-62cc01de5d52 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Request method failure captured: Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: request: PUT /compute/v2.1/flavors/397315413/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 22 Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_JRmZyNIzpXjQbqmAekv_c00YPqlcQyBeJex27Eg2TEGV3Y6ozduSyry21geAg3oAcBWcG8R5lu0pvhLC05zIvCTuCeicvP05quUjfN93hwsk9GqWIMBn6R48yurK4IDLgm_WGZ-Rev0qovWycd-SgHqY31lRJjaL_OSPbcThq8Zo Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: b627f7dd7f1f4c78bf60072e450c4910 Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:33.681878 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:33.683721 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b627f7dd7f1f4c78bf60072e450c4910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b627f7dd7f1f4c78bf60072e450c4910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b627f7dd7f1f4c78bf60072e450c4910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b627f7dd7f1f4c78bf60072e450c4910", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:33.683721 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 Jul 12 11:49:33.683721 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: b627f7dd7f1f4c78bf60072e450c4910 Jul 12 11:49:33.683721 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 Jul 12 11:49:33.683721 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project Jul 12 11:49:33.683721 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:33.683721 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:33.683721 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 5bda6e95b8c244b8beaee35224828be1 Jul 12 11:49:33.683721 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project Jul 12 11:49:33.683721 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:49:33.683721 n-d-849104-4 devstack@n-api.service[125984]: {"hw:numa_nodes": "1"} Jul 12 11:49:33.683721 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:33.683721 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'flavor_id': '397315413', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:33.685111 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 12 11:49:33.686448 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.687480 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1059f500-7eee-4630-a449-a7e183b654ff tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:33.689081 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5091881d-a447-409d-ab15-62cc01de5d52 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:33.690513 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5091881d-a447-409d-ab15-62cc01de5d52 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611 tempest-FlavorsExtraSpecsNegativeTestJSON-162135611-project] 10.222.0.50 "PUT /compute/v2.1/flavors/397315413/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.031307 Jul 12 11:49:33.692574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1059f500-7eee-4630-a449-a7e183b654ff tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:33.693029 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1059f500-7eee-4630-a449-a7e183b654ff tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:33.700527 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1059f500-7eee-4630-a449-a7e183b654ff tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:33.700527 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1059f500-7eee-4630-a449-a7e183b654ff tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:33.700765 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 99/170] 10.222.0.50 () {60 vars in 1261 bytes} [Tue Jul 12 11:49:33 2022] PUT /compute/v2.1/flavors/397315413/os-extra_specs/hw:numa_nodes => generated 124 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:33.709356 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e11f98f6-6708-4605-b6e6-640aafc9006b tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:33.746225 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-e11f98f6-6708-4605-b6e6-640aafc9006b tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] HTTP exception thrown: Flavor 397315413 has no extra specs with key hw:cpu_thread_policy. Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e11f98f6-6708-4605-b6e6-640aafc9006b tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] Request method failure captured: Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/flavors/397315413/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_LoOUeJYJ08GE-O67G18wAgMQ-U4w2gjYJ2e86Ns7V35ReKND-IlGlWTPogGn9mW_1kMS7ocAqRcNkHgRxkBfZXPISOe-QzBbtNSzrlcGFHpieZ-GE588ye8fBSoKb0KEQq4rgAj8wBI06l7OqwW32z1pC_dPpC26ILLeDO7T2u0E Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 57ee502b20804032870a1dfc453d42c9 Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:49:33.754874 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:49:33.756223 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/57ee502b20804032870a1dfc453d42c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/57ee502b20804032870a1dfc453d42c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/57ee502b20804032870a1dfc453d42c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_57ee502b20804032870a1dfc453d42c9", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:33.756223 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 Jul 12 11:49:33.756223 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 57ee502b20804032870a1dfc453d42c9 Jul 12 11:49:33.756223 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 Jul 12 11:49:33.756223 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin Jul 12 11:49:33.756223 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:33.756223 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:33.756223 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 1cc03260f6bf46638074d4eca85c28d1 Jul 12 11:49:33.756223 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin Jul 12 11:49:33.756223 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:33.756223 n-d-849104-4 devstack@n-api.service[125984]: exception: Flavor 397315413 has no extra specs with key hw:cpu_thread_policy. Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'flavor_id': '397315413', 'id': 'hw:cpu_thread_policy'} Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 397315413 has no extra specs with key hw:cpu_thread_policy. Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:33.756822 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.758097 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:33.758097 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:33.758097 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:33.758097 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:33.758097 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:33.758097 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 397315413 has no extra specs with key hw:cpu_thread_policy. Jul 12 11:49:33.758097 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:33.768786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e11f98f6-6708-4605-b6e6-640aafc9006b tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] Returning 404 to user: Flavor 397315413 has no extra specs with key hw:cpu_thread_policy. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:33.773487 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e11f98f6-6708-4605-b6e6-640aafc9006b tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/397315413/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.072681 Jul 12 11:49:33.776926 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 100/171] 10.222.0.50 () {58 vars in 1265 bytes} [Tue Jul 12 11:49:33 2022] DELETE /compute/v2.1/flavors/397315413/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 11:49:34.170137 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1059f500-7eee-4630-a449-a7e183b654ff tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:34.189159 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1059f500-7eee-4630-a449-a7e183b654ff tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.511663 Jul 12 11:49:34.190011 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 72/172] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:33 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:34.210134 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e868d878-9a00-4b3d-a2f3-fe155aba6fdc tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:34.215312 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:34.215312 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:34.217997 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-e868d878-9a00-4b3d-a2f3-fe155aba6fdc tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e868d878-9a00-4b3d-a2f3-fe155aba6fdc tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] Request method failure captured: Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: request: PUT /compute/v2.1/flavors/397315413/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 27 Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_LoOUeJYJ08GE-O67G18wAgMQ-U4w2gjYJ2e86Ns7V35ReKND-IlGlWTPogGn9mW_1kMS7ocAqRcNkHgRxkBfZXPISOe-QzBbtNSzrlcGFHpieZ-GE588ye8fBSoKb0KEQq4rgAj8wBI06l7OqwW32z1pC_dPpC26ILLeDO7T2u0E Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 57ee502b20804032870a1dfc453d42c9 Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:49:34.221131 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:49:34.222654 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/57ee502b20804032870a1dfc453d42c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/57ee502b20804032870a1dfc453d42c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/57ee502b20804032870a1dfc453d42c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_57ee502b20804032870a1dfc453d42c9", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:34.222654 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 Jul 12 11:49:34.222654 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 57ee502b20804032870a1dfc453d42c9 Jul 12 11:49:34.222654 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 Jul 12 11:49:34.222654 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin Jul 12 11:49:34.222654 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:34.222654 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:34.222654 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 1cc03260f6bf46638074d4eca85c28d1 Jul 12 11:49:34.222654 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin Jul 12 11:49:34.222654 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:49:34.222654 n-d-849104-4 devstack@n-api.service[125983]: {"hw:cpu_policy": "shared"} Jul 12 11:49:34.222654 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:34.222654 n-d-849104-4 devstack@n-api.service[125983]: exception: Request body and URI mismatch Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'flavor_id': '397315413', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:34.223339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:34.224543 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:34.224543 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:34.224543 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 12 11:49:34.224543 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:34.228125 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e868d878-9a00-4b3d-a2f3-fe155aba6fdc tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:34.231564 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e868d878-9a00-4b3d-a2f3-fe155aba6fdc tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/397315413/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.039039 Jul 12 11:49:34.233602 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 73/173] 10.222.0.50 () {60 vars in 1261 bytes} [Tue Jul 12 11:49:34 2022] PUT /compute/v2.1/flavors/397315413/os-extra_specs/hw:numa_nodes => generated 73 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 12 11:49:34.245142 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c2a7ba89-5bcd-47a7-8fa8-bc51f9ccf348 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:34.245788 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c2a7ba89-5bcd-47a7-8fa8-bc51f9ccf348 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:34.263800 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2a7ba89-5bcd-47a7-8fa8-bc51f9ccf348 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:34.267946 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2a7ba89-5bcd-47a7-8fa8-bc51f9ccf348 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:34.272124 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2a7ba89-5bcd-47a7-8fa8-bc51f9ccf348 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:34.272963 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2a7ba89-5bcd-47a7-8fa8-bc51f9ccf348 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:34.290032 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1099467629", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:34.454762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] validate_networks() for None {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:49:34.780667 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:49:34.781396 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:49:34.782060 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:49:34.782688 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:49:34.783504 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:49:34.801551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:34.802096 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:34.803128 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:34.803781 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:34.841738 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Getting quotas for project 4c6a6e22d13840698ada0866ea3f4913. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:49:34.852400 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Getting quotas for user d42140cf6bac4674ba0515ca28531222 and project 4c6a6e22d13840698ada0866ea3f4913. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:49:34.872693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:49:34.876430 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:49:34.957656 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fa634d88-c183-4bf0-900f-ba080da2b787 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.173591 Jul 12 11:49:34.958966 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 101/174] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:49:34.966041 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fadb178e-94a0-42bd-b06b-4f5ee8c3c3c6 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fadb178e-94a0-42bd-b06b-4f5ee8c3c3c6 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] Request method failure captured: Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: request: PUT /compute/v2.1/flavors/397315413/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 49 Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_LoOUeJYJ08GE-O67G18wAgMQ-U4w2gjYJ2e86Ns7V35ReKND-IlGlWTPogGn9mW_1kMS7ocAqRcNkHgRxkBfZXPISOe-QzBbtNSzrlcGFHpieZ-GE588ye8fBSoKb0KEQq4rgAj8wBI06l7OqwW32z1pC_dPpC26ILLeDO7T2u0E Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 57ee502b20804032870a1dfc453d42c9 Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:49:35.004422 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:49:35.005609 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/57ee502b20804032870a1dfc453d42c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/57ee502b20804032870a1dfc453d42c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/57ee502b20804032870a1dfc453d42c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_57ee502b20804032870a1dfc453d42c9", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:35.005609 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 Jul 12 11:49:35.005609 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 57ee502b20804032870a1dfc453d42c9 Jul 12 11:49:35.005609 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 Jul 12 11:49:35.005609 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin Jul 12 11:49:35.005609 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:35.005609 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:35.005609 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 1cc03260f6bf46638074d4eca85c28d1 Jul 12 11:49:35.005609 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin Jul 12 11:49:35.005609 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:49:35.005609 n-d-849104-4 devstack@n-api.service[125984]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 12 11:49:35.005609 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'flavor_id': '397315413', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise error Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi On instance: Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 12 11:49:35.006265 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:35.007424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:35.008512 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:35.008512 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:35.008512 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 11:49:35.008512 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 11:49:35.008512 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 12 11:49:35.008512 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:35.008512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fadb178e-94a0-42bd-b06b-4f5ee8c3c3c6 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:35.008512 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fadb178e-94a0-42bd-b06b-4f5ee8c3c3c6 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/397315413/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.047795 Jul 12 11:49:35.010774 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 102/175] 10.222.0.50 () {60 vars in 1261 bytes} [Tue Jul 12 11:49:34 2022] PUT /compute/v2.1/flavors/397315413/os-extra_specs/hw:numa_nodes => generated 117 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:49:35.023050 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dc797dd8-92ea-4f14-ba56-09db4075cc14 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:35.024300 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dc797dd8-92ea-4f14-ba56-09db4075cc14 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:35.072504 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c2a7ba89-5bcd-47a7-8fa8-bc51f9ccf348 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:35.093137 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c2a7ba89-5bcd-47a7-8fa8-bc51f9ccf348 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1470 microversion: 2.1 time: 0.858105 Jul 12 11:49:35.106058 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 74/176] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:34 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1470 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:35.136784 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-31a4e59e-7cf1-459f-9e85-14531ec4dc31 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:35.139256 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:35.139256 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:35.194452 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-31a4e59e-7cf1-459f-9e85-14531ec4dc31 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/397315413" status: 202 len: 0 microversion: 2.1 time: 0.083163 Jul 12 11:49:35.195596 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 75/177] 10.222.0.50 () {58 vars in 1157 bytes} [Tue Jul 12 11:49:35 2022] DELETE /compute/v2.1/flavors/397315413 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:35.207581 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dc797dd8-92ea-4f14-ba56-09db4075cc14 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:35.227119 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dc797dd8-92ea-4f14-ba56-09db4075cc14 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1213 microversion: 2.1 time: 0.214692 Jul 12 11:49:35.228115 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 103/178] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:35 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1213 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:35.236967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-757d59d7-3c53-4a2e-a037-f922787de906 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:35.288419 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-757d59d7-3c53-4a2e-a037-f922787de906 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070 tempest-FlavorsExtraSpecsNegativeTestJSON-2098854070-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058782 Jul 12 11:49:35.289441 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 104/179] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:35.314059 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dbaed000-cdbd-418b-8351-4982b4e08762 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:35.315189 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dbaed000-cdbd-418b-8351-4982b4e08762 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:35.324557 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbaed000-cdbd-418b-8351-4982b4e08762 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:35.325412 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbaed000-cdbd-418b-8351-4982b4e08762 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:35.326397 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbaed000-cdbd-418b-8351-4982b4e08762 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:35.327022 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbaed000-cdbd-418b-8351-4982b4e08762 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:35.558081 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dbaed000-cdbd-418b-8351-4982b4e08762 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:35.568557 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dbaed000-cdbd-418b-8351-4982b4e08762 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1339 microversion: 2.1 time: 0.261019 Jul 12 11:49:35.580679 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 105/180] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:35 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1339 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:35.762936 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-533baa8d-4c24-42cd-9556-0a41d1e5edab tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:35.763626 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-533baa8d-4c24-42cd-9556-0a41d1e5edab tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:35.775055 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-533baa8d-4c24-42cd-9556-0a41d1e5edab tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:35.776014 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-533baa8d-4c24-42cd-9556-0a41d1e5edab tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:35.777230 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-533baa8d-4c24-42cd-9556-0a41d1e5edab tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:35.778119 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-533baa8d-4c24-42cd-9556-0a41d1e5edab tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:35.905014 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-533baa8d-4c24-42cd-9556-0a41d1e5edab tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:49:36.140146 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-533baa8d-4c24-42cd-9556-0a41d1e5edab tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] 10.222.0.50 "DELETE /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 204 len: 0 microversion: 2.1 time: 0.942965 Jul 12 11:49:36.141726 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 76/181] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:49:35 2022] DELETE /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 0 bytes in 945 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:49:36.149901 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9c585e6b-aa93-4f1e-b348-b509c9836cf7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:36.150751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9c585e6b-aa93-4f1e-b348-b509c9836cf7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:36.167966 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c585e6b-aa93-4f1e-b348-b509c9836cf7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:36.169648 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c585e6b-aa93-4f1e-b348-b509c9836cf7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:36.172278 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c585e6b-aa93-4f1e-b348-b509c9836cf7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:36.173503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c585e6b-aa93-4f1e-b348-b509c9836cf7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:36.246311 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1d3641db-48d5-41f0-bc21-69bd78134e2b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:36.247011 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1d3641db-48d5-41f0-bc21-69bd78134e2b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:36.258207 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d3641db-48d5-41f0-bc21-69bd78134e2b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:36.259276 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d3641db-48d5-41f0-bc21-69bd78134e2b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:36.260728 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d3641db-48d5-41f0-bc21-69bd78134e2b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:36.261386 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d3641db-48d5-41f0-bc21-69bd78134e2b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:36.372621 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1d3641db-48d5-41f0-bc21-69bd78134e2b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:36.381146 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1d3641db-48d5-41f0-bc21-69bd78134e2b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1265 microversion: 2.1 time: 0.139226 Jul 12 11:49:36.382384 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 77/182] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:36 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:36.501149 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9c585e6b-aa93-4f1e-b348-b509c9836cf7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:36.509769 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9c585e6b-aa93-4f1e-b348-b509c9836cf7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1476 microversion: 2.1 time: 0.363723 Jul 12 11:49:36.520762 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 106/183] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:36 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:36.587722 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b3b120c3-b428-4d1f-ab7d-eca01f665c05 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:36.588756 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b3b120c3-b428-4d1f-ab7d-eca01f665c05 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:36.591825 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=76,nova_api:SAVEPOINT=6,nova_api:INSERT=4,nova_api:RELEASE=6,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:36.595593 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3b120c3-b428-4d1f-ab7d-eca01f665c05 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:36.596056 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3b120c3-b428-4d1f-ab7d-eca01f665c05 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:36.596899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3b120c3-b428-4d1f-ab7d-eca01f665c05 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:36.598072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3b120c3-b428-4d1f-ab7d-eca01f665c05 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:36.763268 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b3b120c3-b428-4d1f-ab7d-eca01f665c05 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:36.772347 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b3b120c3-b428-4d1f-ab7d-eca01f665c05 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1489 microversion: 2.1 time: 0.188951 Jul 12 11:49:36.773269 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 78/184] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:36 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1489 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:36.792244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-17f60509-64af-4189-9ece-4d55e19ef441 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:36.795256 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-17f60509-64af-4189-9ece-4d55e19ef441 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:36.813858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17f60509-64af-4189-9ece-4d55e19ef441 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:36.814777 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17f60509-64af-4189-9ece-4d55e19ef441 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:36.816860 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17f60509-64af-4189-9ece-4d55e19ef441 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:36.817525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17f60509-64af-4189-9ece-4d55e19ef441 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:37.095472 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-73a89c16-bd66-439a-8b10-47a4da81331e tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Calling method '.version_select at 0x7f5e0bccc3a0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:37.151304 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-73a89c16-bd66-439a-8b10-47a4da81331e tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "GET /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b" status: 200 len: 637 microversion: 2.1 time: 0.059585 Jul 12 11:49:37.152221 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 79/185] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 11:49:37 2022] GET /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b => generated 637 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:37.165899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d15270db-4840-4d0c-a330-3b0ca99c500e tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Action: 'update_all', calling method: .version_select at 0x7f5e0bccce50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:37.220454 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-d15270db-4840-4d0c-a330-3b0ca99c500e tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:49:37.226851 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-d15270db-4840-4d0c-a330-3b0ca99c500e tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for user adb3f360730a46e2b72132c4adaa5e6a and project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:49:37.513990 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-17f60509-64af-4189-9ece-4d55e19ef441 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1640 microversion: 2.1 time: 0.726043 Jul 12 11:49:37.525897 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 107/186] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:36 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1640 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:37.531672 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dc796b5e-3236-4a5f-a333-051415db931f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:37.532469 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dc796b5e-3236-4a5f-a333-051415db931f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:37.546272 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc796b5e-3236-4a5f-a333-051415db931f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:37.552334 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc796b5e-3236-4a5f-a333-051415db931f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:37.553176 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc796b5e-3236-4a5f-a333-051415db931f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:37.556647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc796b5e-3236-4a5f-a333-051415db931f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:37.889173 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dc796b5e-3236-4a5f-a333-051415db931f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:37.914155 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dc796b5e-3236-4a5f-a333-051415db931f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1265 microversion: 2.1 time: 0.386048 Jul 12 11:49:37.916615 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 108/187] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:37 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1265 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:37.929731 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d46b67dd-f5c0-4b95-9259-3b8ae7f8cf5d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:37.930904 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d46b67dd-f5c0-4b95-9259-3b8ae7f8cf5d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:37.944390 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d46b67dd-f5c0-4b95-9259-3b8ae7f8cf5d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:37.945736 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d46b67dd-f5c0-4b95-9259-3b8ae7f8cf5d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:37.948139 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d46b67dd-f5c0-4b95-9259-3b8ae7f8cf5d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:37.949293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d46b67dd-f5c0-4b95-9259-3b8ae7f8cf5d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:38.006686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d46b67dd-f5c0-4b95-9259-3b8ae7f8cf5d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:49:38.158234 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d15270db-4840-4d0c-a330-3b0ca99c500e tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.995195 Jul 12 11:49:38.159658 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 80/188] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 11:49:37 2022] PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata => generated 61 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 11:49:38.166217 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-882ee122-b60b-46b7-9a34-7f714082303c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:38.168355 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-882ee122-b60b-46b7-9a34-7f714082303c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:38.191589 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-882ee122-b60b-46b7-9a34-7f714082303c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:38.193675 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-882ee122-b60b-46b7-9a34-7f714082303c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:38.195592 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-882ee122-b60b-46b7-9a34-7f714082303c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:38.196889 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-882ee122-b60b-46b7-9a34-7f714082303c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:38.422216 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:38.574205 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d46b67dd-f5c0-4b95-9259-3b8ae7f8cf5d tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 204 len: 0 microversion: 2.1 time: 0.655480 Jul 12 11:49:38.579079 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 109/189] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:49:37 2022] DELETE /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:49:38.594847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d1ae2d72-df20-4d3a-91aa-66f86357a790 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Calling method '.version_select at 0x7f5e0accf940>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:38.805372 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-882ee122-b60b-46b7-9a34-7f714082303c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:38.808910 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:38.815921 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-882ee122-b60b-46b7-9a34-7f714082303c tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1476 microversion: 2.1 time: 0.654512 Jul 12 11:49:38.818511 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 81/190] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:38 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1476 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:38.823635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b3640675-bf38-4401-ba8d-68aa923e598f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:38.828051 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b3640675-bf38-4401-ba8d-68aa923e598f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:38.851317 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3640675-bf38-4401-ba8d-68aa923e598f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:38.851766 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3640675-bf38-4401-ba8d-68aa923e598f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:38.852639 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3640675-bf38-4401-ba8d-68aa923e598f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:38.853103 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3640675-bf38-4401-ba8d-68aa923e598f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:39.257318 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d1ae2d72-df20-4d3a-91aa-66f86357a790 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "DELETE /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.674337 Jul 12 11:49:39.259432 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 110/191] 10.222.0.50 () {58 vars in 1295 bytes} [Tue Jul 12 11:49:38 2022] DELETE /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata/os_version => generated 0 bytes in 678 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:49:39.264540 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f42184cd-1207-4672-bbab-d9c8fab75f20 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:39.265467 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f42184cd-1207-4672-bbab-d9c8fab75f20 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:39.277080 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f42184cd-1207-4672-bbab-d9c8fab75f20 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:39.277777 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f42184cd-1207-4672-bbab-d9c8fab75f20 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:39.278708 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f42184cd-1207-4672-bbab-d9c8fab75f20 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:39.279326 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f42184cd-1207-4672-bbab-d9c8fab75f20 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:39.410929 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f42184cd-1207-4672-bbab-d9c8fab75f20 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:39.426191 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f42184cd-1207-4672-bbab-d9c8fab75f20 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1271 microversion: 2.1 time: 0.166191 Jul 12 11:49:39.427010 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 111/192] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:39 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:39.438175 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bd00cdd6-545c-46dc-b20e-4ea97ac731f0 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Calling method '.version_select at 0x7f5e0ac02280>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:39.494060 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bd00cdd6-545c-46dc-b20e-4ea97ac731f0 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "GET /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata" status: 200 len: 37 microversion: 2.1 time: 0.065102 Jul 12 11:49:39.501534 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 112/193] 10.222.0.50 () {58 vars in 1259 bytes} [Tue Jul 12 11:49:39 2022] GET /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata => generated 37 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:39.508054 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9f513a40-b3f5-42ac-b7cf-2bd98f7c2b21 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Action: 'update_all', calling method: .version_select at 0x7f5e0accf8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:39.606403 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-9f513a40-b3f5-42ac-b7cf-2bd98f7c2b21 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:49:39.611504 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-9f513a40-b3f5-42ac-b7cf-2bd98f7c2b21 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for user adb3f360730a46e2b72132c4adaa5e6a and project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:49:39.616756 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b3640675-bf38-4401-ba8d-68aa923e598f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:39.627052 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b3640675-bf38-4401-ba8d-68aa923e598f tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1495 microversion: 2.1 time: 0.807289 Jul 12 11:49:39.628072 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 82/194] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:38 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1495 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:39.835323 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c41e1591-338d-419c-8fb6-a549f2ea9c47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:39.836312 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c41e1591-338d-419c-8fb6-a549f2ea9c47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:39.848068 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c41e1591-338d-419c-8fb6-a549f2ea9c47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:39.856363 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c41e1591-338d-419c-8fb6-a549f2ea9c47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:39.862470 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c41e1591-338d-419c-8fb6-a549f2ea9c47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:39.864560 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c41e1591-338d-419c-8fb6-a549f2ea9c47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:40.254261 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c41e1591-338d-419c-8fb6-a549f2ea9c47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:40.264059 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c41e1591-338d-419c-8fb6-a549f2ea9c47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 200 len: 1434 microversion: 2.1 time: 0.434302 Jul 12 11:49:40.265038 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 83/195] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:39 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 1434 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:49:40.318438 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9f513a40-b3f5-42ac-b7cf-2bd98f7c2b21 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.814364 Jul 12 11:49:40.320985 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 113/196] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 11:49:39 2022] PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata => generated 61 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:40.330085 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-11b89fda-5a3e-4706-93c2-f643fa63ae30 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Calling method '.version_select at 0x7f5e0bdd94c0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:40.370583 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-f94166a8-9ec3-4ec9-adc4-5d37a52b1337 req-4d21216e-6426-4367-80fb-e0ff7325339d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409e75a9-6ee8-4705-9f27-97989ba439a2", "name": "network-vif-deleted", "tag": "5660c4c5-a274-499b-a33f-0b775b8ebc8e"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:40.396399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-f94166a8-9ec3-4ec9-adc4-5d37a52b1337 req-4d21216e-6426-4367-80fb-e0ff7325339d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:40.397342 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-f94166a8-9ec3-4ec9-adc4-5d37a52b1337 req-4d21216e-6426-4367-80fb-e0ff7325339d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:40.418478 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-11b89fda-5a3e-4706-93c2-f643fa63ae30 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "GET /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.092183 Jul 12 11:49:40.419053 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 84/197] 10.222.0.50 () {58 vars in 1289 bytes} [Tue Jul 12 11:49:40 2022] GET /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata/os_distro => generated 33 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:40.430925 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ec35478b-a10e-4afe-a552-f8710bc8cbbf tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Action: 'update_all', calling method: .version_select at 0x7f5e0bca21f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:40.443155 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-f94166a8-9ec3-4ec9-adc4-5d37a52b1337 req-4d21216e-6426-4367-80fb-e0ff7325339d service nova] Creating event network-vif-deleted:5660c4c5-a274-499b-a33f-0b775b8ebc8e for instance 409e75a9-6ee8-4705-9f27-97989ba439a2 on n-h1-849104-4 Jul 12 11:49:40.449295 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-f94166a8-9ec3-4ec9-adc4-5d37a52b1337 req-4d21216e-6426-4367-80fb-e0ff7325339d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083552 Jul 12 11:49:40.451153 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 114/198] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:49:40.460207 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-238c9674-92b8-4240-8537-a156e8ec97fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:40.461011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-238c9674-92b8-4240-8537-a156e8ec97fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:40.483172 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-238c9674-92b8-4240-8537-a156e8ec97fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:40.484704 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-238c9674-92b8-4240-8537-a156e8ec97fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:40.486441 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-238c9674-92b8-4240-8537-a156e8ec97fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:40.487056 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-238c9674-92b8-4240-8537-a156e8ec97fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:40.561381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-ec35478b-a10e-4afe-a552-f8710bc8cbbf tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:49:40.574814 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-ec35478b-a10e-4afe-a552-f8710bc8cbbf tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for user adb3f360730a46e2b72132c4adaa5e6a and project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:49:40.946887 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ec35478b-a10e-4afe-a552-f8710bc8cbbf tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.519521 Jul 12 11:49:40.947887 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 85/199] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 11:49:40 2022] PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata => generated 61 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 11:49:40.953191 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e87e9b96-46ed-436d-8b71-328d7a955440 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:40.955909 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e87e9b96-46ed-436d-8b71-328d7a955440 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:40.970148 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e87e9b96-46ed-436d-8b71-328d7a955440 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:40.970604 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e87e9b96-46ed-436d-8b71-328d7a955440 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:40.971404 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e87e9b96-46ed-436d-8b71-328d7a955440 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:40.971885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e87e9b96-46ed-436d-8b71-328d7a955440 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:41.474165 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e87e9b96-46ed-436d-8b71-328d7a955440 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:41.484939 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e87e9b96-46ed-436d-8b71-328d7a955440 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1495 microversion: 2.1 time: 0.535887 Jul 12 11:49:41.485928 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 86/200] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:40 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1495 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:41.491234 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bb7f352b-3436-463e-90e3-28e45b7cbadf tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Calling method '.version_select at 0x7f5e0bca2670>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:41.526980 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-238c9674-92b8-4240-8537-a156e8ec97fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:41.538864 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-238c9674-92b8-4240-8537-a156e8ec97fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1313 microversion: 2.1 time: 1.085836 Jul 12 11:49:41.539498 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 115/201] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:40 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1313 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:41.554293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3b5615d9-0258-4acd-b5eb-5c1be5b2e4b2 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:41.567021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3b5615d9-0258-4acd-b5eb-5c1be5b2e4b2 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:41.572202 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bb7f352b-3436-463e-90e3-28e45b7cbadf tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "GET /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.084917 Jul 12 11:49:41.574835 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 87/202] 10.222.0.50 () {58 vars in 1259 bytes} [Tue Jul 12 11:49:41 2022] GET /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata => generated 61 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:41.588743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a3998edb-2b91-441d-9dfd-c49209427b74 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Action: 'update_all', calling method: .version_select at 0x7f5e0bccc940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:41.591058 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3b5615d9-0258-4acd-b5eb-5c1be5b2e4b2 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:41.591516 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3b5615d9-0258-4acd-b5eb-5c1be5b2e4b2 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:41.592333 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3b5615d9-0258-4acd-b5eb-5c1be5b2e4b2 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:41.592769 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3b5615d9-0258-4acd-b5eb-5c1be5b2e4b2 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:41.652257 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-3b5615d9-0258-4acd-b5eb-5c1be5b2e4b2 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] HTTP exception thrown: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3b5615d9-0258-4acd-b5eb-5c1be5b2e4b2 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Request method failure captured: Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 HTTP/1.1 Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV-pl-lc1Yp5UWTCdLcV3JyXQYaOGMbW7v8V_UdHYNKcJ80_h-JbargH-Z_fDWEgmTuYcwhqACy5VYsd5xFK7dILJwHF66sXRcteqqF6Zf2jwlYW4ZeWLpYH_up9m1a5S31-tyIdK5QBdbZty3eJ0CyVpBAQkwhyI0j2G4ZrsL-2Kns Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 959f0f9676134a43b59b24a174df0df8 Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:41.663668 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:41.665148 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_959f0f9676134a43b59b24a174df0df8", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:41.665148 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:41.665148 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 959f0f9676134a43b59b24a174df0df8 Jul 12 11:49:41.665148 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:41.665148 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-DeleteServersAdminTestJSON-1286651160-project Jul 12 11:49:41.665148 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:41.665148 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:41.665148 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: a1398a8a39da4db08f1ae1ae223d13ce Jul 12 11:49:41.665148 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-DeleteServersAdminTestJSON-1286651160-project Jul 12 11:49:41.665148 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:41.665148 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:41.665148 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '409e75a9-6ee8-4705-9f27-97989ba439a2'} Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:41.665796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:41.672923 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:41.674063 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3b5615d9-0258-4acd-b5eb-5c1be5b2e4b2 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Returning 404 to user: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:41.674063 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3b5615d9-0258-4acd-b5eb-5c1be5b2e4b2 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 404 len: 111 microversion: 2.1 time: 0.123779 Jul 12 11:49:41.674063 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 116/203] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:41 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:41.697613 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a3998edb-2b91-441d-9dfd-c49209427b74 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:49:41.705992 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a3998edb-2b91-441d-9dfd-c49209427b74 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for user adb3f360730a46e2b72132c4adaa5e6a and project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:49:42.002141 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-141152434", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:42.209567 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] validate_networks() for None {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:49:42.330389 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a3998edb-2b91-441d-9dfd-c49209427b74 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.748775 Jul 12 11:49:42.335122 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 88/204] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 11:49:41 2022] PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata => generated 61 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 11:49:42.349663 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-bd01f7ae-084f-452b-89f5-9cd24373e440 req-a9b1f2a9-fe85-42fe-a44c-2b139dbaa602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4298b8-89e6-4f58-a781-f850dab332a7", "name": "network-vif-deleted", "tag": "e214e74f-a4a8-464c-9444-ac4d68d3ec0f"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:42.371797 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-bd01f7ae-084f-452b-89f5-9cd24373e440 req-a9b1f2a9-fe85-42fe-a44c-2b139dbaa602 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:42.377957 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-bd01f7ae-084f-452b-89f5-9cd24373e440 req-a9b1f2a9-fe85-42fe-a44c-2b139dbaa602 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:42.403306 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-bd01f7ae-084f-452b-89f5-9cd24373e440 req-a9b1f2a9-fe85-42fe-a44c-2b139dbaa602 service nova] Creating event network-vif-deleted:e214e74f-a4a8-464c-9444-ac4d68d3ec0f for instance dd4298b8-89e6-4f58-a781-f850dab332a7 on n-h2-849104-4 Jul 12 11:49:42.417910 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-bd01f7ae-084f-452b-89f5-9cd24373e440 req-a9b1f2a9-fe85-42fe-a44c-2b139dbaa602 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075929 Jul 12 11:49:42.418944 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 89/205] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:42.425624 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-50260ed5-454b-41c2-b257-df15db8c3f07 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Action: 'update_all', calling method: .version_select at 0x7f5e0bdd9820>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:42.536718 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-50260ed5-454b-41c2-b257-df15db8c3f07 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:49:42.556792 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-50260ed5-454b-41c2-b257-df15db8c3f07 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for user adb3f360730a46e2b72132c4adaa5e6a and project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:49:42.937981 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:49:42.938525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:49:42.941097 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:49:42.948409 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:49:42.949418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:49:42.985273 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:42.987553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:42.989993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:42.991640 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:43.037611 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Getting quotas for project 959f0f9676134a43b59b24a174df0df8. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:49:43.056553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Getting quotas for user a1398a8a39da4db08f1ae1ae223d13ce and project 959f0f9676134a43b59b24a174df0df8. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:49:43.111401 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:49:43.146339 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:49:43.268807 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-53339308-813d-46e0-b573-fbde1229acf6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.271287 Jul 12 11:49:43.270221 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 117/206] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:49:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:49:43.272803 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-50260ed5-454b-41c2-b257-df15db8c3f07 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata" status: 200 len: 64 microversion: 2.1 time: 0.852414 Jul 12 11:49:43.273781 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 90/207] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 11:49:42 2022] PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata => generated 64 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:43.279400 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b67a6a80-d14d-4602-9098-a1afdb27f8de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:43.280383 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b67a6a80-d14d-4602-9098-a1afdb27f8de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:43.286474 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d2ad7b9b-656f-4fd8-a4ab-f9e1a9ec1eca tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:43.287430 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d2ad7b9b-656f-4fd8-a4ab-f9e1a9ec1eca tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:43.290900 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=89,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=1,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:43.309296 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b67a6a80-d14d-4602-9098-a1afdb27f8de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:43.309988 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b67a6a80-d14d-4602-9098-a1afdb27f8de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:43.311068 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b67a6a80-d14d-4602-9098-a1afdb27f8de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:43.314428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b67a6a80-d14d-4602-9098-a1afdb27f8de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:43.318702 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d2ad7b9b-656f-4fd8-a4ab-f9e1a9ec1eca tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:43.319157 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d2ad7b9b-656f-4fd8-a4ab-f9e1a9ec1eca tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:43.324937 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d2ad7b9b-656f-4fd8-a4ab-f9e1a9ec1eca tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:43.325746 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d2ad7b9b-656f-4fd8-a4ab-f9e1a9ec1eca tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:43.434359 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d2ad7b9b-656f-4fd8-a4ab-f9e1a9ec1eca tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:43.435922 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d2ad7b9b-656f-4fd8-a4ab-f9e1a9ec1eca tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:43.436888 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-d2ad7b9b-656f-4fd8-a4ab-f9e1a9ec1eca tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lazy-loading 'fault' on Instance uuid dd4298b8-89e6-4f58-a781-f850dab332a7 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:49:43.701948 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b67a6a80-d14d-4602-9098-a1afdb27f8de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:43.712858 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b67a6a80-d14d-4602-9098-a1afdb27f8de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1313 microversion: 2.1 time: 0.437695 Jul 12 11:49:43.713503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d2ad7b9b-656f-4fd8-a4ab-f9e1a9ec1eca tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9960b163a93241a7961e242c60f704b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c437ce2735840ce8bf6729ba3cceae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:43.714116 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 91/208] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:43 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:43.721258 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d2ad7b9b-656f-4fd8-a4ab-f9e1a9ec1eca tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 200 len: 1329 microversion: 2.1 time: 0.449614 Jul 12 11:49:43.731894 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 118/209] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:43 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 1329 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:43.738626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-186e6689-b562-4d2e-86b9-9a1b419dd0b7 req-e70dc56e-fc54-47c8-9bce-47c59bf615c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e100f265-e0cc-405b-87d0-d4c524c2e333", "tag": "46a1ed7f-84a2-4d5e-b3d7-20e1261b3c88"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:43.750701 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-186e6689-b562-4d2e-86b9-9a1b419dd0b7 req-e70dc56e-fc54-47c8-9bce-47c59bf615c0 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:43.751779 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-186e6689-b562-4d2e-86b9-9a1b419dd0b7 req-e70dc56e-fc54-47c8-9bce-47c59bf615c0 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:43.770180 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-186e6689-b562-4d2e-86b9-9a1b419dd0b7 req-e70dc56e-fc54-47c8-9bce-47c59bf615c0 service nova] Creating event network-changed:46a1ed7f-84a2-4d5e-b3d7-20e1261b3c88 for instance e100f265-e0cc-405b-87d0-d4c524c2e333 on n-h1-849104-4 Jul 12 11:49:43.777789 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-186e6689-b562-4d2e-86b9-9a1b419dd0b7 req-e70dc56e-fc54-47c8-9bce-47c59bf615c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044253 Jul 12 11:49:43.778672 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 119/210] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:43.786465 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-564a51e7-f646-4d20-aa21-0dc6665bc157 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:43.787095 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-564a51e7-f646-4d20-aa21-0dc6665bc157 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:43.863201 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-37370383-bb34-408f-8819-9d49c110ab81 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Calling method '.version_select at 0x7f5e10048ca0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:43.864995 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:43.864995 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:43.866291 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37370383-bb34-408f-8819-9d49c110ab81 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:43.866744 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37370383-bb34-408f-8819-9d49c110ab81 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:43.884646 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37370383-bb34-408f-8819-9d49c110ab81 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:43.885278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37370383-bb34-408f-8819-9d49c110ab81 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:43.888285 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-564a51e7-f646-4d20-aa21-0dc6665bc157 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:43.902476 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-564a51e7-f646-4d20-aa21-0dc6665bc157 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 200 len: 1219 microversion: 2.1 time: 0.122285 Jul 12 11:49:43.903849 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 120/211] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:43 2022] GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 1219 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:43.909622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a6a4979d-5342-46e2-922b-7e915d9c2782 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Calling method '.version_select at 0x7f5e0abf1550>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:43.918347 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37370383-bb34-408f-8819-9d49c110ab81 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:43.918925 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37370383-bb34-408f-8819-9d49c110ab81 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:43.931727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37370383-bb34-408f-8819-9d49c110ab81 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:43.932236 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37370383-bb34-408f-8819-9d49c110ab81 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:43.960905 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37370383-bb34-408f-8819-9d49c110ab81 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:43.961660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37370383-bb34-408f-8819-9d49c110ab81 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:43.962713 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a6a4979d-5342-46e2-922b-7e915d9c2782 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "GET /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata" status: 200 len: 64 microversion: 2.1 time: 0.057460 Jul 12 11:49:43.970021 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 121/212] 10.222.0.50 () {58 vars in 1259 bytes} [Tue Jul 12 11:49:43 2022] GET /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata => generated 64 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:43.973167 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-37370383-bb34-408f-8819-9d49c110ab81 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 0.257792 Jul 12 11:49:43.974383 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 92/213] 10.222.0.50 () {60 vars in 1242 bytes} [Tue Jul 12 11:49:43 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:49:43.977249 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-486d8152-56df-4be0-9b9a-0517da063ed0 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Action: 'update_all', calling method: .version_select at 0x7f5e0ac7b820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:43.995207 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e8bb22d4-eb60-4fdc-a2c1-517e97c7d95a tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Calling method '.version_select at 0x7f5e0bcf0550>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:43.999639 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:43.999639 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:44.002635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8bb22d4-eb60-4fdc-a2c1-517e97c7d95a tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:44.003153 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8bb22d4-eb60-4fdc-a2c1-517e97c7d95a tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:44.025763 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8bb22d4-eb60-4fdc-a2c1-517e97c7d95a tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:44.026208 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8bb22d4-eb60-4fdc-a2c1-517e97c7d95a tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:44.043860 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8bb22d4-eb60-4fdc-a2c1-517e97c7d95a tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:44.044486 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8bb22d4-eb60-4fdc-a2c1-517e97c7d95a tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:44.070171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8bb22d4-eb60-4fdc-a2c1-517e97c7d95a tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:44.070894 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8bb22d4-eb60-4fdc-a2c1-517e97c7d95a tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:44.076665 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-486d8152-56df-4be0-9b9a-0517da063ed0 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:49:44.090387 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-486d8152-56df-4be0-9b9a-0517da063ed0 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for user adb3f360730a46e2b72132c4adaa5e6a and project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:49:44.110057 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8bb22d4-eb60-4fdc-a2c1-517e97c7d95a tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:44.113824 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8bb22d4-eb60-4fdc-a2c1-517e97c7d95a tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:44.124240 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e8bb22d4-eb60-4fdc-a2c1-517e97c7d95a tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.138381 Jul 12 11:49:44.131746 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 93/214] 10.222.0.50 () {60 vars in 1221 bytes} [Tue Jul 12 11:49:43 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:49:44.138226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1676fb6c-550a-4b29-9408-843404957456 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Calling method '.version_select at 0x7f5e0bedc160>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:44.140133 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:44.140133 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:44.143021 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1676fb6c-550a-4b29-9408-843404957456 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:44.143727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1676fb6c-550a-4b29-9408-843404957456 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:44.173822 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1676fb6c-550a-4b29-9408-843404957456 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:44.175712 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1676fb6c-550a-4b29-9408-843404957456 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:44.185272 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1676fb6c-550a-4b29-9408-843404957456 tempest-HypervisorAdminV253TestBase-1576800602 tempest-HypervisorAdminV253TestBase-1576800602-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/fab65aa6-a63e-41b3-aa80-61588d68d3e9" status: 200 len: 791 microversion: 2.53 time: 0.051820 Jul 12 11:49:44.185880 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 94/215] 10.222.0.50 () {60 vars in 1297 bytes} [Tue Jul 12 11:49:44 2022] GET /compute/v2.1/os-hypervisors/fab65aa6-a63e-41b3-aa80-61588d68d3e9 => generated 791 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:49:44.598651 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-486d8152-56df-4be0-9b9a-0517da063ed0 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.624622 Jul 12 11:49:44.599280 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 122/216] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 11:49:43 2022] PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata => generated 61 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:44.609190 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6cb5a12a-2f44-4d81-8603-8e84904fbc56 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Action: 'update', calling method: .version_select at 0x7f5e0bedc4c0>, body: {"meta": {"os_version": "alt"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:44.685318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-6cb5a12a-2f44-4d81-8603-8e84904fbc56 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:49:44.698790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-6cb5a12a-2f44-4d81-8603-8e84904fbc56 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for user adb3f360730a46e2b72132c4adaa5e6a and project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:49:44.731561 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-90dcbaa5-ac3b-43f7-a20b-36576b63f5fb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:44.732206 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-90dcbaa5-ac3b-43f7-a20b-36576b63f5fb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:44.750867 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90dcbaa5-ac3b-43f7-a20b-36576b63f5fb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:44.751630 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90dcbaa5-ac3b-43f7-a20b-36576b63f5fb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:44.755795 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90dcbaa5-ac3b-43f7-a20b-36576b63f5fb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:44.756447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90dcbaa5-ac3b-43f7-a20b-36576b63f5fb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:45.154174 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6cb5a12a-2f44-4d81-8603-8e84904fbc56 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.549097 Jul 12 11:49:45.158564 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 95/217] 10.222.0.50 () {60 vars in 1312 bytes} [Tue Jul 12 11:49:44 2022] PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata/os_version => generated 31 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 11:49:45.163273 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-74a7c5df-247f-4b27-949f-fad12508dd13 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:45.163273 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-74a7c5df-247f-4b27-949f-fad12508dd13 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:45.192088 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-90dcbaa5-ac3b-43f7-a20b-36576b63f5fb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:45.192521 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-74a7c5df-247f-4b27-949f-fad12508dd13 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:45.193146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-74a7c5df-247f-4b27-949f-fad12508dd13 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:45.194099 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-74a7c5df-247f-4b27-949f-fad12508dd13 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:45.194670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-74a7c5df-247f-4b27-949f-fad12508dd13 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:45.204688 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-90dcbaa5-ac3b-43f7-a20b-36576b63f5fb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1313 microversion: 2.1 time: 0.478288 Jul 12 11:49:45.205409 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 123/218] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:44 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:45.210770 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f9c9ec74-3deb-4edc-af3c-a8eeb7296041 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:45.210898 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-74a7c5df-247f-4b27-949f-fad12508dd13 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] HTTP exception thrown: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:45.211538 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f9c9ec74-3deb-4edc-af3c-a8eeb7296041 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-74a7c5df-247f-4b27-949f-fad12508dd13 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Request method failure captured: Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 HTTP/1.1 Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-oVixSEQYoFEP6zaZdv3VOUqFjA_BVQjDG-I5VQ7IJX1iKEAmmopC_LSJ3VAP529ypj74oZsQYoUnKqZfd8PIP8P2bU8IpPlzYQcL4fpPMrNulcMCboX38UKljieUCmC7_AEnZVdc5QSm9uIAW1dzf6G5-UpJXySy3U3U7JC6BV0U Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 5c437ce2735840ce8bf6729ba3cceae3 Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminTestJSON-643502991 Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:45.215989 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:45.217175 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c437ce2735840ce8bf6729ba3cceae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c437ce2735840ce8bf6729ba3cceae3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5c437ce2735840ce8bf6729ba3cceae3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5c437ce2735840ce8bf6729ba3cceae3", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:45.217175 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminTestJSON-643502991 Jul 12 11:49:45.217175 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 5c437ce2735840ce8bf6729ba3cceae3 Jul 12 11:49:45.217175 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-643502991 Jul 12 11:49:45.217175 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminTestJSON-643502991-project Jul 12 11:49:45.217175 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:45.217175 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:45.217175 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 9960b163a93241a7961e242c60f704b6 Jul 12 11:49:45.217175 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminTestJSON-643502991-project Jul 12 11:49:45.217175 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:45.217175 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:45.217175 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'dd4298b8-89e6-4f58-a781-f850dab332a7'} Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:45.217838 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:45.218851 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:45.221170 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9c9ec74-3deb-4edc-af3c-a8eeb7296041 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:45.221413 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-74a7c5df-247f-4b27-949f-fad12508dd13 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Returning 404 to user: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:45.222532 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-74a7c5df-247f-4b27-949f-fad12508dd13 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 404 len: 111 microversion: 2.1 time: 0.066097 Jul 12 11:49:45.223423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9c9ec74-3deb-4edc-af3c-a8eeb7296041 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:45.223626 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 96/219] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:45 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:45.224424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9c9ec74-3deb-4edc-af3c-a8eeb7296041 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:45.225142 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9c9ec74-3deb-4edc-af3c-a8eeb7296041 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:45.240899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-75dd168c-598b-4844-a8ea-e8f3cfdc5c05 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Calling method '.version_select at 0x7f5e0bbfde50>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:45.305945 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-75dd168c-598b-4844-a8ea-e8f3cfdc5c05 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "GET /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata" status: 200 len: 58 microversion: 2.1 time: 0.080964 Jul 12 11:49:45.306550 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 97/220] 10.222.0.50 () {58 vars in 1259 bytes} [Tue Jul 12 11:49:45 2022] GET /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata => generated 58 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:45.321434 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ce31d865-ed45-4d31-b175-834804181024 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-849104-4"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:45.324609 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:45.324609 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:45.346728 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f9c9ec74-3deb-4edc-af3c-a8eeb7296041 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:45.357577 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce31d865-ed45-4d31-b175-834804181024 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:45.358468 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f9c9ec74-3deb-4edc-af3c-a8eeb7296041 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 200 len: 1299 microversion: 2.1 time: 0.151613 Jul 12 11:49:45.359630 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce31d865-ed45-4d31-b175-834804181024 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:45.360492 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 124/221] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:45 2022] GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 1299 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:45.394827 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cf85f8d5-2c75-459d-9482-38554cf72089 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Action: 'update_all', calling method: .version_select at 0x7f5e0ac7be50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:45.504205 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-cf85f8d5-2c75-459d-9482-38554cf72089 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:49:45.511353 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-cf85f8d5-2c75-459d-9482-38554cf72089 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for user adb3f360730a46e2b72132c4adaa5e6a and project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:49:45.984165 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cf85f8d5-2c75-459d-9482-38554cf72089 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.620381 Jul 12 11:49:45.989841 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 125/222] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 11:49:45 2022] PUT /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata => generated 61 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:45.995331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2cc3ee37-1e2d-48bf-8efe-7d8747fa8a19 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Action: 'create', calling method: .version_select at 0x7f5e0ac4d430>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:46.066647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-2cc3ee37-1e2d-48bf-8efe-7d8747fa8a19 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:49:46.070235 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ce31d865-ed45-4d31-b175-834804181024 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.1 time: 0.761806 Jul 12 11:49:46.072680 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-2cc3ee37-1e2d-48bf-8efe-7d8747fa8a19 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Getting quotas for user adb3f360730a46e2b72132c4adaa5e6a and project 19983c6a4512426ca40139da4e998feb. Resources: dict_keys(['metadata_items']) {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:49:46.076260 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 98/223] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Jul 12 11:49:45 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:46.088199 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-dabbd652-7ed3-476f-ac3f-b43dfea6b460 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:46.089256 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:46.089256 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:46.124941 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-dabbd652-7ed3-476f-ac3f-b43dfea6b460 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.042510 Jul 12 11:49:46.126252 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 99/224] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:46 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 12 11:49:46.163940 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-93d3bb77-063f-4147-918a-2dc92e64e391 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1063618883"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:46.214429 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:46.214429 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:46.215477 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.aggregate [None req-93d3bb77-063f-4147-918a-2dc92e64e391 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Generated uuid b47d1422-2516-4a8c-8e68-155fd9876480 for aggregate {{(pid=125983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:46.255421 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-93d3bb77-063f-4147-918a-2dc92e64e391 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.116032 Jul 12 11:49:46.256799 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 100/225] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:46.262486 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cdd98bdd-82a0-450d-92be-0badd6b67228 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:46.276337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cdd98bdd-82a0-450d-92be-0badd6b67228 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:46.285690 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cdd98bdd-82a0-450d-92be-0badd6b67228 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:46.287409 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cdd98bdd-82a0-450d-92be-0badd6b67228 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:46.288478 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cdd98bdd-82a0-450d-92be-0badd6b67228 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:46.289141 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cdd98bdd-82a0-450d-92be-0badd6b67228 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:46.708497 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2cc3ee37-1e2d-48bf-8efe-7d8747fa8a19 tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "POST /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata" status: 200 len: 85 microversion: 2.1 time: 0.717452 Jul 12 11:49:46.709095 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 126/226] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Jul 12 11:49:45 2022] POST /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata => generated 85 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:46.719901 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ac713072-bab2-410e-85f3-11637735c7f9 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849104-4"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:46.719901 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:46.719901 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:46.729013 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac713072-bab2-410e-85f3-11637735c7f9 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:46.729545 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac713072-bab2-410e-85f3-11637735c7f9 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:46.767657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-cdd98bdd-82a0-450d-92be-0badd6b67228 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:46.779579 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cdd98bdd-82a0-450d-92be-0badd6b67228 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1313 microversion: 2.1 time: 0.517954 Jul 12 11:49:46.780628 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 101/227] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:46 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:46.788173 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-142e1783-6a8a-4f09-b1dc-3e47f2088d6f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:46.788866 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-142e1783-6a8a-4f09-b1dc-3e47f2088d6f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:46.806708 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-142e1783-6a8a-4f09-b1dc-3e47f2088d6f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:46.807162 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-142e1783-6a8a-4f09-b1dc-3e47f2088d6f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:46.807959 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-142e1783-6a8a-4f09-b1dc-3e47f2088d6f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:46.808402 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-142e1783-6a8a-4f09-b1dc-3e47f2088d6f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:46.910384 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ac713072-bab2-410e-85f3-11637735c7f9 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.195377 Jul 12 11:49:46.913791 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 127/228] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Jul 12 11:49:46 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:46.924548 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8ab9c36a-c598-473f-9622-371dbf9ee4ef tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] Calling method '.version_select at 0x7f5e0ab2ea60>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:46.974567 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8ab9c36a-c598-473f-9622-371dbf9ee4ef tempest-ImagesMetadataTestJSON-706304855 tempest-ImagesMetadataTestJSON-706304855-project] 10.222.0.50 "GET /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata" status: 200 len: 85 microversion: 2.1 time: 0.054166 Jul 12 11:49:46.975198 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 128/229] 10.222.0.50 () {58 vars in 1259 bytes} [Tue Jul 12 11:49:46 2022] GET /compute/v2.1/images/4aac068e-d001-484e-b984-0564bd007c0b/metadata => generated 85 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:49:46.984951 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dcbed203-b77a-488c-ac8e-1af594ab6fd3 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:46.985721 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:46.985721 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:46.994893 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dcbed203-b77a-488c-ac8e-1af594ab6fd3 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.013400 Jul 12 11:49:46.995473 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 129/230] 10.222.0.50 () {58 vars in 1148 bytes} [Tue Jul 12 11:49:46 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:47.007052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bbbfd535-7d00-408e-bdeb-0a800ff01e7d tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-849104-4"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:47.008830 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:47.008830 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:47.019850 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bbbfd535-7d00-408e-bdeb-0a800ff01e7d tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:47.020679 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bbbfd535-7d00-408e-bdeb-0a800ff01e7d tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:47.117306 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-142e1783-6a8a-4f09-b1dc-3e47f2088d6f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:47.127337 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-142e1783-6a8a-4f09-b1dc-3e47f2088d6f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 200 len: 1319 microversion: 2.1 time: 0.345312 Jul 12 11:49:47.138954 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 102/231] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:46 2022] GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:47.179433 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bbbfd535-7d00-408e-bdeb-0a800ff01e7d tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.176431 Jul 12 11:49:47.186923 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 130/232] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Jul 12 11:49:47 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:47.193799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9b4a2951-dd53-4b5b-b579-a9be946f0dfd tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:47.196119 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:47.196119 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:47.219054 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:47.235121 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9b4a2951-dd53-4b5b-b579-a9be946f0dfd tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.046982 Jul 12 11:49:47.236141 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 103/233] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:47 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 12 11:49:47.256158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-250dbf9f-0080-4085-93c4-f2ba864dd8c6 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-18259278"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:47.258472 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:47.258472 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:47.259434 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.aggregate [None req-250dbf9f-0080-4085-93c4-f2ba864dd8c6 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Generated uuid 8bdb3087-ab8a-4cd0-b1bf-e5ffdb30bcee for aggregate {{(pid=125984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:47.297908 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-250dbf9f-0080-4085-93c4-f2ba864dd8c6 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.053819 Jul 12 11:49:47.299250 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 131/234] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:47 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:49:47.310835 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-828f01ff-4f94-4a4f-9344-dfc9900b0856 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849104-4"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:47.312211 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:47.312211 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:47.328134 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-828f01ff-4f94-4a4f-9344-dfc9900b0856 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:47.329117 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-828f01ff-4f94-4a4f-9344-dfc9900b0856 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:47.533350 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-7da90785-9491-4800-a4ce-ee63ed90aab9 req-c3d55979-5af6-4b18-994e-2b684d769cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c3c3708-14f5-486e-8025-a4b91aefee65", "tag": "dd35879a-b9d2-470e-99a5-526d2b5a0e51"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:47.574167 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-7da90785-9491-4800-a4ce-ee63ed90aab9 req-c3d55979-5af6-4b18-994e-2b684d769cff service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:47.579450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-7da90785-9491-4800-a4ce-ee63ed90aab9 req-c3d55979-5af6-4b18-994e-2b684d769cff service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:47.604078 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-828f01ff-4f94-4a4f-9344-dfc9900b0856 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 240 microversion: 2.1 time: 0.298205 Jul 12 11:49:47.605161 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 104/235] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Jul 12 11:49:47 2022] POST /compute/v2.1/os-aggregates/3/action => generated 240 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:47.619479 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7ceddbd3-23b6-4192-9754-e259d90d13bc tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:47.620400 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:47.620400 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:47.641227 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-7da90785-9491-4800-a4ce-ee63ed90aab9 req-c3d55979-5af6-4b18-994e-2b684d769cff service nova] Creating event network-changed:dd35879a-b9d2-470e-99a5-526d2b5a0e51 for instance 0c3c3708-14f5-486e-8025-a4b91aefee65 on n-h2-849104-4 Jul 12 11:49:47.651728 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-7da90785-9491-4800-a4ce-ee63ed90aab9 req-c3d55979-5af6-4b18-994e-2b684d769cff service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150804 Jul 12 11:49:47.656445 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7ceddbd3-23b6-4192-9754-e259d90d13bc tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 243 microversion: 2.1 time: 0.045165 Jul 12 11:49:47.657303 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 105/236] 10.222.0.50 () {58 vars in 1142 bytes} [Tue Jul 12 11:49:47 2022] GET /compute/v2.1/os-aggregates => generated 243 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:49:47.663952 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 132/237] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:49:47.670615 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-887b57da-9af0-4c9d-be39-03aba81ef86d tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-849104-4"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:47.672302 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:47.672302 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:47.682143 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-887b57da-9af0-4c9d-be39-03aba81ef86d tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:47.686226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-887b57da-9af0-4c9d-be39-03aba81ef86d tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:47.797916 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2f721868-8a70-404b-830c-32d1c78c7644 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:47.800062 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2f721868-8a70-404b-830c-32d1c78c7644 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:47.812778 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2f721868-8a70-404b-830c-32d1c78c7644 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:47.817762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2f721868-8a70-404b-830c-32d1c78c7644 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:47.819553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2f721868-8a70-404b-830c-32d1c78c7644 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:47.821278 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2f721868-8a70-404b-830c-32d1c78c7644 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:47.880008 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-887b57da-9af0-4c9d-be39-03aba81ef86d tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 225 microversion: 2.1 time: 0.215041 Jul 12 11:49:47.880643 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 106/238] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Jul 12 11:49:47 2022] POST /compute/v2.1/os-aggregates/3/action => generated 225 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:49:47.894150 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5ff8a459-3bf0-40bd-b464-6615fd9dd20b tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:47.895249 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:47.895249 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:47.930565 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5ff8a459-3bf0-40bd-b464-6615fd9dd20b tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.040353 Jul 12 11:49:47.932328 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 107/239] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:47 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:47.943433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5de0e218-7b7d-442d-ba67-9d0b29bea2a4 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1664161898"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:47.945365 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:47.945365 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:47.947207 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.aggregate [None req-5de0e218-7b7d-442d-ba67-9d0b29bea2a4 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Generated uuid 88bab33a-466e-4311-b94e-646cc3539615 for aggregate {{(pid=125983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:47.987505 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5de0e218-7b7d-442d-ba67-9d0b29bea2a4 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048267 Jul 12 11:49:47.988881 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 108/240] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:48.002199 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0f6f6235-d7e1-401f-99c3-e87d62f11476 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849104-4"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:48.006232 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:48.006232 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:48.023667 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0f6f6235-d7e1-401f-99c3-e87d62f11476 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:48.024168 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0f6f6235-d7e1-401f-99c3-e87d62f11476 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:48.219027 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0f6f6235-d7e1-401f-99c3-e87d62f11476 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.222973 Jul 12 11:49:48.219973 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 109/241] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Jul 12 11:49:47 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:48.226657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e4584be5-0f5a-4cb7-b5bf-2be93e5af24f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:48.228986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e4584be5-0f5a-4cb7-b5bf-2be93e5af24f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:48.241132 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4584be5-0f5a-4cb7-b5bf-2be93e5af24f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:48.242768 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4584be5-0f5a-4cb7-b5bf-2be93e5af24f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:48.245208 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4584be5-0f5a-4cb7-b5bf-2be93e5af24f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:48.246029 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4584be5-0f5a-4cb7-b5bf-2be93e5af24f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:48.270327 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2f721868-8a70-404b-830c-32d1c78c7644 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:48.288470 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2f721868-8a70-404b-830c-32d1c78c7644 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1313 microversion: 2.1 time: 0.491595 Jul 12 11:49:48.289416 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 133/242] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:47 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:48.301126 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d5d8a9e8-9d28-4f78-b299-26a9f874a98e tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-849104-4"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:48.303119 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:48.303119 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:48.323243 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d5d8a9e8-9d28-4f78-b299-26a9f874a98e tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:48.323691 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d5d8a9e8-9d28-4f78-b299-26a9f874a98e tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:48.509118 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d5d8a9e8-9d28-4f78-b299-26a9f874a98e tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.217815 Jul 12 11:49:48.510405 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 134/243] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Jul 12 11:49:48 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:48.526548 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2d2a4ef1-4f68-44b3-b32e-7e8c47d9f04f tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:48.527364 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:48.527364 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:48.552425 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2d2a4ef1-4f68-44b3-b32e-7e8c47d9f04f tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.035117 Jul 12 11:49:48.553328 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 135/244] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:48 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 12 11:49:48.580534 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8b0afae0-dda7-40b2-80b5-a609453b09d4 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1841332106"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:48.583807 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:48.583807 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:48.585658 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.aggregate [None req-8b0afae0-dda7-40b2-80b5-a609453b09d4 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Generated uuid 0cbcc4d6-2cd2-482d-aacf-455ad34ddf0c for aggregate {{(pid=125984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:48.592233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e4584be5-0f5a-4cb7-b5bf-2be93e5af24f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:48.604897 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e4584be5-0f5a-4cb7-b5bf-2be93e5af24f tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 200 len: 1319 microversion: 2.1 time: 0.379920 Jul 12 11:49:48.605989 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 110/245] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:48 2022] GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:48.617853 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-748bb3c0-ba90-4ef6-b0e5-43c8485ea35a tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-666265104"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:48.621147 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:48.621147 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:48.631814 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8b0afae0-dda7-40b2-80b5-a609453b09d4 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.070384 Jul 12 11:49:48.634432 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 136/246] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:48.634705 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.aggregate [None req-748bb3c0-ba90-4ef6-b0e5-43c8485ea35a tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Generated uuid 505d1b65-2774-4ef0-9883-ed1fd9cbf377 for aggregate {{(pid=125983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:48.646089 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0646c239-22c2-4f7a-9671-5c9a32484519 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:48.647752 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:48.647752 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:48.669716 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-748bb3c0-ba90-4ef6-b0e5-43c8485ea35a tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.062081 Jul 12 11:49:48.669893 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 111/247] 10.222.0.50 () {62 vars in 1204 bytes} [Tue Jul 12 11:49:48 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:49:48.680243 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-028fca87-da78-43c2-b111-def1eb90024f tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1919957870"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:48.682987 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0646c239-22c2-4f7a-9671-5c9a32484519 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.040610 Jul 12 11:49:48.683979 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 137/248] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:48 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:48.703395 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b7dc5a68-e5f9-4db4-9724-4f24cd6371df tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:48.704281 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:48.704281 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:48.715416 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-b7dc5a68-e5f9-4db4-9724-4f24cd6371df tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b7dc5a68-e5f9-4db4-9724-4f24cd6371df tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Request method failure captured: Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV-qEpRkvBdVCtmbGaYcUBSC-z_QWRaORWfnEjRVyZwp9QUOqJKeOIipyPUJuen5Y0Mswi7yNzL1Ei_SBQuDK91NGunQBYT32_WN9SD7-YnMShDpqhPjEP-kpCGZRrrgpCpzmEnE2zhhiA-WgpIO5KhNu2qNE8uYobTkI-4DpuZ2I04 Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 7d985247fd174f3db255fe58faf45075 Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-AggregatesAdminTestJSON-1302320456 Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:49:48.719246 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:49:48.720754 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d985247fd174f3db255fe58faf45075"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d985247fd174f3db255fe58faf45075"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7d985247fd174f3db255fe58faf45075"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7d985247fd174f3db255fe58faf45075", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:48.720754 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-AggregatesAdminTestJSON-1302320456 Jul 12 11:49:48.720754 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 7d985247fd174f3db255fe58faf45075 Jul 12 11:49:48.720754 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1302320456 Jul 12 11:49:48.720754 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-AggregatesAdminTestJSON-1302320456-project-admin Jul 12 11:49:48.720754 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:48.720754 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:48.720754 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 9c606b3b068d4e8ca50808aed339a065 Jul 12 11:49:48.720754 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-AggregatesAdminTestJSON-1302320456-project-admin Jul 12 11:49:48.720754 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:48.720754 n-d-849104-4 devstack@n-api.service[125984]: exception: Aggregate 5 could not be found. Jul 12 11:49:48.720754 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '5'} Jul 12 11:49:48.720754 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:48.722397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 12 11:49:48.723694 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.725119 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b7dc5a68-e5f9-4db4-9724-4f24cd6371df tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:48.725119 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b7dc5a68-e5f9-4db4-9724-4f24cd6371df tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.032393 Jul 12 11:49:48.725119 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 138/249] 10.222.0.50 () {58 vars in 1148 bytes} [Tue Jul 12 11:49:48 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 12 11:49:48.734993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-39ee1a7f-04c2-4e59-ade5-451d4d8a22de tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:48.735763 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:48.735763 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:48.754845 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-39ee1a7f-04c2-4e59-ade5-451d4d8a22de tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-39ee1a7f-04c2-4e59-ade5-451d4d8a22de tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Request method failure captured: Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV-qEpRkvBdVCtmbGaYcUBSC-z_QWRaORWfnEjRVyZwp9QUOqJKeOIipyPUJuen5Y0Mswi7yNzL1Ei_SBQuDK91NGunQBYT32_WN9SD7-YnMShDpqhPjEP-kpCGZRrrgpCpzmEnE2zhhiA-WgpIO5KhNu2qNE8uYobTkI-4DpuZ2I04 Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 7d985247fd174f3db255fe58faf45075 Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-AggregatesAdminTestJSON-1302320456 Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:49:48.756897 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:49:48.758517 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d985247fd174f3db255fe58faf45075"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d985247fd174f3db255fe58faf45075"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7d985247fd174f3db255fe58faf45075"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7d985247fd174f3db255fe58faf45075", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:48.758517 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-AggregatesAdminTestJSON-1302320456 Jul 12 11:49:48.758517 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 7d985247fd174f3db255fe58faf45075 Jul 12 11:49:48.758517 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1302320456 Jul 12 11:49:48.758517 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-AggregatesAdminTestJSON-1302320456-project-admin Jul 12 11:49:48.758517 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:48.758517 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:48.758517 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 9c606b3b068d4e8ca50808aed339a065 Jul 12 11:49:48.758517 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-AggregatesAdminTestJSON-1302320456-project-admin Jul 12 11:49:48.758517 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:48.758517 n-d-849104-4 devstack@n-api.service[125984]: exception: Aggregate 5 could not be found. Jul 12 11:49:48.758517 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '5'} Jul 12 11:49:48.758517 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:49:48.759332 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:48.766796 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:48.767873 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:48.767873 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:48.767873 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:48.767873 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 12 11:49:48.767873 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.767873 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-39ee1a7f-04c2-4e59-ade5-451d4d8a22de tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:48.767873 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-39ee1a7f-04c2-4e59-ade5-451d4d8a22de tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.030277 Jul 12 11:49:48.767873 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 139/250] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:48 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:49:48.771070 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5496c9a5-73f2-41d1-8401-a089c1908fc8 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-535237378", "name": "tempest-test_aggregate-1572458334"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:48.775235 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:48.775235 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:48.780488 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.aggregate [None req-5496c9a5-73f2-41d1-8401-a089c1908fc8 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Generated uuid 39166747-fe6e-4dfe-bfd8-442b8b091a0a for aggregate {{(pid=125984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:48.812940 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5496c9a5-73f2-41d1-8401-a089c1908fc8 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.045913 Jul 12 11:49:48.816147 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 140/251] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Jul 12 11:49:48 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:48.824910 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7e52cdad-c46f-4f7c-ac62-f0bfac6b7715 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:48.826097 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:48.826097 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:48.848587 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:DELETE=8 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:48.859505 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:48.859505 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:48.868965 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7e52cdad-c46f-4f7c-ac62-f0bfac6b7715 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.047415 Jul 12 11:49:48.870727 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 141/252] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:48 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:48.880964 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-93dccea9-4e25-4640-a271-9894868dacff req-fe7e0c51-725b-4c03-8a97-d35e42c0a331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e100f265-e0cc-405b-87d0-d4c524c2e333", "name": "network-vif-plugged", "status": "completed", "tag": "46a1ed7f-84a2-4d5e-b3d7-20e1261b3c88"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:48.903014 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-028fca87-da78-43c2-b111-def1eb90024f tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.226538 Jul 12 11:49:48.903623 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 112/253] 10.222.0.50 () {62 vars in 1209 bytes} [Tue Jul 12 11:49:48 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:49:48.914405 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-93dccea9-4e25-4640-a271-9894868dacff req-fe7e0c51-725b-4c03-8a97-d35e42c0a331 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:48.915582 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-93dccea9-4e25-4640-a271-9894868dacff req-fe7e0c51-725b-4c03-8a97-d35e42c0a331 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:48.920303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a3d5723a-1e6b-480e-9ea7-fc4bbab6fd60 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:48.921205 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:48.921205 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:48.934586 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-93dccea9-4e25-4640-a271-9894868dacff req-fe7e0c51-725b-4c03-8a97-d35e42c0a331 service nova] Creating event network-vif-plugged:46a1ed7f-84a2-4d5e-b3d7-20e1261b3c88 for instance e100f265-e0cc-405b-87d0-d4c524c2e333 on n-h1-849104-4 Jul 12 11:49:48.937744 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-a3d5723a-1e6b-480e-9ea7-fc4bbab6fd60 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 12 11:49:48.942766 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-93dccea9-4e25-4640-a271-9894868dacff req-fe7e0c51-725b-4c03-8a97-d35e42c0a331 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069297 Jul 12 11:49:48.944290 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 142/254] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a3d5723a-1e6b-480e-9ea7-fc4bbab6fd60 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Request method failure captured: Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-qEpRkvBdVCtmbGaYcUBSC-z_QWRaORWfnEjRVyZwp9QUOqJKeOIipyPUJuen5Y0Mswi7yNzL1Ei_SBQuDK91NGunQBYT32_WN9SD7-YnMShDpqhPjEP-kpCGZRrrgpCpzmEnE2zhhiA-WgpIO5KhNu2qNE8uYobTkI-4DpuZ2I04 Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 7d985247fd174f3db255fe58faf45075 Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminTestJSON-1302320456 Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:49:48.947960 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:49:48.949543 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d985247fd174f3db255fe58faf45075"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d985247fd174f3db255fe58faf45075"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7d985247fd174f3db255fe58faf45075"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7d985247fd174f3db255fe58faf45075", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:48.949543 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminTestJSON-1302320456 Jul 12 11:49:48.949543 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 7d985247fd174f3db255fe58faf45075 Jul 12 11:49:48.949543 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1302320456 Jul 12 11:49:48.949543 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminTestJSON-1302320456-project-admin Jul 12 11:49:48.949543 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:48.949543 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:48.949543 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 9c606b3b068d4e8ca50808aed339a065 Jul 12 11:49:48.949543 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminTestJSON-1302320456-project-admin Jul 12 11:49:48.949543 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:48.949543 n-d-849104-4 devstack@n-api.service[125983]: exception: Aggregate 7 could not be found. Jul 12 11:49:48.949543 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '7'} Jul 12 11:49:48.949543 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:48.950373 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 12 11:49:48.951434 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:48.953899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a3d5723a-1e6b-480e-9ea7-fc4bbab6fd60 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:48.953899 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a3d5723a-1e6b-480e-9ea7-fc4bbab6fd60 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.041063 Jul 12 11:49:48.953899 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 113/255] 10.222.0.50 () {58 vars in 1148 bytes} [Tue Jul 12 11:49:48 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:49:48.973379 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8f0aff1d-aefb-43ed-997a-ed603ceef698 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:48.973883 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-684c3981-5065-40da-b866-b2e1d2cba38f tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:48.975388 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:48.975388 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:48.975904 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:48.975904 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:48.989371 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8f0aff1d-aefb-43ed-997a-ed603ceef698 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.042797 Jul 12 11:49:48.992165 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 143/256] 10.222.0.50 () {60 vars in 1189 bytes} [Tue Jul 12 11:49:48 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:49:49.015479 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ef747425-53ff-4943-b753-d0a14737b8e5 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849104-4"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:49.016120 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-684c3981-5065-40da-b866-b2e1d2cba38f tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 12 11:49:49.017387 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:49.017387 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-684c3981-5065-40da-b866-b2e1d2cba38f tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Request method failure captured: Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-qEpRkvBdVCtmbGaYcUBSC-z_QWRaORWfnEjRVyZwp9QUOqJKeOIipyPUJuen5Y0Mswi7yNzL1Ei_SBQuDK91NGunQBYT32_WN9SD7-YnMShDpqhPjEP-kpCGZRrrgpCpzmEnE2zhhiA-WgpIO5KhNu2qNE8uYobTkI-4DpuZ2I04 Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 7d985247fd174f3db255fe58faf45075 Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminTestJSON-1302320456 Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:49:49.020846 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:49:49.022408 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d985247fd174f3db255fe58faf45075"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d985247fd174f3db255fe58faf45075"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7d985247fd174f3db255fe58faf45075"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7d985247fd174f3db255fe58faf45075", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:49.022408 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminTestJSON-1302320456 Jul 12 11:49:49.022408 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 7d985247fd174f3db255fe58faf45075 Jul 12 11:49:49.022408 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1302320456 Jul 12 11:49:49.022408 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminTestJSON-1302320456-project-admin Jul 12 11:49:49.022408 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:49.022408 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:49.022408 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 9c606b3b068d4e8ca50808aed339a065 Jul 12 11:49:49.022408 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminTestJSON-1302320456-project-admin Jul 12 11:49:49.022408 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:49.022408 n-d-849104-4 devstack@n-api.service[125983]: exception: Aggregate 7 could not be found. Jul 12 11:49:49.022408 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '7'} Jul 12 11:49:49.022408 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:49:49.023264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:49.024510 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:49.026052 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:49.026052 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:49.026052 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:49.026052 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 12 11:49:49.026052 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:49.026052 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-684c3981-5065-40da-b866-b2e1d2cba38f tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:49.026052 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-684c3981-5065-40da-b866-b2e1d2cba38f tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.064694 Jul 12 11:49:49.029871 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 114/257] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:48 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:49:49.043508 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ef747425-53ff-4943-b753-d0a14737b8e5 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:49.043931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5739df4f-6297-4165-b355-647876bf69fc tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1371679454"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:49.044423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ef747425-53ff-4943-b753-d0a14737b8e5 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:49.045959 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:49.045959 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:49.047309 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.aggregate [None req-5739df4f-6297-4165-b355-647876bf69fc tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Generated uuid 8ed23d0d-1ae2-4784-8dbf-ee6ff8f43690 for aggregate {{(pid=125983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:49.077218 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5739df4f-6297-4165-b355-647876bf69fc tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036799 Jul 12 11:49:49.077829 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 115/258] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:49:49.095675 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e658a246-03c2-4693-9528-74437547e055 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:49.096710 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:49.096710 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:49.110699 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e658a246-03c2-4693-9528-74437547e055 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.022766 Jul 12 11:49:49.116579 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 116/259] 10.222.0.50 () {58 vars in 1148 bytes} [Tue Jul 12 11:49:49 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:49.129854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-56bff704-d66b-495d-9d48-d486ee74ccc7 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:49.131870 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:49.131870 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:49.169970 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-56bff704-d66b-495d-9d48-d486ee74ccc7 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.045413 Jul 12 11:49:49.170879 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 117/260] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Jul 12 11:49:49 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:49.182890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7090c35a-f2d2-435c-8617-c5d682f8ad8b tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:49.183860 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:49.183860 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:49.193955 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7090c35a-f2d2-435c-8617-c5d682f8ad8b tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.015107 Jul 12 11:49:49.194848 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 118/261] 10.222.0.50 () {58 vars in 1148 bytes} [Tue Jul 12 11:49:49 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:49.209146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e1cb532f-066a-4a0e-aabd-e9d88a154191 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:49.210419 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:49.210419 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:49.262492 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e1cb532f-066a-4a0e-aabd-e9d88a154191 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.056977 Jul 12 11:49:49.263199 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 119/262] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:49 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:49.282140 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ec11d6cb-9055-417d-ba94-44c9bf73e4aa tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1019782221", "availability_zone": "tempest-test_az-353924331"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:49.289587 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ef747425-53ff-4943-b753-d0a14737b8e5 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.279619 Jul 12 11:49:49.295644 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 144/263] 10.222.0.50 () {62 vars in 1231 bytes} [Tue Jul 12 11:49:49 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:49:49.304299 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:49.304299 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:49.305260 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-43d49995-2f97-46cb-9a84-388fe3b01a47 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-849104-4"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:49.305393 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.aggregate [None req-ec11d6cb-9055-417d-ba94-44c9bf73e4aa tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Generated uuid 40df3d9d-683e-43b5-bca3-6b10c1722b4b for aggregate {{(pid=125983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:49.311604 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:49.311604 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:49.334251 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43d49995-2f97-46cb-9a84-388fe3b01a47 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:49.334978 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43d49995-2f97-46cb-9a84-388fe3b01a47 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:49.370714 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ec11d6cb-9055-417d-ba94-44c9bf73e4aa tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.095000 Jul 12 11:49:49.372751 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 120/264] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Jul 12 11:49:49 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:49.426844 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-61f0dda6-8f0f-4ffd-86b7-330598b845e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:49.427716 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-61f0dda6-8f0f-4ffd-86b7-330598b845e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:49.439803 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-61f0dda6-8f0f-4ffd-86b7-330598b845e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:49.440516 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-61f0dda6-8f0f-4ffd-86b7-330598b845e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:49.441647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-61f0dda6-8f0f-4ffd-86b7-330598b845e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:49.442804 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-61f0dda6-8f0f-4ffd-86b7-330598b845e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:49.575107 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-43d49995-2f97-46cb-9a84-388fe3b01a47 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.277857 Jul 12 11:49:49.577303 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 145/265] 10.222.0.50 () {62 vars in 1231 bytes} [Tue Jul 12 11:49:49 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:49:49.603084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8b78f33e-035b-404a-824f-a1ccb8b661e8 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1019782221_new", "availability_zone": "tempest-test_az-353924331_new"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:49.727901 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:49.727901 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:49.743413 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-61f0dda6-8f0f-4ffd-86b7-330598b845e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:49.755933 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-61f0dda6-8f0f-4ffd-86b7-330598b845e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1313 microversion: 2.1 time: 0.355545 Jul 12 11:49:49.760537 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 121/266] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:49 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:49.780339 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ab7d4bc0-a479-4328-963e-6d84a7972058 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:49.780339 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:49.780339 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:49.804713 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b78f33e-035b-404a-824f-a1ccb8b661e8 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:49.805276 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b78f33e-035b-404a-824f-a1ccb8b661e8 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:49.841080 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ab7d4bc0-a479-4328-963e-6d84a7972058 tempest-AggregatesAdminTestV241-1792719087 tempest-AggregatesAdminTestV241-1792719087-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.073143 Jul 12 11:49:49.847221 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 122/267] 10.222.0.50 () {60 vars in 1192 bytes} [Tue Jul 12 11:49:49 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:49.853327 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-166d12d2-e43c-4d9f-97f6-dcfc9542c388 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:49.854764 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-166d12d2-e43c-4d9f-97f6-dcfc9542c388 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:49.876889 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8b78f33e-035b-404a-824f-a1ccb8b661e8 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 334 microversion: 2.1 time: 0.286292 Jul 12 11:49:49.883435 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 146/268] 10.222.0.50 () {60 vars in 1169 bytes} [Tue Jul 12 11:49:49 2022] PUT /compute/v2.1/os-aggregates/9 => generated 334 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:49.883623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-166d12d2-e43c-4d9f-97f6-dcfc9542c388 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:49.883623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-166d12d2-e43c-4d9f-97f6-dcfc9542c388 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:49.883623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-166d12d2-e43c-4d9f-97f6-dcfc9542c388 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:49.883623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-166d12d2-e43c-4d9f-97f6-dcfc9542c388 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:49.890351 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-275d5204-55bb-49e5-8a8a-0d809c4f7e84 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:49.892533 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:49.892533 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:49.913296 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-275d5204-55bb-49e5-8a8a-0d809c4f7e84 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.025458 Jul 12 11:49:49.914392 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 147/269] 10.222.0.50 () {58 vars in 1142 bytes} [Tue Jul 12 11:49:49 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:49.930253 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-431a61fc-1d43-4f0a-9325-887ad290a5c4 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:49.934588 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:49.934588 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:49.940179 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:49.981059 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-431a61fc-1d43-4f0a-9325-887ad290a5c4 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.060116 Jul 12 11:49:49.982327 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 148/270] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:49 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:50.002361 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fdd28995-36a4-4e42-a997-b93cb6463f98 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1353949015"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:50.005526 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:50.005526 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:50.006757 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.aggregate [None req-fdd28995-36a4-4e42-a997-b93cb6463f98 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Generated uuid 88d6dc20-a81a-4823-928f-4fcdaa956578 for aggregate {{(pid=125984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:50.032510 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fdd28995-36a4-4e42-a997-b93cb6463f98 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.048711 Jul 12 11:49:50.033556 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 149/271] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:50.178420 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-166d12d2-e43c-4d9f-97f6-dcfc9542c388 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:50.202239 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-166d12d2-e43c-4d9f-97f6-dcfc9542c388 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 200 len: 1319 microversion: 2.1 time: 0.356492 Jul 12 11:49:50.203544 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 123/272] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:49 2022] GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:50.216449 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-05007a54-ca10-41a0-bcde-061c06f6cf71 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2096878920"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:50.229744 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:50.229744 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:50.233251 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.aggregate [None req-05007a54-ca10-41a0-bcde-061c06f6cf71 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Generated uuid a45ab3d9-7d69-4253-b214-1d401a223f18 for aggregate {{(pid=125983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:50.302091 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-05007a54-ca10-41a0-bcde-061c06f6cf71 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.092062 Jul 12 11:49:50.304202 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 124/273] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:50.311970 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-70a21002-3ff0-44f6-b3eb-4128603477c7 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-849104-4"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:50.315118 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:50.315118 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:50.337143 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-70a21002-3ff0-44f6-b3eb-4128603477c7 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:50.338916 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-70a21002-3ff0-44f6-b3eb-4128603477c7 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:50.356657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=81,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:50.479672 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7d408383-f48e-4d84-80ec-47f6bf8714b9 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Calling method '.version_select at 0x7f5e0ac0eb80>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:50.484445 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:50.484445 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:50.485970 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7d408383-f48e-4d84-80ec-47f6bf8714b9 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'eb650a497ed94b19aa9f8e35d2c627f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16bb700fd1b401c8047a3d4f2d30bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7d408383-f48e-4d84-80ec-47f6bf8714b9 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Request method failure captured: Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_cO19xQGimPqc_rZIdsMbIVF3LFp0Q9bI4BekiwXQQmb_VEkjDxlrabEX1ex7SZYz3ffegy6MVRT_pw7LcHWJ8ZzchfS306wpQQK9BI7RrV3z4OeHi5Jk2OrrfDMM17_M1trrDp1Y7TzdT2QblIIm3KB2BqMYTMxEr3ndH9u_pd90 Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: e16bb700fd1b401c8047a3d4f2d30bba Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:50.493954 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:50.495479 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e16bb700fd1b401c8047a3d4f2d30bba", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:50.495479 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:50.495479 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: e16bb700fd1b401c8047a3d4f2d30bba Jul 12 11:49:50.495479 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:50.495479 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HypervisorAdminNegativeTestJSON-962146590-project Jul 12 11:49:50.495479 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:50.495479 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:50.495479 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: eb650a497ed94b19aa9f8e35d2c627f4 Jul 12 11:49:50.495479 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-962146590-project Jul 12 11:49:50.495479 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:49:50.495479 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 12 11:49:50.495479 n-d-849104-4 devstack@n-api.service[125984]: action_args: {} Jul 12 11:49:50.495479 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:50.496510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 12 11:49:50.497734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.501106 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7d408383-f48e-4d84-80ec-47f6bf8714b9 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:50.505368 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7d408383-f48e-4d84-80ec-47f6bf8714b9 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.468381 Jul 12 11:49:50.506402 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 150/274] 10.222.0.50 () {58 vars in 1166 bytes} [Tue Jul 12 11:49:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 472 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:50.516496 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4bc4787b-56d0-4747-94f5-2e74fc497a11 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:50.521246 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:50.521246 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:50.547963 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4bc4787b-56d0-4747-94f5-2e74fc497a11 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 461 microversion: 2.1 time: 0.038669 Jul 12 11:49:50.549287 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 151/275] 10.222.0.50 () {58 vars in 1142 bytes} [Tue Jul 12 11:49:50 2022] GET /compute/v2.1/os-aggregates => generated 461 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:50.562382 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c1d92be6-8eda-4779-b5c3-940a5f5ef409 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Calling method '.version_select at 0x7f5e0af8c160>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:50.563159 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-70a21002-3ff0-44f6-b3eb-4128603477c7 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.257423 Jul 12 11:49:50.564003 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 125/276] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:49:50 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:50.566994 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:50.566994 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:50.568370 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c1d92be6-8eda-4779-b5c3-940a5f5ef409 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'eb650a497ed94b19aa9f8e35d2c627f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16bb700fd1b401c8047a3d4f2d30bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c1d92be6-8eda-4779-b5c3-940a5f5ef409 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Request method failure captured: Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_cO19xQGimPqc_rZIdsMbIVF3LFp0Q9bI4BekiwXQQmb_VEkjDxlrabEX1ex7SZYz3ffegy6MVRT_pw7LcHWJ8ZzchfS306wpQQK9BI7RrV3z4OeHi5Jk2OrrfDMM17_M1trrDp1Y7TzdT2QblIIm3KB2BqMYTMxEr3ndH9u_pd90 Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: e16bb700fd1b401c8047a3d4f2d30bba Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:50.573242 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:50.574491 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e16bb700fd1b401c8047a3d4f2d30bba", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:50.574491 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:50.574491 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: e16bb700fd1b401c8047a3d4f2d30bba Jul 12 11:49:50.574491 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:50.574491 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HypervisorAdminNegativeTestJSON-962146590-project Jul 12 11:49:50.574491 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:50.574491 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:50.574491 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: eb650a497ed94b19aa9f8e35d2c627f4 Jul 12 11:49:50.574491 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-962146590-project Jul 12 11:49:50.574491 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:49:50.574491 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 12 11:49:50.574491 n-d-849104-4 devstack@n-api.service[125984]: action_args: {} Jul 12 11:49:50.574491 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:50.575182 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 12 11:49:50.576401 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.578147 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-37cfaa11-a6d6-4dff-b595-05480ea42c10 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:50.578416 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c1d92be6-8eda-4779-b5c3-940a5f5ef409 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:50.579403 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:50.579403 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:50.579615 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c1d92be6-8eda-4779-b5c3-940a5f5ef409 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.027725 Jul 12 11:49:50.583956 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 152/277] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:50 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:50.587553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5e2fc7c6-e586-4849-95b4-cfff0c0a3dd2 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-849104-4"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:50.590661 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:50.590661 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:50.619154 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5e2fc7c6-e586-4849-95b4-cfff0c0a3dd2 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:50.619612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5e2fc7c6-e586-4849-95b4-cfff0c0a3dd2 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:50.620696 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-37cfaa11-a6d6-4dff-b595-05480ea42c10 tempest-AggregatesAdminTestJSON-1302320456 tempest-AggregatesAdminTestJSON-1302320456-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.055189 Jul 12 11:49:50.623489 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 126/278] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Jul 12 11:49:50 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:50.664584 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8e61d078-dc7d-4cf4-9733-22f5d75fa6cb tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Calling method '.version_select at 0x7f5e11b880d0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:50.667790 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:50.667790 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:50.673610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8e61d078-dc7d-4cf4-9733-22f5d75fa6cb tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'eb650a497ed94b19aa9f8e35d2c627f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16bb700fd1b401c8047a3d4f2d30bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8e61d078-dc7d-4cf4-9733-22f5d75fa6cb tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Request method failure captured: Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_cO19xQGimPqc_rZIdsMbIVF3LFp0Q9bI4BekiwXQQmb_VEkjDxlrabEX1ex7SZYz3ffegy6MVRT_pw7LcHWJ8ZzchfS306wpQQK9BI7RrV3z4OeHi5Jk2OrrfDMM17_M1trrDp1Y7TzdT2QblIIm3KB2BqMYTMxEr3ndH9u_pd90 Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: e16bb700fd1b401c8047a3d4f2d30bba Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:50.682683 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:50.683936 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e16bb700fd1b401c8047a3d4f2d30bba", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:50.683936 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:50.683936 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: e16bb700fd1b401c8047a3d4f2d30bba Jul 12 11:49:50.683936 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:50.683936 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-HypervisorAdminNegativeTestJSON-962146590-project Jul 12 11:49:50.683936 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:50.683936 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:50.683936 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: eb650a497ed94b19aa9f8e35d2c627f4 Jul 12 11:49:50.683936 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-962146590-project Jul 12 11:49:50.683936 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:49:50.683936 n-d-849104-4 devstack@n-api.service[125983]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 12 11:49:50.683936 n-d-849104-4 devstack@n-api.service[125983]: action_args: {} Jul 12 11:49:50.683936 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:50.684683 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 12 11:49:50.685760 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.688240 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8e61d078-dc7d-4cf4-9733-22f5d75fa6cb tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:50.690101 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8e61d078-dc7d-4cf4-9733-22f5d75fa6cb tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.057891 Jul 12 11:49:50.690941 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 127/279] 10.222.0.50 () {58 vars in 1178 bytes} [Tue Jul 12 11:49:50 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 67 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:50.713051 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6cb80898-221b-4da0-a89a-ddb148e54850 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:50.714720 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6cb80898-221b-4da0-a89a-ddb148e54850 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:50.718751 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-5e2fc7c6-e586-4849-95b4-cfff0c0a3dd2 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] HTTP exception thrown: Aggregate 10 already has host n-h1-849104-4. Jul 12 11:49:50.733179 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6cb80898-221b-4da0-a89a-ddb148e54850 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:50.733664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6cb80898-221b-4da0-a89a-ddb148e54850 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:50.736578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6cb80898-221b-4da0-a89a-ddb148e54850 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:50.739709 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6cb80898-221b-4da0-a89a-ddb148e54850 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:50.773940 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-6cb80898-221b-4da0-a89a-ddb148e54850 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] HTTP exception thrown: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6cb80898-221b-4da0-a89a-ddb148e54850 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Request method failure captured: Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 HTTP/1.1 Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-oVixSEQYoFEP6zaZdv3VOUqFjA_BVQjDG-I5VQ7IJX1iKEAmmopC_LSJ3VAP529ypj74oZsQYoUnKqZfd8PIP8P2bU8IpPlzYQcL4fpPMrNulcMCboX38UKljieUCmC7_AEnZVdc5QSm9uIAW1dzf6G5-UpJXySy3U3U7JC6BV0U Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 5c437ce2735840ce8bf6729ba3cceae3 Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminTestJSON-643502991 Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:50.775658 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:50.776868 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c437ce2735840ce8bf6729ba3cceae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c437ce2735840ce8bf6729ba3cceae3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5c437ce2735840ce8bf6729ba3cceae3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5c437ce2735840ce8bf6729ba3cceae3", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:50.776868 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminTestJSON-643502991 Jul 12 11:49:50.776868 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 5c437ce2735840ce8bf6729ba3cceae3 Jul 12 11:49:50.776868 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-643502991 Jul 12 11:49:50.776868 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminTestJSON-643502991-project Jul 12 11:49:50.776868 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:50.776868 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:50.776868 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 9960b163a93241a7961e242c60f704b6 Jul 12 11:49:50.776868 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminTestJSON-643502991-project Jul 12 11:49:50.776868 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:50.776868 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:50.776868 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'dd4298b8-89e6-4f58-a781-f850dab332a7'} Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:50.777548 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:50.778603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.779634 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6cb80898-221b-4da0-a89a-ddb148e54850 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Returning 404 to user: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:50.779634 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6cb80898-221b-4da0-a89a-ddb148e54850 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 404 len: 111 microversion: 2.1 time: 0.084334 Jul 12 11:49:50.780441 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 128/280] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:49:50 2022] DELETE /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5e2fc7c6-e586-4849-95b4-cfff0c0a3dd2 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Request method failure captured: Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 39 Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV-rqMgZ6jMdHhW5bdciXf9hP4I122-Y1_P3WHBuBUo9TEYqPO-bTlbdrBlUnGJqRV7pWR5tJ3rTRIZ6AH9d9fggEfpiBHreUpNtEOA58D_H8twlEBS1mFglysYaArQ1p3GoI0gKGLs9pZuQpaF0WN1llPkx5EjK2Uz9Ds7ZVoSP_qc Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:49:50.822979 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:49:50.824337 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0cc056fb0ff40acba73fdc461d60efb", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:50.824337 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:50.824337 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:50.824337 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:50.824337 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:50.824337 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:50.824337 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:50.824337 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: cd356328364c44f899595a060a9ff53c Jul 12 11:49:50.824337 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:50.824337 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:49:50.824337 n-d-849104-4 devstack@n-api.service[125984]: {"add_host": {"host": "n-h1-849104-4"}} Jul 12 11:49:50.824337 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:50.824337 n-d-849104-4 devstack@n-api.service[125984]: exception: Aggregate 10 already has host n-h1-849104-4. Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h1-849104-4'}}} Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result.read() Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 11:49:50.825049 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-849104-4-10' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi session.flush() Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 11:49:50.826041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 11:49:50.827204 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 11:49:50.828865 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result.read() Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-849104-4-10' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 12, 11, 49, 50, 697962), 'updated_at': None, 'host': 'n-h1-849104-4', 'aggregate_id': 10}] Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:50.831658 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 10 already has host n-h1-849104-4. Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.832935 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 10 already has host n-h1-849104-4. Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:50.834682 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:50.836893 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 10 already has host n-h1-849104-4. Jul 12 11:49:50.836893 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:50.836893 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5e2fc7c6-e586-4849-95b4-cfff0c0a3dd2 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Returning 409 to user: Aggregate 10 already has host n-h1-849104-4. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:50.836893 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5e2fc7c6-e586-4849-95b4-cfff0c0a3dd2 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/10/action" status: 409 len: 96 microversion: 2.1 time: 0.244511 Jul 12 11:49:50.836893 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 153/281] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:49:50 2022] POST /compute/v2.1/os-aggregates/10/action => generated 96 bytes in 247 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 12 11:49:50.856238 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1679b302-a2a4-4725-a8bf-63a698d8629b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:50.858801 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1679b302-a2a4-4725-a8bf-63a698d8629b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:50.883151 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1679b302-a2a4-4725-a8bf-63a698d8629b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:50.884669 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1679b302-a2a4-4725-a8bf-63a698d8629b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:50.887405 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1679b302-a2a4-4725-a8bf-63a698d8629b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:50.890661 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1679b302-a2a4-4725-a8bf-63a698d8629b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:51.285250 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-50fe089e-b412-4274-ae8c-c71838e58ba5 tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Calling method '.version_select at 0x7f5e0bbfde50>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:51.286182 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:51.286182 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:51.287356 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-50fe089e-b412-4274-ae8c-c71838e58ba5 tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:51.287804 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-50fe089e-b412-4274-ae8c-c71838e58ba5 tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:51.305132 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-50fe089e-b412-4274-ae8c-c71838e58ba5 tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:51.306568 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-50fe089e-b412-4274-ae8c-c71838e58ba5 tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:51.316900 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1679b302-a2a4-4725-a8bf-63a698d8629b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:51.321615 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-50fe089e-b412-4274-ae8c-c71838e58ba5 tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:51.322068 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-50fe089e-b412-4274-ae8c-c71838e58ba5 tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:51.330871 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1679b302-a2a4-4725-a8bf-63a698d8629b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1462 microversion: 2.1 time: 0.490351 Jul 12 11:49:51.344729 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 154/282] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:50 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1462 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:51.344964 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-50fe089e-b412-4274-ae8c-c71838e58ba5 tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.550769 Jul 12 11:49:51.344964 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 129/283] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:51.345146 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-22f9bc55-fdb2-4bdb-b439-61300ff4c659 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:51.345146 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-22f9bc55-fdb2-4bdb-b439-61300ff4c659 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] [instance: dd4298b8-89e6-4f58-a781-f850dab332a7] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:51.345295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-46e9b756-46af-486c-b8a3-c24d491b1791 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-849104-4"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:51.352905 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:51.352905 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:51.359100 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22f9bc55-fdb2-4bdb-b439-61300ff4c659 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:51.360279 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22f9bc55-fdb2-4bdb-b439-61300ff4c659 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:51.363258 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22f9bc55-fdb2-4bdb-b439-61300ff4c659 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:51.363781 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22f9bc55-fdb2-4bdb-b439-61300ff4c659 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:51.368213 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-46e9b756-46af-486c-b8a3-c24d491b1791 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:51.368963 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-46e9b756-46af-486c-b8a3-c24d491b1791 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:51.407482 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-22f9bc55-fdb2-4bdb-b439-61300ff4c659 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] HTTP exception thrown: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-22f9bc55-fdb2-4bdb-b439-61300ff4c659 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Request method failure captured: Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 HTTP/1.1 Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV-oVixSEQYoFEP6zaZdv3VOUqFjA_BVQjDG-I5VQ7IJX1iKEAmmopC_LSJ3VAP529ypj74oZsQYoUnKqZfd8PIP8P2bU8IpPlzYQcL4fpPMrNulcMCboX38UKljieUCmC7_AEnZVdc5QSm9uIAW1dzf6G5-UpJXySy3U3U7JC6BV0U Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 5c437ce2735840ce8bf6729ba3cceae3 Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-AggregatesAdminTestJSON-643502991 Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:51.412619 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:51.414808 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c437ce2735840ce8bf6729ba3cceae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5c437ce2735840ce8bf6729ba3cceae3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5c437ce2735840ce8bf6729ba3cceae3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5c437ce2735840ce8bf6729ba3cceae3", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:51.414808 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-AggregatesAdminTestJSON-643502991 Jul 12 11:49:51.414808 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 5c437ce2735840ce8bf6729ba3cceae3 Jul 12 11:49:51.414808 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-643502991 Jul 12 11:49:51.414808 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-AggregatesAdminTestJSON-643502991-project Jul 12 11:49:51.414808 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:51.414808 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:51.414808 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 9960b163a93241a7961e242c60f704b6 Jul 12 11:49:51.414808 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-AggregatesAdminTestJSON-643502991-project Jul 12 11:49:51.414808 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:51.414808 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:51.414808 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'dd4298b8-89e6-4f58-a781-f850dab332a7'} Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:51.415691 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. Jul 12 11:49:51.417449 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.419851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-22f9bc55-fdb2-4bdb-b439-61300ff4c659 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] Returning 404 to user: Instance dd4298b8-89e6-4f58-a781-f850dab332a7 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:51.429160 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-22f9bc55-fdb2-4bdb-b439-61300ff4c659 tempest-AggregatesAdminTestJSON-643502991 tempest-AggregatesAdminTestJSON-643502991-project] 10.222.0.50 "GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7" status: 404 len: 111 microversion: 2.1 time: 0.094684 Jul 12 11:49:51.429735 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 155/284] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:51 2022] GET /compute/v2.1/servers/dd4298b8-89e6-4f58-a781-f850dab332a7 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:51.449244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ad5b9b3b-39b6-4e88-8c8b-327fc3d4b5e0 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:51.449784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ad5b9b3b-39b6-4e88-8c8b-327fc3d4b5e0 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:51.483485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ad5b9b3b-39b6-4e88-8c8b-327fc3d4b5e0 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:51.484550 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ad5b9b3b-39b6-4e88-8c8b-327fc3d4b5e0 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:51.486401 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ad5b9b3b-39b6-4e88-8c8b-327fc3d4b5e0 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:51.486659 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ad5b9b3b-39b6-4e88-8c8b-327fc3d4b5e0 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:51.548892 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-46e9b756-46af-486c-b8a3-c24d491b1791 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.209655 Jul 12 11:49:51.555826 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 130/285] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:49:51 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:51.571458 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8cc397f9-6bc6-4146-a286-9a8732975fe1 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Calling method '.version_select at 0x7f5e0beabb80>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:51.571458 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:51.571458 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:51.574518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8cc397f9-6bc6-4146-a286-9a8732975fe1 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'eb650a497ed94b19aa9f8e35d2c627f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16bb700fd1b401c8047a3d4f2d30bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8cc397f9-6bc6-4146-a286-9a8732975fe1 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Request method failure captured: Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_cO19xQGimPqc_rZIdsMbIVF3LFp0Q9bI4BekiwXQQmb_VEkjDxlrabEX1ex7SZYz3ffegy6MVRT_pw7LcHWJ8ZzchfS306wpQQK9BI7RrV3z4OeHi5Jk2OrrfDMM17_M1trrDp1Y7TzdT2QblIIm3KB2BqMYTMxEr3ndH9u_pd90 Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: e16bb700fd1b401c8047a3d4f2d30bba Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:51.577740 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:51.579169 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e16bb700fd1b401c8047a3d4f2d30bba", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:51.579169 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:51.579169 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: e16bb700fd1b401c8047a3d4f2d30bba Jul 12 11:49:51.579169 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:51.579169 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-HypervisorAdminNegativeTestJSON-962146590-project Jul 12 11:49:51.579169 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:51.579169 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:51.579169 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: eb650a497ed94b19aa9f8e35d2c627f4 Jul 12 11:49:51.579169 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-962146590-project Jul 12 11:49:51.579169 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:49:51.579169 n-d-849104-4 devstack@n-api.service[125983]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 12 11:49:51.579169 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '1'} Jul 12 11:49:51.579169 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:51.579875 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 12 11:49:51.582037 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.585961 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8cc397f9-6bc6-4146-a286-9a8732975fe1 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:51.585961 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8cc397f9-6bc6-4146-a286-9a8732975fe1 tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.023613 Jul 12 11:49:51.585961 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 131/286] 10.222.0.50 () {58 vars in 1172 bytes} [Tue Jul 12 11:49:51 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:51.814495 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ad5b9b3b-39b6-4e88-8c8b-327fc3d4b5e0 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:51.827239 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ad5b9b3b-39b6-4e88-8c8b-327fc3d4b5e0 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 200 len: 1319 microversion: 2.1 time: 0.390064 Jul 12 11:49:51.833631 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 156/287] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:51 2022] GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:51.847703 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fb80fb94-1bed-4fcd-9e8b-4f7747c0777f tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:51.849265 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:51.849265 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:51.888722 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fb80fb94-1bed-4fcd-9e8b-4f7747c0777f tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.053556 Jul 12 11:49:51.890412 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 157/288] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Jul 12 11:49:51 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:51.900261 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5895fe10-7fe1-4417-be56-8287641df613 tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Calling method '.version_select at 0x7f5e0a884dc0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:51.901673 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:51.901673 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:51.902946 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-5895fe10-7fe1-4417-be56-8287641df613 tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] HTTP exception thrown: Hypervisor with ID '83be0231-ba1b-4c35-a362-e82ea8a4b59f' could not be found. Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5895fe10-7fe1-4417-be56-8287641df613 tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Request method failure captured: Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-hypervisors/83be0231-ba1b-4c35-a362-e82ea8a4b59f/uptime HTTP/1.1 Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_dxJj4AMfZpDszqxaQ5RIz5K0QW1NomNO03zyd3P-lt78i3ztj9Cft2LUWfVqkkIFV3ZzNag-t_mLssOl1eMS1Yt7a06YkPzbZrczMvEmvKle_QHx0IwI4YgYFZD1d39Tvcqw6taCvn07WY3Pkmpj5RkMN0IDIJZAlO_NVfQMifwY Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d570c7c4e3e74c2a8d537a3c69626859 Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1332917463 Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:49:51.918466 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:49:51.920021 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d570c7c4e3e74c2a8d537a3c69626859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d570c7c4e3e74c2a8d537a3c69626859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d570c7c4e3e74c2a8d537a3c69626859"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d570c7c4e3e74c2a8d537a3c69626859", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:51.920021 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1332917463 Jul 12 11:49:51.920021 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d570c7c4e3e74c2a8d537a3c69626859 Jul 12 11:49:51.920021 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1332917463 Jul 12 11:49:51.920021 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin Jul 12 11:49:51.920021 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:51.920021 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:51.920021 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: e314055366c04893ac81f69b72233942 Jul 12 11:49:51.920021 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin Jul 12 11:49:51.920021 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:49:51.920021 n-d-849104-4 devstack@n-api.service[125984]: exception: Hypervisor with ID '83be0231-ba1b-4c35-a362-e82ea8a4b59f' could not be found. Jul 12 11:49:51.920021 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '83be0231-ba1b-4c35-a362-e82ea8a4b59f'} Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '83be0231-ba1b-4c35-a362-e82ea8a4b59f' Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 12 11:49:51.920849 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '83be0231-ba1b-4c35-a362-e82ea8a4b59f' could not be found. Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:51.922429 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.923882 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:51.923882 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:51.923882 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:51.923882 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:51.923882 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:51.923882 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '83be0231-ba1b-4c35-a362-e82ea8a4b59f' could not be found. Jul 12 11:49:51.923882 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:51.923882 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5895fe10-7fe1-4417-be56-8287641df613 tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Returning 404 to user: Hypervisor with ID '83be0231-ba1b-4c35-a362-e82ea8a4b59f' could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:51.923882 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5895fe10-7fe1-4417-be56-8287641df613 tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/83be0231-ba1b-4c35-a362-e82ea8a4b59f/uptime" status: 404 len: 123 microversion: 2.1 time: 0.029466 Jul 12 11:49:51.923882 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 158/289] 10.222.0.50 () {58 vars in 1277 bytes} [Tue Jul 12 11:49:51 2022] GET /compute/v2.1/os-hypervisors/83be0231-ba1b-4c35-a362-e82ea8a4b59f/uptime => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:51.934126 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-7440f1aa-5018-4c20-b3d9-b2a3418c8a76 req-a7aa32db-51e2-4b62-801e-592a8115872f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c3c3708-14f5-486e-8025-a4b91aefee65", "name": "network-vif-plugged", "status": "completed", "tag": "dd35879a-b9d2-470e-99a5-526d2b5a0e51"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:51.946221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-7440f1aa-5018-4c20-b3d9-b2a3418c8a76 req-a7aa32db-51e2-4b62-801e-592a8115872f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:51.949974 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-7440f1aa-5018-4c20-b3d9-b2a3418c8a76 req-a7aa32db-51e2-4b62-801e-592a8115872f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:51.976017 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-7440f1aa-5018-4c20-b3d9-b2a3418c8a76 req-a7aa32db-51e2-4b62-801e-592a8115872f service nova] Creating event network-vif-plugged:dd35879a-b9d2-470e-99a5-526d2b5a0e51 for instance 0c3c3708-14f5-486e-8025-a4b91aefee65 on n-h2-849104-4 Jul 12 11:49:51.988727 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-7440f1aa-5018-4c20-b3d9-b2a3418c8a76 req-a7aa32db-51e2-4b62-801e-592a8115872f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063879 Jul 12 11:49:51.990061 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 159/290] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:52.007466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-15389fcf-80f4-4eba-8b6b-eed49949d821 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-686994215"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:52.010772 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:52.010772 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:52.011948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.aggregate [None req-15389fcf-80f4-4eba-8b6b-eed49949d821 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Generated uuid e3a73bde-f591-446a-b770-fd2bb806ab94 for aggregate {{(pid=125984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:52.059966 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-15389fcf-80f4-4eba-8b6b-eed49949d821 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068286 Jul 12 11:49:52.061027 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 160/291] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:52.075959 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1dcb41fb-f7d5-42db-977b-a57afd2ace8a tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Calling method '.version_select at 0x7f5e0a884d30>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:52.079534 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:52.079534 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:52.081010 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1dcb41fb-f7d5-42db-977b-a57afd2ace8a tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:52.081703 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1dcb41fb-f7d5-42db-977b-a57afd2ace8a tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:52.097871 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1dcb41fb-f7d5-42db-977b-a57afd2ace8a tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:52.099577 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1dcb41fb-f7d5-42db-977b-a57afd2ace8a tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:52.107647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:52.119670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1dcb41fb-f7d5-42db-977b-a57afd2ace8a tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:52.120634 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1dcb41fb-f7d5-42db-977b-a57afd2ace8a tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:52.131741 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1dcb41fb-f7d5-42db-977b-a57afd2ace8a tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.066199 Jul 12 11:49:52.133044 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 161/292] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:49:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:52.282186 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bdf54c44-8c74-4a19-a588-805a6c651e47 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:52.283444 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-bdf54c44-8c74-4a19-a588-805a6c651e47 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:52.311288 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bdf54c44-8c74-4a19-a588-805a6c651e47 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:52.311970 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bdf54c44-8c74-4a19-a588-805a6c651e47 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:52.319126 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bdf54c44-8c74-4a19-a588-805a6c651e47 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:52.321454 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bdf54c44-8c74-4a19-a588-805a6c651e47 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:52.692105 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2885c2fc-41a8-4e1e-bb99-b6b67149857b tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-849104-4"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:52.695465 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:52.695465 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:52.697112 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2885c2fc-41a8-4e1e-bb99-b6b67149857b tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '159cb9ae8a5d4a3d9a371710a5bbc61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c211fa2293a34a8d93062f88a8fc72b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2885c2fc-41a8-4e1e-bb99-b6b67149857b tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Request method failure captured: Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 39 Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV-pshMqPRCSEGrOouEin3EGDM7gGErqDESu_HuQvlK8EzxqUys6kAwvstxz96-iYlkrrRP1BmAiMzKajjr4rvUR7JRseaxENScLmBpqHVY6-HxsuSSuaZOAx-m5WGPRRwT6CHtY9gQrNXj7bVYhHbhwV0ZNLRTFG0w_Jk7xtoZFKUg Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: c211fa2293a34a8d93062f88a8fc72b8 Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:52.699192 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:52.700696 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c211fa2293a34a8d93062f88a8fc72b8", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:52.700696 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:52.700696 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: c211fa2293a34a8d93062f88a8fc72b8 Jul 12 11:49:52.700696 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:52.700696 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-AggregatesAdminNegativeTestJSON-1634309727-project Jul 12 11:49:52.700696 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:52.700696 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:52.700696 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 159cb9ae8a5d4a3d9a371710a5bbc61a Jul 12 11:49:52.700696 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727-project Jul 12 11:49:52.700696 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:49:52.700696 n-d-849104-4 devstack@n-api.service[125984]: {"add_host": {"host": "n-h1-849104-4"}} Jul 12 11:49:52.700696 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:52.700696 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-849104-4'}}} Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:52.701605 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 12 11:49:52.702857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.705310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2885c2fc-41a8-4e1e-bb99-b6b67149857b tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:52.706903 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2885c2fc-41a8-4e1e-bb99-b6b67149857b tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.572714 Jul 12 11:49:52.708107 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 162/293] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:49:52 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 574 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:52.713681 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e993a5ab-55ff-4252-8420-95672e9b40af tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Calling method '.version_select at 0x7f5e0a8b40d0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:52.714684 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:52.714684 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:52.715987 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e993a5ab-55ff-4252-8420-95672e9b40af tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'eb650a497ed94b19aa9f8e35d2c627f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16bb700fd1b401c8047a3d4f2d30bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e993a5ab-55ff-4252-8420-95672e9b40af tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Request method failure captured: Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_cO19xQGimPqc_rZIdsMbIVF3LFp0Q9bI4BekiwXQQmb_VEkjDxlrabEX1ex7SZYz3ffegy6MVRT_pw7LcHWJ8ZzchfS306wpQQK9BI7RrV3z4OeHi5Jk2OrrfDMM17_M1trrDp1Y7TzdT2QblIIm3KB2BqMYTMxEr3ndH9u_pd90 Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: e16bb700fd1b401c8047a3d4f2d30bba Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:52.717772 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:52.719180 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e16bb700fd1b401c8047a3d4f2d30bba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e16bb700fd1b401c8047a3d4f2d30bba", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:52.719180 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:52.719180 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: e16bb700fd1b401c8047a3d4f2d30bba Jul 12 11:49:52.719180 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-962146590 Jul 12 11:49:52.719180 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HypervisorAdminNegativeTestJSON-962146590-project Jul 12 11:49:52.719180 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:52.719180 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:52.719180 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: eb650a497ed94b19aa9f8e35d2c627f4 Jul 12 11:49:52.719180 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-962146590-project Jul 12 11:49:52.719180 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:49:52.719180 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 12 11:49:52.719180 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '1'} Jul 12 11:49:52.719180 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:52.720127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 12 11:49:52.721386 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.723482 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e993a5ab-55ff-4252-8420-95672e9b40af tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:52.725718 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e993a5ab-55ff-4252-8420-95672e9b40af tempest-HypervisorAdminNegativeTestJSON-962146590 tempest-HypervisorAdminNegativeTestJSON-962146590-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015831 Jul 12 11:49:52.733352 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 163/294] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:52 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:52.744613 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fbd92d32-7af8-431f-ac08-08d38073ec97 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:52.746339 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:52.746339 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:52.777882 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fbd92d32-7af8-431f-ac08-08d38073ec97 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.041199 Jul 12 11:49:52.778506 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 164/295] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Jul 12 11:49:52 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:52.791077 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8da55c50-cb1b-4013-aaad-9de0a442580d tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Calling method '.version_select at 0x7f5e0a884dc0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:52.792347 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:52.792347 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:52.793582 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-8da55c50-cb1b-4013-aaad-9de0a442580d tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] HTTP exception thrown: Hypervisor with ID '5d1ecfd5-5c28-4173-b207-2f70560764f7' could not be found. Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8da55c50-cb1b-4013-aaad-9de0a442580d tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Request method failure captured: Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-hypervisors/5d1ecfd5-5c28-4173-b207-2f70560764f7 HTTP/1.1 Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_dxJj4AMfZpDszqxaQ5RIz5K0QW1NomNO03zyd3P-lt78i3ztj9Cft2LUWfVqkkIFV3ZzNag-t_mLssOl1eMS1Yt7a06YkPzbZrczMvEmvKle_QHx0IwI4YgYFZD1d39Tvcqw6taCvn07WY3Pkmpj5RkMN0IDIJZAlO_NVfQMifwY Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d570c7c4e3e74c2a8d537a3c69626859 Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1332917463 Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:49:52.797090 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:49:52.798517 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d570c7c4e3e74c2a8d537a3c69626859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d570c7c4e3e74c2a8d537a3c69626859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d570c7c4e3e74c2a8d537a3c69626859"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d570c7c4e3e74c2a8d537a3c69626859", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:52.798517 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1332917463 Jul 12 11:49:52.798517 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d570c7c4e3e74c2a8d537a3c69626859 Jul 12 11:49:52.798517 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1332917463 Jul 12 11:49:52.798517 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin Jul 12 11:49:52.798517 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:52.798517 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:52.798517 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: e314055366c04893ac81f69b72233942 Jul 12 11:49:52.798517 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin Jul 12 11:49:52.798517 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:49:52.798517 n-d-849104-4 devstack@n-api.service[125984]: exception: Hypervisor with ID '5d1ecfd5-5c28-4173-b207-2f70560764f7' could not be found. Jul 12 11:49:52.798517 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '5d1ecfd5-5c28-4173-b207-2f70560764f7'} Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '5d1ecfd5-5c28-4173-b207-2f70560764f7' Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 12 11:49:52.799308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 12 11:49:52.801614 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '5d1ecfd5-5c28-4173-b207-2f70560764f7' could not be found. Jul 12 11:49:52.802934 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.802934 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:52.802934 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.802934 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:52.802934 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:52.802934 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:52.802934 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:52.802934 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:52.802934 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '5d1ecfd5-5c28-4173-b207-2f70560764f7' could not be found. Jul 12 11:49:52.802934 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:52.804987 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8da55c50-cb1b-4013-aaad-9de0a442580d tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] Returning 404 to user: Hypervisor with ID '5d1ecfd5-5c28-4173-b207-2f70560764f7' could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:52.806014 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8da55c50-cb1b-4013-aaad-9de0a442580d tempest-HypervisorAdminNegativeTestJSON-1332917463 tempest-HypervisorAdminNegativeTestJSON-1332917463-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/5d1ecfd5-5c28-4173-b207-2f70560764f7" status: 404 len: 123 microversion: 2.1 time: 0.024941 Jul 12 11:49:52.806714 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 165/296] 10.222.0.50 () {58 vars in 1256 bytes} [Tue Jul 12 11:49:52 2022] GET /compute/v2.1/os-hypervisors/5d1ecfd5-5c28-4173-b207-2f70560764f7 => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:52.812221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f40c4116-16f9-4aa2-b1e2-dd794ff5b707 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-297977861"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:52.814263 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:52.814263 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:52.816485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.aggregate [None req-f40c4116-16f9-4aa2-b1e2-dd794ff5b707 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Generated uuid 6f288a93-65f3-47b1-b6b4-19d6563f8530 for aggregate {{(pid=125984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:52.876232 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f40c4116-16f9-4aa2-b1e2-dd794ff5b707 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067595 Jul 12 11:49:52.877194 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 166/297] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:52.889983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e7dd9f23-4842-408c-8fe7-e231aece2ddd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:52.891454 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e7dd9f23-4842-408c-8fe7-e231aece2ddd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:52.913950 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e7dd9f23-4842-408c-8fe7-e231aece2ddd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:52.916620 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e7dd9f23-4842-408c-8fe7-e231aece2ddd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:52.917711 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e7dd9f23-4842-408c-8fe7-e231aece2ddd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:52.921698 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e7dd9f23-4842-408c-8fe7-e231aece2ddd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:53.022914 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=4 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:53.397262 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bdf54c44-8c74-4a19-a588-805a6c651e47 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1613 microversion: 2.1 time: 1.812318 Jul 12 11:49:53.398723 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 132/298] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:51 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1613 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:53.409556 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e7dd9f23-4842-408c-8fe7-e231aece2ddd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:53.412550 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e7dd9f23-4842-408c-8fe7-e231aece2ddd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 200 len: 1319 microversion: 2.1 time: 0.533206 Jul 12 11:49:53.413908 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 167/299] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:52 2022] GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 1319 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:53.417245 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9ddc5f03-6326-4af6-87e7-fb3d1c381939 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-519050701"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:53.418604 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:53.418604 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:53.424676 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-74523fbe-3edf-408c-b136-1ed5cfc4b6c8 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:53.426736 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-74523fbe-3edf-408c-b136-1ed5cfc4b6c8 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:53.441106 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74523fbe-3edf-408c-b136-1ed5cfc4b6c8 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:53.464238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ddc5f03-6326-4af6-87e7-fb3d1c381939 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:53.464476 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74523fbe-3edf-408c-b136-1ed5cfc4b6c8 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:53.466594 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74523fbe-3edf-408c-b136-1ed5cfc4b6c8 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:53.467056 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74523fbe-3edf-408c-b136-1ed5cfc4b6c8 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:53.467295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ddc5f03-6326-4af6-87e7-fb3d1c381939 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:53.481412 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ddc5f03-6326-4af6-87e7-fb3d1c381939 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:53.485460 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ddc5f03-6326-4af6-87e7-fb3d1c381939 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:53.507043 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-9ddc5f03-6326-4af6-87e7-fb3d1c381939 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-519050701 could not be found. Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9ddc5f03-6326-4af6-87e7-fb3d1c381939 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Request method failure captured: Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 57 Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-rqMgZ6jMdHhW5bdciXf9hP4I122-Y1_P3WHBuBUo9TEYqPO-bTlbdrBlUnGJqRV7pWR5tJ3rTRIZ6AH9d9fggEfpiBHreUpNtEOA58D_H8twlEBS1mFglysYaArQ1p3GoI0gKGLs9pZuQpaF0WN1llPkx5EjK2Uz9Ds7ZVoSP_qc Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:49:53.511075 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:49:53.512325 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0cc056fb0ff40acba73fdc461d60efb", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:53.512325 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:53.512325 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:53.512325 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:53.512325 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:53.512325 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:53.512325 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:53.512325 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: cd356328364c44f899595a060a9ff53c Jul 12 11:49:53.512325 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:53.512325 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:49:53.512325 n-d-849104-4 devstack@n-api.service[125983]: {"add_host": {"host": "tempest-nonexist_host-519050701"}} Jul 12 11:49:53.512325 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:53.512325 n-d-849104-4 devstack@n-api.service[125983]: exception: Compute host tempest-nonexist_host-519050701 could not be found. Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-519050701'}}} Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-519050701' is not mapped to any cell Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.513038 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 12 11:49:53.514066 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-519050701 could not be found. Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-519050701 could not be found. Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:53.515150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.516619 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.516619 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:53.516619 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:53.516619 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:53.516619 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:53.516619 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-519050701 could not be found. Jul 12 11:49:53.516619 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.516619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9ddc5f03-6326-4af6-87e7-fb3d1c381939 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-519050701 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:53.516619 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9ddc5f03-6326-4af6-87e7-fb3d1c381939 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.104737 Jul 12 11:49:53.517222 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 133/300] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:49:53 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:53.533300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-47fe76d1-f2e6-4f9c-8585-6774bc13ddb7 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:53.534423 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:53.534423 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:53.577539 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-47fe76d1-f2e6-4f9c-8585-6774bc13ddb7 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.055046 Jul 12 11:49:53.578550 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 134/301] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Jul 12 11:49:53 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:53.603239 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d7940827-1908-457d-a0f1-cab201c2870e tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d7940827-1908-457d-a0f1-cab201c2870e tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Request method failure captured: Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 283 Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-rqMgZ6jMdHhW5bdciXf9hP4I122-Y1_P3WHBuBUo9TEYqPO-bTlbdrBlUnGJqRV7pWR5tJ3rTRIZ6AH9d9fggEfpiBHreUpNtEOA58D_H8twlEBS1mFglysYaArQ1p3GoI0gKGLs9pZuQpaF0WN1llPkx5EjK2Uz9Ds7ZVoSP_qc Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:49:53.610358 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:49:53.611637 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0cc056fb0ff40acba73fdc461d60efb", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:53.611637 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:53.611637 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:53.611637 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:53.611637 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:53.611637 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:53.611637 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:53.611637 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: cd356328364c44f899595a060a9ff53c Jul 12 11:49:53.611637 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:53.611637 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:49:53.611637 n-d-849104-4 devstack@n-api.service[125983]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 12 11:49:53.612315 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:53.612315 n-d-849104-4 devstack@n-api.service[125983]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 12 11:49:53.612315 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 12 11:49:53.612315 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:53.612315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.612315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 11:49:53.612315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 11:49:53.612315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 11:49:53.612315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise error Jul 12 11:49:53.612315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 12 11:49:53.612315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 11:49:53.612947 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 11:49:53.613951 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 11:49:53.613951 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 11:49:53.613951 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 11:49:53.613951 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 11:49:53.613951 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 12 11:49:53.613951 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.613951 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:53.613951 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.613951 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.613951 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:53.613951 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:53.613951 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 11:49:53.613951 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 11:49:53.614645 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 12 11:49:53.614645 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.619315 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d7940827-1908-457d-a0f1-cab201c2870e tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:53.637896 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d7940827-1908-457d-a0f1-cab201c2870e tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.034342 Jul 12 11:49:53.641137 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 135/302] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Jul 12 11:49:53 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:49:53.654574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9ec7200a-297a-4db1-a2d8-20f049aaabce tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9ec7200a-297a-4db1-a2d8-20f049aaabce tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Request method failure captured: Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 27 Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-rqMgZ6jMdHhW5bdciXf9hP4I122-Y1_P3WHBuBUo9TEYqPO-bTlbdrBlUnGJqRV7pWR5tJ3rTRIZ6AH9d9fggEfpiBHreUpNtEOA58D_H8twlEBS1mFglysYaArQ1p3GoI0gKGLs9pZuQpaF0WN1llPkx5EjK2Uz9Ds7ZVoSP_qc Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:49:53.658421 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:49:53.659881 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0cc056fb0ff40acba73fdc461d60efb", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:53.659881 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:53.659881 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:53.659881 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:53.659881 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:53.659881 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:53.659881 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:53.659881 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: cd356328364c44f899595a060a9ff53c Jul 12 11:49:53.659881 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:53.659881 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:49:53.659881 n-d-849104-4 devstack@n-api.service[125983]: {"aggregate": {"name": ""}} Jul 12 11:49:53.659881 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:53.659881 n-d-849104-4 devstack@n-api.service[125983]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise error Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi '' Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:53.660662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 12 11:49:53.661922 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.665641 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9ec7200a-297a-4db1-a2d8-20f049aaabce tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:53.668926 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9ec7200a-297a-4db1-a2d8-20f049aaabce tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.022485 Jul 12 11:49:53.670290 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 136/303] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:53 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 11:49:53.684902 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6d274587-41d7-4f2c-a1e0-3794618a96b6 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1511096571"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:53.687730 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:53.687730 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:53.689493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6d274587-41d7-4f2c-a1e0-3794618a96b6 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '159cb9ae8a5d4a3d9a371710a5bbc61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c211fa2293a34a8d93062f88a8fc72b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6d274587-41d7-4f2c-a1e0-3794618a96b6 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Request method failure captured: Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 60 Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-pshMqPRCSEGrOouEin3EGDM7gGErqDESu_HuQvlK8EzxqUys6kAwvstxz96-iYlkrrRP1BmAiMzKajjr4rvUR7JRseaxENScLmBpqHVY6-HxsuSSuaZOAx-m5WGPRRwT6CHtY9gQrNXj7bVYhHbhwV0ZNLRTFG0w_Jk7xtoZFKUg Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: c211fa2293a34a8d93062f88a8fc72b8 Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:53.692733 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:53.693987 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c211fa2293a34a8d93062f88a8fc72b8", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:53.693987 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:53.693987 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: c211fa2293a34a8d93062f88a8fc72b8 Jul 12 11:49:53.693987 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:53.693987 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminNegativeTestJSON-1634309727-project Jul 12 11:49:53.693987 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:53.693987 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:53.693987 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 159cb9ae8a5d4a3d9a371710a5bbc61a Jul 12 11:49:53.693987 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727-project Jul 12 11:49:53.693987 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:49:53.693987 n-d-849104-4 devstack@n-api.service[125983]: {"aggregate": {"name": "tempest-test_aggregate-1511096571"}} Jul 12 11:49:53.693987 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:53.693987 n-d-849104-4 devstack@n-api.service[125983]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1511096571'}}} Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:53.694709 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:53.695792 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 12 11:49:53.699711 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.699711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6d274587-41d7-4f2c-a1e0-3794618a96b6 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:53.701098 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6d274587-41d7-4f2c-a1e0-3794618a96b6 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.021738 Jul 12 11:49:53.702543 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 137/304] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:53 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:53.721431 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b60c9418-f85f-4fd4-87b4-f7ea72f7dc9e tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-940549959"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:53.726356 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.aggregate [None req-b60c9418-f85f-4fd4-87b4-f7ea72f7dc9e tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Generated uuid ddf3e505-ed68-4876-bb52-4e9368ecebe1 for aggregate {{(pid=125983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:53.764497 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b60c9418-f85f-4fd4-87b4-f7ea72f7dc9e tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.054379 Jul 12 11:49:53.766263 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 138/305] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:53.783574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3ac95186-f97d-4e31-b2cc-fe6bf8e140c2 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-940549959"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:53.785614 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:53.785614 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:53.787529 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.aggregate [None req-3ac95186-f97d-4e31-b2cc-fe6bf8e140c2 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Generated uuid 63123926-f4bb-4cb4-9bc1-6106926c2595 for aggregate {{(pid=125983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:53.807550 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-3ac95186-f97d-4e31-b2cc-fe6bf8e140c2 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-940549959 already exists. Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3ac95186-f97d-4e31-b2cc-fe6bf8e140c2 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Request method failure captured: Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 59 Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-rqMgZ6jMdHhW5bdciXf9hP4I122-Y1_P3WHBuBUo9TEYqPO-bTlbdrBlUnGJqRV7pWR5tJ3rTRIZ6AH9d9fggEfpiBHreUpNtEOA58D_H8twlEBS1mFglysYaArQ1p3GoI0gKGLs9pZuQpaF0WN1llPkx5EjK2Uz9Ds7ZVoSP_qc Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:49:53.813335 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:49:53.816801 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0cc056fb0ff40acba73fdc461d60efb", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:53.816801 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:53.816801 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:53.816801 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:53.816801 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:53.816801 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:53.816801 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:53.816801 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: cd356328364c44f899595a060a9ff53c Jul 12 11:49:53.816801 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:53.816801 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:49:53.816801 n-d-849104-4 devstack@n-api.service[125983]: {"aggregate": {"name": "tempest-test_aggregate-940549959"}} Jul 12 11:49:53.816801 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:53.816801 n-d-849104-4 devstack@n-api.service[125983]: exception: Aggregate tempest-test_aggregate-940549959 already exists. Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-940549959'}}} Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 12 11:49:53.820004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-940549959 already exists. Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:53.822637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 12 11:49:53.825166 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 12 11:49:53.825166 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-940549959 already exists. Jul 12 11:49:53.825166 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.825166 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:53.825166 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.825166 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.825166 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:53.825166 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:53.825166 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:53.825166 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:53.825166 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-940549959 already exists. Jul 12 11:49:53.825166 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.828096 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3ac95186-f97d-4e31-b2cc-fe6bf8e140c2 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-940549959 already exists. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:53.830008 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3ac95186-f97d-4e31-b2cc-fe6bf8e140c2 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.055963 Jul 12 11:49:53.831314 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 139/306] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:53 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:49:53.844408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-94e48f19-94de-4467-b16e-2ec35f5fcc1d tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:53.846167 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:53.846167 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:53.888685 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-94e48f19-94de-4467-b16e-2ec35f5fcc1d tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.051810 Jul 12 11:49:53.890154 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 140/307] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Jul 12 11:49:53 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:53.906024 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-175b2af7-7a04-4399-b7e2-57a54ffbbf49 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1093987000"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:53.909357 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:53.909357 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:53.910999 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.aggregate [None req-175b2af7-7a04-4399-b7e2-57a54ffbbf49 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Generated uuid b626de0d-1805-4f82-9ef7-4b44e7c1e1e6 for aggregate {{(pid=125983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:53.951313 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-175b2af7-7a04-4399-b7e2-57a54ffbbf49 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.054475 Jul 12 11:49:53.953129 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 141/308] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:53.980290 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2ea0f504-f6e1-4b1c-97cf-91c37d2cfd9b tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:53.982975 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:53.982975 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:53.985484 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2ea0f504-f6e1-4b1c-97cf-91c37d2cfd9b tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '159cb9ae8a5d4a3d9a371710a5bbc61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c211fa2293a34a8d93062f88a8fc72b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2ea0f504-f6e1-4b1c-97cf-91c37d2cfd9b tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Request method failure captured: Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-pshMqPRCSEGrOouEin3EGDM7gGErqDESu_HuQvlK8EzxqUys6kAwvstxz96-iYlkrrRP1BmAiMzKajjr4rvUR7JRseaxENScLmBpqHVY6-HxsuSSuaZOAx-m5WGPRRwT6CHtY9gQrNXj7bVYhHbhwV0ZNLRTFG0w_Jk7xtoZFKUg Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: c211fa2293a34a8d93062f88a8fc72b8 Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:53.990726 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:53.991921 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c211fa2293a34a8d93062f88a8fc72b8", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:53.991921 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:53.991921 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: c211fa2293a34a8d93062f88a8fc72b8 Jul 12 11:49:53.991921 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:53.991921 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminNegativeTestJSON-1634309727-project Jul 12 11:49:53.991921 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:53.991921 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:53.991921 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 159cb9ae8a5d4a3d9a371710a5bbc61a Jul 12 11:49:53.991921 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727-project Jul 12 11:49:53.991921 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:53.991921 n-d-849104-4 devstack@n-api.service[125983]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 12 11:49:53.991921 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '15'} Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:53.993388 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 12 11:49:53.994429 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:53.997214 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2ea0f504-f6e1-4b1c-97cf-91c37d2cfd9b tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:53.998457 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2ea0f504-f6e1-4b1c-97cf-91c37d2cfd9b tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.038484 Jul 12 11:49:54.002771 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 142/309] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Jul 12 11:49:53 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 12 11:49:54.009567 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a5bb676c-926d-4bee-95fe-909375bb7f4c tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:54.046482 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a5bb676c-926d-4bee-95fe-909375bb7f4c tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.041857 Jul 12 11:49:54.053790 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 143/310] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Jul 12 11:49:54 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:54.061075 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c564f07f-e658-4d79-98db-ab84626f1a8e tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:54.063040 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:54.063040 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:54.080383 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-c564f07f-e658-4d79-98db-ab84626f1a8e tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c564f07f-e658-4d79-98db-ab84626f1a8e tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Request method failure captured: Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-rqMgZ6jMdHhW5bdciXf9hP4I122-Y1_P3WHBuBUo9TEYqPO-bTlbdrBlUnGJqRV7pWR5tJ3rTRIZ6AH9d9fggEfpiBHreUpNtEOA58D_H8twlEBS1mFglysYaArQ1p3GoI0gKGLs9pZuQpaF0WN1llPkx5EjK2Uz9Ds7ZVoSP_qc Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:49:54.084350 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:49:54.085549 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0cc056fb0ff40acba73fdc461d60efb", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:54.085549 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:54.085549 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:54.085549 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:54.085549 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:54.085549 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:54.085549 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:54.085549 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: cd356328364c44f899595a060a9ff53c Jul 12 11:49:54.085549 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:54.085549 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:54.085549 n-d-849104-4 devstack@n-api.service[125983]: exception: Aggregate -1 could not be found. Jul 12 11:49:54.085549 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '-1'} Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 12 11:49:54.086294 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.087336 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:54.089282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:54.089282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:54.089282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:54.089282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:54.089282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 12 11:49:54.089282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.090470 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c564f07f-e658-4d79-98db-ab84626f1a8e tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:54.094419 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c564f07f-e658-4d79-98db-ab84626f1a8e tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.037939 Jul 12 11:49:54.095001 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 144/311] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Jul 12 11:49:54 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:49:54.115797 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-100aabe8-6aa4-4253-a9a3-ee4868cae70c tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1509350898"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:54.123446 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:54.123446 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:54.129534 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.aggregate [None req-100aabe8-6aa4-4253-a9a3-ee4868cae70c tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Generated uuid bd6a67e5-2d0c-46b4-af92-8f9c52f7de7a for aggregate {{(pid=125983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:54.181506 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-100aabe8-6aa4-4253-a9a3-ee4868cae70c tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.080024 Jul 12 11:49:54.182292 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 145/312] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:54.195363 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7f0f7df1-a37f-4119-8720-7471a9f45bde tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:54.196149 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:54.196149 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:54.197016 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7f0f7df1-a37f-4119-8720-7471a9f45bde tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '159cb9ae8a5d4a3d9a371710a5bbc61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c211fa2293a34a8d93062f88a8fc72b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7f0f7df1-a37f-4119-8720-7471a9f45bde tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Request method failure captured: Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-pshMqPRCSEGrOouEin3EGDM7gGErqDESu_HuQvlK8EzxqUys6kAwvstxz96-iYlkrrRP1BmAiMzKajjr4rvUR7JRseaxENScLmBpqHVY6-HxsuSSuaZOAx-m5WGPRRwT6CHtY9gQrNXj7bVYhHbhwV0ZNLRTFG0w_Jk7xtoZFKUg Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: c211fa2293a34a8d93062f88a8fc72b8 Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:54.202574 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:54.204124 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c211fa2293a34a8d93062f88a8fc72b8", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:54.204124 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:54.204124 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: c211fa2293a34a8d93062f88a8fc72b8 Jul 12 11:49:54.204124 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:54.204124 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminNegativeTestJSON-1634309727-project Jul 12 11:49:54.204124 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:54.204124 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:54.204124 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 159cb9ae8a5d4a3d9a371710a5bbc61a Jul 12 11:49:54.204124 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727-project Jul 12 11:49:54.204124 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:54.204124 n-d-849104-4 devstack@n-api.service[125983]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 12 11:49:54.204124 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '16'} Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:54.204830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.206412 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7f0f7df1-a37f-4119-8720-7471a9f45bde tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:54.207389 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7f0f7df1-a37f-4119-8720-7471a9f45bde tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] 10.222.0.50 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.013854 Jul 12 11:49:54.208770 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 146/313] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:54 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:54.213301 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-608d7940-8c3c-4956-8b03-2d9bd99e1e90 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:54.214471 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:54.214471 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:54.252180 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-608d7940-8c3c-4956-8b03-2d9bd99e1e90 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.039522 Jul 12 11:49:54.256877 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 147/314] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Jul 12 11:49:54 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:54.272418 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5ce29bcc-d64b-4f1e-9449-5291ce0ed5ae tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:54.274967 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:54.274967 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:54.290068 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-5ce29bcc-d64b-4f1e-9449-5291ce0ed5ae tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5ce29bcc-d64b-4f1e-9449-5291ce0ed5ae tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Request method failure captured: Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-rqMgZ6jMdHhW5bdciXf9hP4I122-Y1_P3WHBuBUo9TEYqPO-bTlbdrBlUnGJqRV7pWR5tJ3rTRIZ6AH9d9fggEfpiBHreUpNtEOA58D_H8twlEBS1mFglysYaArQ1p3GoI0gKGLs9pZuQpaF0WN1llPkx5EjK2Uz9Ds7ZVoSP_qc Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:49:54.294474 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:49:54.296013 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0cc056fb0ff40acba73fdc461d60efb", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:54.296013 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:54.296013 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:54.296013 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:54.296013 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:54.296013 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:54.296013 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:54.296013 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: cd356328364c44f899595a060a9ff53c Jul 12 11:49:54.296013 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:54.296013 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:54.296013 n-d-849104-4 devstack@n-api.service[125983]: exception: Aggregate -1 could not be found. Jul 12 11:49:54.296013 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '-1'} Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:54.296826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 12 11:49:54.298168 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.304120 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5ce29bcc-d64b-4f1e-9449-5291ce0ed5ae tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:54.305130 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5ce29bcc-d64b-4f1e-9449-5291ce0ed5ae tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.042465 Jul 12 11:49:54.307687 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 148/315] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 11:49:54 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:49:54.318450 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2236721e-4779-4c09-98a6-5945f248aeb1 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:54.319351 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:54.319351 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:54.325458 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2236721e-4779-4c09-98a6-5945f248aeb1 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '159cb9ae8a5d4a3d9a371710a5bbc61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c211fa2293a34a8d93062f88a8fc72b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2236721e-4779-4c09-98a6-5945f248aeb1 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Request method failure captured: Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-pshMqPRCSEGrOouEin3EGDM7gGErqDESu_HuQvlK8EzxqUys6kAwvstxz96-iYlkrrRP1BmAiMzKajjr4rvUR7JRseaxENScLmBpqHVY6-HxsuSSuaZOAx-m5WGPRRwT6CHtY9gQrNXj7bVYhHbhwV0ZNLRTFG0w_Jk7xtoZFKUg Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: c211fa2293a34a8d93062f88a8fc72b8 Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:54.332987 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:54.334377 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c211fa2293a34a8d93062f88a8fc72b8", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:54.334377 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:54.334377 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: c211fa2293a34a8d93062f88a8fc72b8 Jul 12 11:49:54.334377 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:54.334377 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminNegativeTestJSON-1634309727-project Jul 12 11:49:54.334377 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:54.334377 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:54.334377 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 159cb9ae8a5d4a3d9a371710a5bbc61a Jul 12 11:49:54.334377 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727-project Jul 12 11:49:54.334377 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:54.334377 n-d-849104-4 devstack@n-api.service[125983]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 12 11:49:54.334377 n-d-849104-4 devstack@n-api.service[125983]: action_args: {} Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:54.335025 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 12 11:49:54.336095 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:54.338135 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2236721e-4779-4c09-98a6-5945f248aeb1 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:54.341747 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2236721e-4779-4c09-98a6-5945f248aeb1 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.029368 Jul 12 11:49:54.352575 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 149/316] 10.222.0.50 () {58 vars in 1142 bytes} [Tue Jul 12 11:49:54 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:54.367787 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a094a152-1b3c-4ea5-938e-237b6956f07b tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1646247523"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:54.371893 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:54.371893 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:54.376746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.aggregate [None req-a094a152-1b3c-4ea5-938e-237b6956f07b tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Generated uuid 4075bd77-a353-4f6f-9e61-71b7f541b217 for aggregate {{(pid=125983) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:54.435593 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a094a152-1b3c-4ea5-938e-237b6956f07b tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.077270 Jul 12 11:49:54.436595 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 150/317] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:49:54.446563 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2d3b68b1-1313-44bc-bab8-83efb60d9d15 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:54.447185 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2d3b68b1-1313-44bc-bab8-83efb60d9d15 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:54.480337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d3b68b1-1313-44bc-bab8-83efb60d9d15 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:54.481170 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d3b68b1-1313-44bc-bab8-83efb60d9d15 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:54.482377 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d3b68b1-1313-44bc-bab8-83efb60d9d15 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:54.483584 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d3b68b1-1313-44bc-bab8-83efb60d9d15 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:54.559947 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-74523fbe-3edf-408c-b136-1ed5cfc4b6c8 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7e394152cbc64b698118836521f3e4fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edf9834df214506be223369a506d00e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:54.561757 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-74523fbe-3edf-408c-b136-1ed5cfc4b6c8 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] flavor_id is None. Assuming migration. {{(pid=125984) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 12 11:49:54.562581 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-74523fbe-3edf-408c-b136-1ed5cfc4b6c8 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125984) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 12 11:49:54.715278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=20 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:54.781002 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2d3b68b1-1313-44bc-bab8-83efb60d9d15 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:54.796810 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2d3b68b1-1313-44bc-bab8-83efb60d9d15 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 200 len: 1468 microversion: 2.1 time: 0.359566 Jul 12 11:49:54.797683 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 151/318] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:54 2022] GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 1468 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:54.802340 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-dad47234-eb10-4681-8035-e0097739a600 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-849104-4"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:54.803827 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:54.803827 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:54.833528 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dad47234-eb10-4681-8035-e0097739a600 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:54.834558 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dad47234-eb10-4681-8035-e0097739a600 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:55.080643 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-dad47234-eb10-4681-8035-e0097739a600 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.279921 Jul 12 11:49:55.083190 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 152/319] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:49:54 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:55.095112 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1520d841-280f-467f-abba-efe7975ca3c8 tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:55.098111 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1520d841-280f-467f-abba-efe7975ca3c8 tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:55.108651 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1520d841-280f-467f-abba-efe7975ca3c8 tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:55.109109 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1520d841-280f-467f-abba-efe7975ca3c8 tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:55.109912 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1520d841-280f-467f-abba-efe7975ca3c8 tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:55.110354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1520d841-280f-467f-abba-efe7975ca3c8 tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:55.263525 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1520d841-280f-467f-abba-efe7975ca3c8 tempest-DeleteServersAdminTestJSON-1569774941 tempest-DeleteServersAdminTestJSON-1569774941-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65/action" status: 202 len: 0 microversion: 2.1 time: 0.178738 Jul 12 11:49:55.264073 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 153/320] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:49:55 2022] POST /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:55.275240 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ffdebc3c-5b55-4f10-85f1-893825144490 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-849104-4"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:55.276613 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:55.276613 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:55.278889 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ffdebc3c-5b55-4f10-85f1-893825144490 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '159cb9ae8a5d4a3d9a371710a5bbc61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c211fa2293a34a8d93062f88a8fc72b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ffdebc3c-5b55-4f10-85f1-893825144490 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Request method failure captured: Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 42 Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-pshMqPRCSEGrOouEin3EGDM7gGErqDESu_HuQvlK8EzxqUys6kAwvstxz96-iYlkrrRP1BmAiMzKajjr4rvUR7JRseaxENScLmBpqHVY6-HxsuSSuaZOAx-m5WGPRRwT6CHtY9gQrNXj7bVYhHbhwV0ZNLRTFG0w_Jk7xtoZFKUg Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: c211fa2293a34a8d93062f88a8fc72b8 Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:55.280534 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:55.281906 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c211fa2293a34a8d93062f88a8fc72b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c211fa2293a34a8d93062f88a8fc72b8", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:55.281906 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:55.281906 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: c211fa2293a34a8d93062f88a8fc72b8 Jul 12 11:49:55.281906 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727 Jul 12 11:49:55.281906 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AggregatesAdminNegativeTestJSON-1634309727-project Jul 12 11:49:55.281906 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:55.281906 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:55.281906 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 159cb9ae8a5d4a3d9a371710a5bbc61a Jul 12 11:49:55.281906 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1634309727-project Jul 12 11:49:55.281906 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:49:55.281906 n-d-849104-4 devstack@n-api.service[125983]: {"remove_host": {"host": "n-h1-849104-4"}} Jul 12 11:49:55.281906 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:55.281906 n-d-849104-4 devstack@n-api.service[125983]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-849104-4'}}} Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:55.282673 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 12 11:49:55.283868 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:55.289092 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ffdebc3c-5b55-4f10-85f1-893825144490 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:55.290153 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ffdebc3c-5b55-4f10-85f1-893825144490 tempest-AggregatesAdminNegativeTestJSON-1634309727 tempest-AggregatesAdminNegativeTestJSON-1634309727-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.025490 Jul 12 11:49:55.301375 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 154/321] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:49:55 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:55.306783 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c7501ef4-14c7-4871-949f-9e2c6382d48a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:55.307546 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c7501ef4-14c7-4871-949f-9e2c6382d48a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:55.314900 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c7501ef4-14c7-4871-949f-9e2c6382d48a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:55.316253 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c7501ef4-14c7-4871-949f-9e2c6382d48a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:55.317321 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c7501ef4-14c7-4871-949f-9e2c6382d48a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:55.317948 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c7501ef4-14c7-4871-949f-9e2c6382d48a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:55.381679 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c7501ef4-14c7-4871-949f-9e2c6382d48a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:55.387624 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c7501ef4-14c7-4871-949f-9e2c6382d48a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:55.387961 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-c7501ef4-14c7-4871-949f-9e2c6382d48a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lazy-loading 'fault' on Instance uuid 0c3c3708-14f5-486e-8025-a4b91aefee65 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:49:55.509204 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-74523fbe-3edf-408c-b136-1ed5cfc4b6c8 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333/action" status: 202 len: 0 microversion: 2.1 time: 2.093678 Jul 12 11:49:55.514942 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 168/322] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:49:53 2022] POST /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333/action => generated 0 bytes in 2100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:49:55.521267 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1ffbe173-f5bb-4e42-a4ed-f68dcec38ee7 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-849104-4"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:55.523774 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:55.523774 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:55.535626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1ffbe173-f5bb-4e42-a4ed-f68dcec38ee7 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:55.536180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1ffbe173-f5bb-4e42-a4ed-f68dcec38ee7 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:55.700431 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1ffbe173-f5bb-4e42-a4ed-f68dcec38ee7 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.181222 Jul 12 11:49:55.701149 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 169/323] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:49:55 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:55.719251 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-76eb6e19-40b1-4bee-8415-ff5ad02489a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:55.720016 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-76eb6e19-40b1-4bee-8415-ff5ad02489a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:55.722627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=8,nova_api:UPDATE=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:55.763463 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76eb6e19-40b1-4bee-8415-ff5ad02489a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:55.763463 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76eb6e19-40b1-4bee-8415-ff5ad02489a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:55.766348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76eb6e19-40b1-4bee-8415-ff5ad02489a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:55.766847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76eb6e19-40b1-4bee-8415-ff5ad02489a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:55.836641 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c7501ef4-14c7-4871-949f-9e2c6382d48a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:55.864078 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c7501ef4-14c7-4871-949f-9e2c6382d48a tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 200 len: 1451 microversion: 2.1 time: 0.561349 Jul 12 11:49:55.868276 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 155/324] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:55 2022] GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 1451 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:55.892016 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d837b193-42b7-4aff-9671-2deb2e870fc9 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:55.893938 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:55.893938 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:49:55.926044 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d837b193-42b7-4aff-9671-2deb2e870fc9 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.054453 Jul 12 11:49:55.935864 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 156/325] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Jul 12 11:49:55 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:55.947928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-966e2dc9-fe2e-4fd8-ac8e-f88b01a589e6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:55.948936 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-966e2dc9-fe2e-4fd8-ac8e-f88b01a589e6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:55.958773 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-966e2dc9-fe2e-4fd8-ac8e-f88b01a589e6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:55.959799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-966e2dc9-fe2e-4fd8-ac8e-f88b01a589e6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:55.961697 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-966e2dc9-fe2e-4fd8-ac8e-f88b01a589e6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:55.962618 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-966e2dc9-fe2e-4fd8-ac8e-f88b01a589e6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:55.999537 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-966e2dc9-fe2e-4fd8-ac8e-f88b01a589e6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:49:56.040477 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-76eb6e19-40b1-4bee-8415-ff5ad02489a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:56.050279 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-76eb6e19-40b1-4bee-8415-ff5ad02489a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1471 microversion: 2.1 time: 0.347804 Jul 12 11:49:56.061055 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 170/326] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:55 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1471 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:56.067002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ae4e3bc8-8992-461a-8bb9-2bc464a4f49c tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-688602754"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:56.068826 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:56.068826 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:56.070506 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.aggregate [None req-ae4e3bc8-8992-461a-8bb9-2bc464a4f49c tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Generated uuid 1708bc99-c602-48f2-8504-a7e49653a4ba for aggregate {{(pid=125984) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 12 11:49:56.092405 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=32 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:56.106135 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ae4e3bc8-8992-461a-8bb9-2bc464a4f49c tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043663 Jul 12 11:49:56.108993 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 171/327] 10.222.0.50 () {60 vars in 1163 bytes} [Tue Jul 12 11:49:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:49:56.127993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d0ca6ce8-49d2-4328-8b67-20108a5c61d5 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:56.130300 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:56.130300 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:56.144915 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0ca6ce8-49d2-4328-8b67-20108a5c61d5 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:56.146396 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0ca6ce8-49d2-4328-8b67-20108a5c61d5 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:56.157123 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0ca6ce8-49d2-4328-8b67-20108a5c61d5 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:56.157862 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0ca6ce8-49d2-4328-8b67-20108a5c61d5 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:56.158422 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:DELETE=13 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:49:56.173959 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.compute.aggregates [None req-d0ca6ce8-49d2-4328-8b67-20108a5c61d5 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 12 11:49:56.175192 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-d0ca6ce8-49d2-4328-8b67-20108a5c61d5 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d0ca6ce8-49d2-4328-8b67-20108a5c61d5 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Request method failure captured: Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 42 Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV-rqMgZ6jMdHhW5bdciXf9hP4I122-Y1_P3WHBuBUo9TEYqPO-bTlbdrBlUnGJqRV7pWR5tJ3rTRIZ6AH9d9fggEfpiBHreUpNtEOA58D_H8twlEBS1mFglysYaArQ1p3GoI0gKGLs9pZuQpaF0WN1llPkx5EjK2Uz9Ds7ZVoSP_qc Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:49:56.178032 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:49:56.179490 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0cc056fb0ff40acba73fdc461d60efb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0cc056fb0ff40acba73fdc461d60efb", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:56.179490 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:56.179490 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a0cc056fb0ff40acba73fdc461d60efb Jul 12 11:49:56.179490 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661 Jul 12 11:49:56.179490 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:56.179490 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:56.179490 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:56.179490 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: cd356328364c44f899595a060a9ff53c Jul 12 11:49:56.179490 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin Jul 12 11:49:56.179490 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:49:56.179490 n-d-849104-4 devstack@n-api.service[125984]: {"remove_host": {"host": "nonexist_host"}} Jul 12 11:49:56.179490 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:56.179490 n-d-849104-4 devstack@n-api.service[125984]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 12 11:49:56.180456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 12 11:49:56.181632 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:56.182719 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:56.183903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:56.183903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:56.183903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:56.183903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:56.183903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 12 11:49:56.183903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:56.185567 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d0ca6ce8-49d2-4328-8b67-20108a5c61d5 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:56.186704 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d0ca6ce8-49d2-4328-8b67-20108a5c61d5 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.070645 Jul 12 11:49:56.188189 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 172/328] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:49:56 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:49:56.200309 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b787ff9c-54cb-4294-b444-bbefc2f4cfd5 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:56.202749 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:49:56.202749 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:49:56.210574 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-966e2dc9-fe2e-4fd8-ac8e-f88b01a589e6 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 204 len: 0 microversion: 2.1 time: 0.272388 Jul 12 11:49:56.211744 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 157/329] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:49:55 2022] DELETE /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:49:56.229275 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-620aa7c6-c062-4cac-9bcc-03164aae4f08 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:56.229995 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-620aa7c6-c062-4cac-9bcc-03164aae4f08 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:56.245641 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-620aa7c6-c062-4cac-9bcc-03164aae4f08 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:56.246680 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-620aa7c6-c062-4cac-9bcc-03164aae4f08 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:56.250568 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b787ff9c-54cb-4294-b444-bbefc2f4cfd5 tempest-AggregatesAdminNegativeTestJSON-2022982661 tempest-AggregatesAdminNegativeTestJSON-2022982661-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.057053 Jul 12 11:49:56.252063 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 173/330] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Jul 12 11:49:56 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 12 11:49:56.255114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-620aa7c6-c062-4cac-9bcc-03164aae4f08 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:56.255568 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-620aa7c6-c062-4cac-9bcc-03164aae4f08 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:56.325119 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-620aa7c6-c062-4cac-9bcc-03164aae4f08 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:56.330274 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-620aa7c6-c062-4cac-9bcc-03164aae4f08 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:56.331189 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-620aa7c6-c062-4cac-9bcc-03164aae4f08 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lazy-loading 'fault' on Instance uuid 0c3c3708-14f5-486e-8025-a4b91aefee65 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:49:56.743415 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-620aa7c6-c062-4cac-9bcc-03164aae4f08 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:56.751980 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-620aa7c6-c062-4cac-9bcc-03164aae4f08 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 200 len: 1457 microversion: 2.1 time: 0.535165 Jul 12 11:49:56.758016 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 158/331] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:56 2022] GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 1457 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:57.067778 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e51f9113-8588-4e32-8cf5-cedb9259bf69 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:57.068587 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e51f9113-8588-4e32-8cf5-cedb9259bf69 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:57.078348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e51f9113-8588-4e32-8cf5-cedb9259bf69 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:57.088248 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e51f9113-8588-4e32-8cf5-cedb9259bf69 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:57.089288 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e51f9113-8588-4e32-8cf5-cedb9259bf69 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:57.089751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e51f9113-8588-4e32-8cf5-cedb9259bf69 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:57.294525 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-620aa7c6-c062-4cac-9bcc-03164aae4f08 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:57.296236 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-620aa7c6-c062-4cac-9bcc-03164aae4f08 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002001 Jul 12 11:49:57.297962 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 159/332] 10.222.0.50 () {56 vars in 885 bytes} [Tue Jul 12 11:49:57 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 12 11:49:57.482245 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e51f9113-8588-4e32-8cf5-cedb9259bf69 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:57.504624 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e51f9113-8588-4e32-8cf5-cedb9259bf69 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1471 microversion: 2.1 time: 0.441146 Jul 12 11:49:57.518740 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 174/333] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:57 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1471 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:57.775930 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2572e259-080d-4585-b2b5-768d3cd691c7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:57.777902 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2572e259-080d-4585-b2b5-768d3cd691c7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:57.791820 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2572e259-080d-4585-b2b5-768d3cd691c7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:57.792994 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2572e259-080d-4585-b2b5-768d3cd691c7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:57.795519 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2572e259-080d-4585-b2b5-768d3cd691c7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:57.796652 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2572e259-080d-4585-b2b5-768d3cd691c7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:57.879247 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2572e259-080d-4585-b2b5-768d3cd691c7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:57.879701 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2572e259-080d-4585-b2b5-768d3cd691c7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:57.884734 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-2572e259-080d-4585-b2b5-768d3cd691c7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lazy-loading 'fault' on Instance uuid 0c3c3708-14f5-486e-8025-a4b91aefee65 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:49:58.264480 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2572e259-080d-4585-b2b5-768d3cd691c7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1398a8a39da4db08f1ae1ae223d13ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f0f9676134a43b59b24a174df0df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:58.279334 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2572e259-080d-4585-b2b5-768d3cd691c7 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 200 len: 1457 microversion: 2.1 time: 0.508954 Jul 12 11:49:58.284498 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 160/334] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:57 2022] GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 1457 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:58.525817 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-74890644-375a-462b-b46b-bc39e62cf398 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:58.526591 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-74890644-375a-462b-b46b-bc39e62cf398 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:58.538513 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74890644-375a-462b-b46b-bc39e62cf398 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:58.541648 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74890644-375a-462b-b46b-bc39e62cf398 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:58.542510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74890644-375a-462b-b46b-bc39e62cf398 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:58.542947 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74890644-375a-462b-b46b-bc39e62cf398 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:58.636937 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-575cf7dd-0f6b-4f15-9ea2-1e7555fcefe5 req-9e18a18c-233b-45b2-819b-e83297adb64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c3c3708-14f5-486e-8025-a4b91aefee65", "name": "network-vif-deleted", "tag": "dd35879a-b9d2-470e-99a5-526d2b5a0e51"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:49:58.680782 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-575cf7dd-0f6b-4f15-9ea2-1e7555fcefe5 req-9e18a18c-233b-45b2-819b-e83297adb64e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:58.680782 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-575cf7dd-0f6b-4f15-9ea2-1e7555fcefe5 req-9e18a18c-233b-45b2-819b-e83297adb64e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:58.718010 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-575cf7dd-0f6b-4f15-9ea2-1e7555fcefe5 req-9e18a18c-233b-45b2-819b-e83297adb64e service nova] Creating event network-vif-deleted:dd35879a-b9d2-470e-99a5-526d2b5a0e51 for instance 0c3c3708-14f5-486e-8025-a4b91aefee65 on n-h2-849104-4 Jul 12 11:49:58.724714 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-575cf7dd-0f6b-4f15-9ea2-1e7555fcefe5 req-9e18a18c-233b-45b2-819b-e83297adb64e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095291 Jul 12 11:49:58.725325 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 161/335] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:49:58.851432 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-74890644-375a-462b-b46b-bc39e62cf398 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:49:58.862653 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-74890644-375a-462b-b46b-bc39e62cf398 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1471 microversion: 2.1 time: 0.341594 Jul 12 11:49:58.865745 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 175/336] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:58 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1471 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:49:59.314921 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-06f8f40d-71ec-43bb-8c64-71c945b6ba47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:59.324308 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-06f8f40d-71ec-43bb-8c64-71c945b6ba47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:59.349056 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-06f8f40d-71ec-43bb-8c64-71c945b6ba47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:59.349835 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-06f8f40d-71ec-43bb-8c64-71c945b6ba47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:59.358443 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-06f8f40d-71ec-43bb-8c64-71c945b6ba47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:59.358906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-06f8f40d-71ec-43bb-8c64-71c945b6ba47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:59.400624 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-06f8f40d-71ec-43bb-8c64-71c945b6ba47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] HTTP exception thrown: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-06f8f40d-71ec-43bb-8c64-71c945b6ba47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Request method failure captured: Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 HTTP/1.1 Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-pl-lc1Yp5UWTCdLcV3JyXQYaOGMbW7v8V_UdHYNKcJ80_h-JbargH-Z_fDWEgmTuYcwhqACy5VYsd5xFK7dILJwHF66sXRcteqqF6Zf2jwlYW4ZeWLpYH_up9m1a5S31-tyIdK5QBdbZty3eJ0CyVpBAQkwhyI0j2G4ZrsL-2Kns Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 959f0f9676134a43b59b24a174df0df8 Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:59.402316 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:59.403722 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_959f0f9676134a43b59b24a174df0df8", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:59.403722 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.403722 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 959f0f9676134a43b59b24a174df0df8 Jul 12 11:49:59.403722 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.403722 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-DeleteServersAdminTestJSON-1286651160-project Jul 12 11:49:59.403722 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:59.403722 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:59.403722 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: a1398a8a39da4db08f1ae1ae223d13ce Jul 12 11:49:59.403722 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-DeleteServersAdminTestJSON-1286651160-project Jul 12 11:49:59.403722 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:59.403722 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.403722 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '0c3c3708-14f5-486e-8025-a4b91aefee65'} Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:59.404552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.405830 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.414521 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-06f8f40d-71ec-43bb-8c64-71c945b6ba47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Returning 404 to user: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:59.414521 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-06f8f40d-71ec-43bb-8c64-71c945b6ba47 tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 404 len: 111 microversion: 2.1 time: 0.102361 Jul 12 11:49:59.414521 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 162/337] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:59 2022] GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:59.416888 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-883b8ac3-42c5-4645-adec-4b17c9ae529b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:59.417394 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-883b8ac3-42c5-4645-adec-4b17c9ae529b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:59.429235 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-883b8ac3-42c5-4645-adec-4b17c9ae529b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:59.430056 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-883b8ac3-42c5-4645-adec-4b17c9ae529b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:59.431626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-883b8ac3-42c5-4645-adec-4b17c9ae529b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:59.432689 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-883b8ac3-42c5-4645-adec-4b17c9ae529b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:59.478854 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-883b8ac3-42c5-4645-adec-4b17c9ae529b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] HTTP exception thrown: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-883b8ac3-42c5-4645-adec-4b17c9ae529b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Request method failure captured: Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 HTTP/1.1 Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV-pl-lc1Yp5UWTCdLcV3JyXQYaOGMbW7v8V_UdHYNKcJ80_h-JbargH-Z_fDWEgmTuYcwhqACy5VYsd5xFK7dILJwHF66sXRcteqqF6Zf2jwlYW4ZeWLpYH_up9m1a5S31-tyIdK5QBdbZty3eJ0CyVpBAQkwhyI0j2G4ZrsL-2Kns Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 959f0f9676134a43b59b24a174df0df8 Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:59.494004 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:59.495371 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_959f0f9676134a43b59b24a174df0df8", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:59.495371 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.495371 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 959f0f9676134a43b59b24a174df0df8 Jul 12 11:49:59.495371 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.495371 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-DeleteServersAdminTestJSON-1286651160-project Jul 12 11:49:59.495371 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:59.495371 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:59.495371 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: a1398a8a39da4db08f1ae1ae223d13ce Jul 12 11:49:59.495371 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-DeleteServersAdminTestJSON-1286651160-project Jul 12 11:49:59.495371 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:59.495371 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.495371 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '0c3c3708-14f5-486e-8025-a4b91aefee65'} Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:59.496069 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.499215 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.507930 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-883b8ac3-42c5-4645-adec-4b17c9ae529b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Returning 404 to user: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:59.509913 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-883b8ac3-42c5-4645-adec-4b17c9ae529b tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 404 len: 111 microversion: 2.1 time: 0.097260 Jul 12 11:49:59.516297 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 176/338] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:49:59 2022] DELETE /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:59.528391 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a6072f9b-5e62-4add-bdd4-955366cb33ed tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:59.529366 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a6072f9b-5e62-4add-bdd4-955366cb33ed tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 0c3c3708-14f5-486e-8025-a4b91aefee65] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:59.540706 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a6072f9b-5e62-4add-bdd4-955366cb33ed tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:59.541161 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a6072f9b-5e62-4add-bdd4-955366cb33ed tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:59.542057 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a6072f9b-5e62-4add-bdd4-955366cb33ed tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:59.542480 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a6072f9b-5e62-4add-bdd4-955366cb33ed tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:59.574850 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-a6072f9b-5e62-4add-bdd4-955366cb33ed tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] HTTP exception thrown: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a6072f9b-5e62-4add-bdd4-955366cb33ed tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Request method failure captured: Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 HTTP/1.1 Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-pl-lc1Yp5UWTCdLcV3JyXQYaOGMbW7v8V_UdHYNKcJ80_h-JbargH-Z_fDWEgmTuYcwhqACy5VYsd5xFK7dILJwHF66sXRcteqqF6Zf2jwlYW4ZeWLpYH_up9m1a5S31-tyIdK5QBdbZty3eJ0CyVpBAQkwhyI0j2G4ZrsL-2Kns Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 959f0f9676134a43b59b24a174df0df8 Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:59.578037 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:59.579459 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_959f0f9676134a43b59b24a174df0df8", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:59.579459 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.579459 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 959f0f9676134a43b59b24a174df0df8 Jul 12 11:49:59.579459 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.579459 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-DeleteServersAdminTestJSON-1286651160-project Jul 12 11:49:59.579459 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:59.579459 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:59.579459 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: a1398a8a39da4db08f1ae1ae223d13ce Jul 12 11:49:59.579459 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-DeleteServersAdminTestJSON-1286651160-project Jul 12 11:49:59.579459 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:59.579459 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.579459 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '0c3c3708-14f5-486e-8025-a4b91aefee65'} Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:59.580310 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. Jul 12 11:49:59.582148 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.583093 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a6072f9b-5e62-4add-bdd4-955366cb33ed tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Returning 404 to user: Instance 0c3c3708-14f5-486e-8025-a4b91aefee65 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:59.583093 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a6072f9b-5e62-4add-bdd4-955366cb33ed tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65" status: 404 len: 111 microversion: 2.1 time: 0.065073 Jul 12 11:49:59.583093 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 163/339] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:59 2022] GET /compute/v2.1/servers/0c3c3708-14f5-486e-8025-a4b91aefee65 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:59.593287 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-24c38589-611a-4b29-937c-1315649b68bd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:59.593784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-24c38589-611a-4b29-937c-1315649b68bd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:59.609753 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24c38589-611a-4b29-937c-1315649b68bd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:59.611052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24c38589-611a-4b29-937c-1315649b68bd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:59.612819 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24c38589-611a-4b29-937c-1315649b68bd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:59.614862 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24c38589-611a-4b29-937c-1315649b68bd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:59.669959 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-24c38589-611a-4b29-937c-1315649b68bd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] HTTP exception thrown: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-24c38589-611a-4b29-937c-1315649b68bd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Request method failure captured: Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 HTTP/1.1 Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV-pl-lc1Yp5UWTCdLcV3JyXQYaOGMbW7v8V_UdHYNKcJ80_h-JbargH-Z_fDWEgmTuYcwhqACy5VYsd5xFK7dILJwHF66sXRcteqqF6Zf2jwlYW4ZeWLpYH_up9m1a5S31-tyIdK5QBdbZty3eJ0CyVpBAQkwhyI0j2G4ZrsL-2Kns Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 959f0f9676134a43b59b24a174df0df8 Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:49:59.676484 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:49:59.678117 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_959f0f9676134a43b59b24a174df0df8", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:59.678117 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.678117 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 959f0f9676134a43b59b24a174df0df8 Jul 12 11:49:59.678117 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.678117 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-DeleteServersAdminTestJSON-1286651160-project Jul 12 11:49:59.678117 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:49:59.678117 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:49:59.678117 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: a1398a8a39da4db08f1ae1ae223d13ce Jul 12 11:49:59.678117 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-DeleteServersAdminTestJSON-1286651160-project Jul 12 11:49:59.678117 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:49:59.678117 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:59.678117 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '409e75a9-6ee8-4705-9f27-97989ba439a2'} Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:59.678912 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:59.680245 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.685237 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-24c38589-611a-4b29-937c-1315649b68bd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Returning 404 to user: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:59.689282 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-24c38589-611a-4b29-937c-1315649b68bd tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "DELETE /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 404 len: 111 microversion: 2.1 time: 0.099706 Jul 12 11:49:59.697360 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 177/340] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:49:59 2022] DELETE /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:59.702268 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f9998a24-29ef-47e1-801e-f8a19efa832e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:59.703601 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f9998a24-29ef-47e1-801e-f8a19efa832e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] [instance: 409e75a9-6ee8-4705-9f27-97989ba439a2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:59.722009 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f9998a24-29ef-47e1-801e-f8a19efa832e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:59.722470 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f9998a24-29ef-47e1-801e-f8a19efa832e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:59.723256 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f9998a24-29ef-47e1-801e-f8a19efa832e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:59.723687 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f9998a24-29ef-47e1-801e-f8a19efa832e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:59.779646 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-f9998a24-29ef-47e1-801e-f8a19efa832e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] HTTP exception thrown: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f9998a24-29ef-47e1-801e-f8a19efa832e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Request method failure captured: Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 HTTP/1.1 Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV-pl-lc1Yp5UWTCdLcV3JyXQYaOGMbW7v8V_UdHYNKcJ80_h-JbargH-Z_fDWEgmTuYcwhqACy5VYsd5xFK7dILJwHF66sXRcteqqF6Zf2jwlYW4ZeWLpYH_up9m1a5S31-tyIdK5QBdbZty3eJ0CyVpBAQkwhyI0j2G4ZrsL-2Kns Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 959f0f9676134a43b59b24a174df0df8 Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:49:59.783624 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:49:59.785708 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/959f0f9676134a43b59b24a174df0df8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_959f0f9676134a43b59b24a174df0df8", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:49:59.785708 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.785708 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 959f0f9676134a43b59b24a174df0df8 Jul 12 11:49:59.785708 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1286651160 Jul 12 11:49:59.785708 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-DeleteServersAdminTestJSON-1286651160-project Jul 12 11:49:59.785708 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:49:59.785708 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:49:59.785708 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: a1398a8a39da4db08f1ae1ae223d13ce Jul 12 11:49:59.785708 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-DeleteServersAdminTestJSON-1286651160-project Jul 12 11:49:59.785708 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:49:59.785708 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:59.785708 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '409e75a9-6ee8-4705-9f27-97989ba439a2'} Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:49:59.786487 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. Jul 12 11:49:59.787768 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:49:59.789004 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f9998a24-29ef-47e1-801e-f8a19efa832e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] Returning 404 to user: Instance 409e75a9-6ee8-4705-9f27-97989ba439a2 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:49:59.789004 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f9998a24-29ef-47e1-801e-f8a19efa832e tempest-DeleteServersAdminTestJSON-1286651160 tempest-DeleteServersAdminTestJSON-1286651160-project] 10.222.0.50 "GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2" status: 404 len: 111 microversion: 2.1 time: 0.091541 Jul 12 11:49:59.792957 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 164/341] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:59 2022] GET /compute/v2.1/servers/409e75a9-6ee8-4705-9f27-97989ba439a2 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:49:59.886933 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d30619e7-2c6f-41d1-90f4-430abcc314bf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:49:59.888939 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d30619e7-2c6f-41d1-90f4-430abcc314bf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:49:59.912651 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d30619e7-2c6f-41d1-90f4-430abcc314bf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:59.915260 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d30619e7-2c6f-41d1-90f4-430abcc314bf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:49:59.918514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d30619e7-2c6f-41d1-90f4-430abcc314bf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:49:59.920993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d30619e7-2c6f-41d1-90f4-430abcc314bf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:00.757418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d30619e7-2c6f-41d1-90f4-430abcc314bf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:00.804512 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d30619e7-2c6f-41d1-90f4-430abcc314bf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1471 microversion: 2.1 time: 0.919207 Jul 12 11:50:00.805176 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 178/342] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:49:59 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1471 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:01.826716 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9a9c26f6-9fe6-4fd8-b135-858815b81756 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:01.828013 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9a9c26f6-9fe6-4fd8-b135-858815b81756 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:01.838347 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9a9c26f6-9fe6-4fd8-b135-858815b81756 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:01.853371 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9a9c26f6-9fe6-4fd8-b135-858815b81756 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:01.858423 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9a9c26f6-9fe6-4fd8-b135-858815b81756 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:01.859736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9a9c26f6-9fe6-4fd8-b135-858815b81756 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:01.879872 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:02.184133 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9a9c26f6-9fe6-4fd8-b135-858815b81756 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:02.195523 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9a9c26f6-9fe6-4fd8-b135-858815b81756 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1471 microversion: 2.1 time: 0.376192 Jul 12 11:50:02.198181 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 165/343] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:01 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1471 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:03.217110 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fa30d0b2-4230-4795-9f15-41caaae5b3d7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:03.217784 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fa30d0b2-4230-4795-9f15-41caaae5b3d7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:03.239849 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa30d0b2-4230-4795-9f15-41caaae5b3d7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:03.240253 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa30d0b2-4230-4795-9f15-41caaae5b3d7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:03.241053 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa30d0b2-4230-4795-9f15-41caaae5b3d7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:03.247882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa30d0b2-4230-4795-9f15-41caaae5b3d7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:03.478225 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fa30d0b2-4230-4795-9f15-41caaae5b3d7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:03.487608 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:03.497494 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fa30d0b2-4230-4795-9f15-41caaae5b3d7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1476 microversion: 2.1 time: 0.283496 Jul 12 11:50:03.498817 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 166/344] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:03 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1476 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:03.929219 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-978328771", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "a4b192d5-01e7-4311-bb92-5453a7cfd32e"}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:04.023344 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] validate_networks() for [('a4b192d5-01e7-4311-bb92-5453a7cfd32e', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:50:04.515949 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9d21ee17-610e-44e5-a6d6-09add2819c98 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:04.516672 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9d21ee17-610e-44e5-a6d6-09add2819c98 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:04.531671 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9d21ee17-610e-44e5-a6d6-09add2819c98 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:04.534057 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9d21ee17-610e-44e5-a6d6-09add2819c98 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:04.535184 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9d21ee17-610e-44e5-a6d6-09add2819c98 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:04.548124 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9d21ee17-610e-44e5-a6d6-09add2819c98 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:04.838197 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:50:04.838623 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:50:04.839098 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:50:04.839510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:50:04.839996 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:50:04.852274 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:04.853019 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:04.854314 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:04.855225 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:04.879475 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Getting quotas for project a48f95c0a90c463f809af1fcdf65da82. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:04.884523 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Getting quotas for user 0e629578143548dc8ba0cf77404c259b and project a48f95c0a90c463f809af1fcdf65da82. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:04.902062 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:50:04.905463 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:50:04.981429 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e23ff925-c7ca-4acd-a1a3-4f5983e43242 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.912202 Jul 12 11:50:04.984418 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 179/345] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:50:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:50:04.989976 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9d21ee17-610e-44e5-a6d6-09add2819c98 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:05.000646 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a9d7a068-ad71-480b-a821-3368320ff63f tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:05.003767 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a9d7a068-ad71-480b-a821-3368320ff63f tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:05.026176 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9d21ee17-610e-44e5-a6d6-09add2819c98 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1476 microversion: 2.1 time: 0.501149 Jul 12 11:50:05.031558 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 167/346] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:04 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1476 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:05.126266 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a9d7a068-ad71-480b-a821-3368320ff63f tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e629578143548dc8ba0cf77404c259b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48f95c0a90c463f809af1fcdf65da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:05.139694 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a9d7a068-ad71-480b-a821-3368320ff63f tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 200 len: 1215 microversion: 2.1 time: 0.150122 Jul 12 11:50:05.149099 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 180/347] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:04 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:06.050111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4b8ee696-e916-4876-9d6e-8b493cf4506c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:06.051994 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4b8ee696-e916-4876-9d6e-8b493cf4506c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:06.080423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b8ee696-e916-4876-9d6e-8b493cf4506c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:06.081741 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b8ee696-e916-4876-9d6e-8b493cf4506c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:06.082702 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b8ee696-e916-4876-9d6e-8b493cf4506c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:06.085359 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b8ee696-e916-4876-9d6e-8b493cf4506c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:06.589011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4b8ee696-e916-4876-9d6e-8b493cf4506c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:06.602255 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4b8ee696-e916-4876-9d6e-8b493cf4506c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1476 microversion: 2.1 time: 0.557048 Jul 12 11:50:06.604977 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 181/348] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:06 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1476 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:06.616489 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-41898f73-a4d0-427a-97da-b45e4fed6797 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:06.617476 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-41898f73-a4d0-427a-97da-b45e4fed6797 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:06.646100 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-41898f73-a4d0-427a-97da-b45e4fed6797 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:06.646566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-41898f73-a4d0-427a-97da-b45e4fed6797 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:06.648481 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-41898f73-a4d0-427a-97da-b45e4fed6797 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:06.649982 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-41898f73-a4d0-427a-97da-b45e4fed6797 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:06.774563 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c487c458-1515-4e4a-9103-0a811b8aedf7 tempest-QuotaClassesAdminTestJSON-614280067 tempest-QuotaClassesAdminTestJSON-614280067-project-admin] Calling method '.version_select at 0x7f5e0b291280>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:06.775466 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:06.775466 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:06.845034 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-41898f73-a4d0-427a-97da-b45e4fed6797 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e629578143548dc8ba0cf77404c259b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48f95c0a90c463f809af1fcdf65da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:06.847351 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c487c458-1515-4e4a-9103-0a811b8aedf7 tempest-QuotaClassesAdminTestJSON-614280067 tempest-QuotaClassesAdminTestJSON-614280067-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.998604 Jul 12 11:50:06.848467 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 168/349] 10.222.0.50 () {58 vars in 1184 bytes} [Tue Jul 12 11:50:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:06.860949 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-41898f73-a4d0-427a-97da-b45e4fed6797 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 200 len: 1275 microversion: 2.1 time: 0.247875 Jul 12 11:50:06.864675 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-253060c2-08be-4465-b087-d39a4be5620f tempest-QuotaClassesAdminTestJSON-614280067 tempest-QuotaClassesAdminTestJSON-614280067-project-admin] Action: 'update', calling method: .version_select at 0x7f5e0b247280>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:06.865183 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 182/350] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:06 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 1275 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:06.874757 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:06.874757 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:07.621492 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-35ffb6ea-ffa6-4730-b621-1dedb3f5e2ee tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:07.622802 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-35ffb6ea-ffa6-4730-b621-1dedb3f5e2ee tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:07.630539 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35ffb6ea-ffa6-4730-b621-1dedb3f5e2ee tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:07.637218 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35ffb6ea-ffa6-4730-b621-1dedb3f5e2ee tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:07.639923 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35ffb6ea-ffa6-4730-b621-1dedb3f5e2ee tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:07.640616 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35ffb6ea-ffa6-4730-b621-1dedb3f5e2ee tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:07.687089 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-253060c2-08be-4465-b087-d39a4be5620f tempest-QuotaClassesAdminTestJSON-614280067 tempest-QuotaClassesAdminTestJSON-614280067-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.830188 Jul 12 11:50:07.698112 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 169/351] 10.222.0.50 () {60 vars in 1205 bytes} [Tue Jul 12 11:50:06 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:07.702894 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f6e3f43c-aa3c-4a22-a473-234abd660dfb tempest-QuotaClassesAdminTestJSON-614280067 tempest-QuotaClassesAdminTestJSON-614280067-project-admin] Calling method '.version_select at 0x7f5e0b27fa60>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:07.742631 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f6e3f43c-aa3c-4a22-a473-234abd660dfb tempest-QuotaClassesAdminTestJSON-614280067 tempest-QuotaClassesAdminTestJSON-614280067-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.043314 Jul 12 11:50:07.755552 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 170/352] 10.222.0.50 () {58 vars in 1184 bytes} [Tue Jul 12 11:50:07 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:07.764196 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-abeb60d4-95cb-4aab-bfa5-c0dbc123a3ce tempest-QuotaClassesAdminTestJSON-614280067 tempest-QuotaClassesAdminTestJSON-614280067-project-admin] Action: 'update', calling method: .version_select at 0x7f5e0beab670>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:07.804171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=15,nova_api:INSERT=12 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:08.046815 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-abeb60d4-95cb-4aab-bfa5-c0dbc123a3ce tempest-QuotaClassesAdminTestJSON-614280067 tempest-QuotaClassesAdminTestJSON-614280067-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.286331 Jul 12 11:50:08.051352 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 171/353] 10.222.0.50 () {60 vars in 1205 bytes} [Tue Jul 12 11:50:07 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:08.071823 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6c287626-8698-412e-bdac-76c42e7bf2e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:08.076962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6c287626-8698-412e-bdac-76c42e7bf2e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:08.126787 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6c287626-8698-412e-bdac-76c42e7bf2e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:08.128836 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6c287626-8698-412e-bdac-76c42e7bf2e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:08.129964 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6c287626-8698-412e-bdac-76c42e7bf2e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:08.131322 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6c287626-8698-412e-bdac-76c42e7bf2e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:08.475057 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-35ffb6ea-ffa6-4730-b621-1dedb3f5e2ee tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:08.484857 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-35ffb6ea-ffa6-4730-b621-1dedb3f5e2ee tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1476 microversion: 2.1 time: 0.867494 Jul 12 11:50:08.485625 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6c287626-8698-412e-bdac-76c42e7bf2e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e629578143548dc8ba0cf77404c259b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48f95c0a90c463f809af1fcdf65da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:08.485843 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 183/354] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:07 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1476 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:08.510786 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6c287626-8698-412e-bdac-76c42e7bf2e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 200 len: 1273 microversion: 2.1 time: 0.454087 Jul 12 11:50:08.512586 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 172/355] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:08 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 1273 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:09.503446 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a2106e1c-8a37-45e0-a5b2-b70ef2043b1f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:09.504075 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a2106e1c-8a37-45e0-a5b2-b70ef2043b1f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:09.524006 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a2106e1c-8a37-45e0-a5b2-b70ef2043b1f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:09.524494 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a2106e1c-8a37-45e0-a5b2-b70ef2043b1f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:09.533719 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a2106e1c-8a37-45e0-a5b2-b70ef2043b1f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:09.535931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a2106e1c-8a37-45e0-a5b2-b70ef2043b1f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:09.873392 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-837adf17-7d66-4919-8783-d69c80fa8e2f tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Calling method '.version_select at 0x7f5e0a731d30>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:09.874197 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:09.874197 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:09.875352 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-837adf17-7d66-4919-8783-d69c80fa8e2f tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:09.875804 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-837adf17-7d66-4919-8783-d69c80fa8e2f tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:09.920220 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-837adf17-7d66-4919-8783-d69c80fa8e2f tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:09.920563 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-837adf17-7d66-4919-8783-d69c80fa8e2f tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:09.936368 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-837adf17-7d66-4919-8783-d69c80fa8e2f tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:09.936825 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-837adf17-7d66-4919-8783-d69c80fa8e2f tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:09.944586 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-837adf17-7d66-4919-8783-d69c80fa8e2f tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.760676 Jul 12 11:50:09.945163 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 184/356] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:50:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:09.950341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-76a54deb-53d8-40f9-a735-019e78c74f7f tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:09.951090 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-76a54deb-53d8-40f9-a735-019e78c74f7f tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:09.959516 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76a54deb-53d8-40f9-a735-019e78c74f7f tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:09.959970 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76a54deb-53d8-40f9-a735-019e78c74f7f tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:09.967576 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76a54deb-53d8-40f9-a735-019e78c74f7f tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:09.968055 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76a54deb-53d8-40f9-a735-019e78c74f7f tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:10.236322 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a2106e1c-8a37-45e0-a5b2-b70ef2043b1f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:10.251956 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a2106e1c-8a37-45e0-a5b2-b70ef2043b1f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1476 microversion: 2.1 time: 0.752620 Jul 12 11:50:10.255783 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 173/357] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:09 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1476 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:10.575708 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-76a54deb-53d8-40f9-a735-019e78c74f7f tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e629578143548dc8ba0cf77404c259b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48f95c0a90c463f809af1fcdf65da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:10.615612 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6ce5e4b8-da1a-4e27-b21e-043b920389ca tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Calling method '.version_select at 0x7f5e0b21d040>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:10.617047 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:10.617047 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:10.618790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ce5e4b8-da1a-4e27-b21e-043b920389ca tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:10.620526 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ce5e4b8-da1a-4e27-b21e-043b920389ca tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:10.623556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ce5e4b8-da1a-4e27-b21e-043b920389ca tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:10.624145 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ce5e4b8-da1a-4e27-b21e-043b920389ca tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:10.631303 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-76a54deb-53d8-40f9-a735-019e78c74f7f tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 200 len: 1315 microversion: 2.1 time: 0.684827 Jul 12 11:50:10.631903 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 185/358] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:09 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:10.636705 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-af37b4b9-b2b5-44c3-9340-2f3e334eb121 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Calling method '.version_select at 0x7f5e0a71fca0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:10.637769 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:10.637769 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:10.639138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af37b4b9-b2b5-44c3-9340-2f3e334eb121 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:10.639763 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af37b4b9-b2b5-44c3-9340-2f3e334eb121 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:10.664008 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af37b4b9-b2b5-44c3-9340-2f3e334eb121 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:10.664920 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af37b4b9-b2b5-44c3-9340-2f3e334eb121 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:10.742138 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6ce5e4b8-da1a-4e27-b21e-043b920389ca tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.483877 Jul 12 11:50:10.742741 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 174/359] 10.222.0.50 () {58 vars in 1127 bytes} [Tue Jul 12 11:50:10 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:10.821504 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af37b4b9-b2b5-44c3-9340-2f3e334eb121 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:10.826108 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af37b4b9-b2b5-44c3-9340-2f3e334eb121 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:10.863373 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-af37b4b9-b2b5-44c3-9340-2f3e334eb121 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h2-849104-4/servers" status: 200 len: 196 microversion: 2.1 time: 0.227007 Jul 12 11:50:10.873377 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 186/360] 10.222.0.50 () {58 vars in 1211 bytes} [Tue Jul 12 11:50:10 2022] GET /compute/v2.1/os-hypervisors/n-h2-849104-4/servers => generated 196 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:10.934096 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9a7e63d0-ee05-4efb-8fff-df82f5882daa tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Calling method '.version_select at 0x7f5e0b27f310>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:10.935889 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:10.935889 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:10.937272 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9a7e63d0-ee05-4efb-8fff-df82f5882daa tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:10.937729 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9a7e63d0-ee05-4efb-8fff-df82f5882daa tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:10.939288 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9a7e63d0-ee05-4efb-8fff-df82f5882daa tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:10.943956 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9a7e63d0-ee05-4efb-8fff-df82f5882daa tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.032830 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9a7e63d0-ee05-4efb-8fff-df82f5882daa tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.288638 Jul 12 11:50:11.040723 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 175/361] 10.222.0.50 () {58 vars in 1127 bytes} [Tue Jul 12 11:50:10 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:11.054881 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4c05810d-433a-4b3e-be86-98b70bfc9704 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Calling method '.version_select at 0x7f5e0b23edc0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:11.057338 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:11.057338 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:11.061944 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4c05810d-433a-4b3e-be86-98b70bfc9704 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.062437 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4c05810d-433a-4b3e-be86-98b70bfc9704 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.098632 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4c05810d-433a-4b3e-be86-98b70bfc9704 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.099198 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4c05810d-433a-4b3e-be86-98b70bfc9704 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.137518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4c05810d-433a-4b3e-be86-98b70bfc9704 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.137963 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4c05810d-433a-4b3e-be86-98b70bfc9704 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.153004 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4c05810d-433a-4b3e-be86-98b70bfc9704 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.110878 Jul 12 11:50:11.154791 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 176/362] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:50:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:11.167637 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-fcb7f858-e1ff-4509-9f2f-c2796abeff38 req-6adba91a-1b19-4e24-ab4e-fa34f5f79555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b7d384-5f54-44be-9eda-4a88ee5280a5", "tag": "da388a5c-094b-414a-b7ad-78fcb21b53d4"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:11.190491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-fcb7f858-e1ff-4509-9f2f-c2796abeff38 req-6adba91a-1b19-4e24-ab4e-fa34f5f79555 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.191154 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-fcb7f858-e1ff-4509-9f2f-c2796abeff38 req-6adba91a-1b19-4e24-ab4e-fa34f5f79555 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.200761 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-85f3ec8c-405f-4c5d-ad4d-0e78a66d8d8a tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Calling method '.version_select at 0x7f5e0a7ac4c0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:11.202021 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:11.202021 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:11.203721 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-85f3ec8c-405f-4c5d-ad4d-0e78a66d8d8a tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '705fefc27c224b27b09e69fc091b141e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68da6b886d44f15926a021f02de8f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:11.205051 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-fcb7f858-e1ff-4509-9f2f-c2796abeff38 req-6adba91a-1b19-4e24-ab4e-fa34f5f79555 service nova] Creating event network-changed:da388a5c-094b-414a-b7ad-78fcb21b53d4 for instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 on n-h2-849104-4 Jul 12 11:50:11.212314 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-fcb7f858-e1ff-4509-9f2f-c2796abeff38 req-6adba91a-1b19-4e24-ab4e-fa34f5f79555 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055930 Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-85f3ec8c-405f-4c5d-ad4d-0e78a66d8d8a tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Request method failure captured: Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_ux-t5NlKjoY_Jo9aCpDNnj_4GgqA_pYmqd9c1QW-SHI-vove3tKKkr7oUQqGbI3H-i-kuAKrjySe2SJsK6MWK7xWGCgaHxzUznCu6JB9H0Sgu4cCUo1VAo-B61J9Ljpw0XwMv3-roK_MvpKTFaB3E5D6-Bi869_HD1fh8ikOD1Ss Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a68da6b886d44f15926a021f02de8f3f Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:50:11.212798 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:50:11.214254 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a68da6b886d44f15926a021f02de8f3f", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:11.214254 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:11.214254 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a68da6b886d44f15926a021f02de8f3f Jul 12 11:50:11.214254 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:11.214254 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HostsAdminNegativeTestJSON-2011992324-project Jul 12 11:50:11.214254 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:11.214254 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:11.214254 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 705fefc27c224b27b09e69fc091b141e Jul 12 11:50:11.214254 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2011992324-project Jul 12 11:50:11.214254 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:50:11.214254 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 12 11:50:11.214254 n-d-849104-4 devstack@n-api.service[125984]: action_args: {} Jul 12 11:50:11.214254 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:50:11.215119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 12 11:50:11.216600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.217835 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-85f3ec8c-405f-4c5d-ad4d-0e78a66d8d8a tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:11.218017 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 177/363] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:11.220886 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-85f3ec8c-405f-4c5d-ad4d-0e78a66d8d8a tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.341650 Jul 12 11:50:11.225414 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 187/364] 10.222.0.50 () {58 vars in 1127 bytes} [Tue Jul 12 11:50:10 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 347 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:11.235986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-94ce0fdf-b5d3-496c-af72-42975c532cf3 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Calling method '.version_select at 0x7f5e0b23ee50>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:11.241503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f55b63c5-4be3-446f-9477-576d9d8cc311 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Calling method '.version_select at 0x7f5e0a8b43a0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:11.242190 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:11.242190 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:11.243951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-94ce0fdf-b5d3-496c-af72-42975c532cf3 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.244467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-94ce0fdf-b5d3-496c-af72-42975c532cf3 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.244752 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:11.244752 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:11.245272 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-94ce0fdf-b5d3-496c-af72-42975c532cf3 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.245712 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-94ce0fdf-b5d3-496c-af72-42975c532cf3 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.248807 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f55b63c5-4be3-446f-9477-576d9d8cc311 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.249833 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f55b63c5-4be3-446f-9477-576d9d8cc311 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.261118 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:11.286497 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f55b63c5-4be3-446f-9477-576d9d8cc311 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.287678 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f55b63c5-4be3-446f-9477-576d9d8cc311 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.307532 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f55b63c5-4be3-446f-9477-576d9d8cc311 tempest-HypervisorAdminUnderV252Test-2057422549 tempest-HypervisorAdminUnderV252Test-2057422549-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h2-849104-4/search" status: 200 len: 104 microversion: 2.1 time: 0.077107 Jul 12 11:50:11.310120 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 188/365] 10.222.0.50 () {58 vars in 1208 bytes} [Tue Jul 12 11:50:11 2022] GET /compute/v2.1/os-hypervisors/n-h2-849104-4/search => generated 104 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:11.316621 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-94ce0fdf-b5d3-496c-af72-42975c532cf3 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.097224 Jul 12 11:50:11.317218 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 178/366] 10.222.0.50 () {58 vars in 1138 bytes} [Tue Jul 12 11:50:11 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:11.329696 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c4af7d42-5684-4cd5-9caf-b3516073945d tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Calling method '.version_select at 0x7f5e0a751b80>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:11.331462 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:11.331462 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:11.334969 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1e720b2d-c424-455c-add2-bf60df9b8584 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:11.335741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1e720b2d-c424-455c-add2-bf60df9b8584 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:11.336433 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c4af7d42-5684-4cd5-9caf-b3516073945d tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '705fefc27c224b27b09e69fc091b141e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68da6b886d44f15926a021f02de8f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c4af7d42-5684-4cd5-9caf-b3516073945d tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Request method failure captured: Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-hosts/n-d-849104-4/reboot HTTP/1.1 Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_ux-t5NlKjoY_Jo9aCpDNnj_4GgqA_pYmqd9c1QW-SHI-vove3tKKkr7oUQqGbI3H-i-kuAKrjySe2SJsK6MWK7xWGCgaHxzUznCu6JB9H0Sgu4cCUo1VAo-B61J9Ljpw0XwMv3-roK_MvpKTFaB3E5D6-Bi869_HD1fh8ikOD1Ss Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a68da6b886d44f15926a021f02de8f3f Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:50:11.338692 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:50:11.340187 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a68da6b886d44f15926a021f02de8f3f", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:11.340187 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:11.340187 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a68da6b886d44f15926a021f02de8f3f Jul 12 11:50:11.340187 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:11.340187 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HostsAdminNegativeTestJSON-2011992324-project Jul 12 11:50:11.340187 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:11.340187 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:11.340187 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 705fefc27c224b27b09e69fc091b141e Jul 12 11:50:11.340187 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2011992324-project Jul 12 11:50:11.340187 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:50:11.340187 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 12 11:50:11.340187 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'n-d-849104-4'} Jul 12 11:50:11.340187 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:50:11.341043 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 12 11:50:11.342288 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.347421 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c4af7d42-5684-4cd5-9caf-b3516073945d tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:11.348615 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c4af7d42-5684-4cd5-9caf-b3516073945d tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-849104-4/reboot" status: 403 len: 111 microversion: 2.1 time: 0.036074 Jul 12 11:50:11.353501 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 189/367] 10.222.0.50 () {58 vars in 1187 bytes} [Tue Jul 12 11:50:11 2022] GET /compute/v2.1/os-hosts/n-d-849104-4/reboot => generated 111 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:11.356976 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1e720b2d-c424-455c-add2-bf60df9b8584 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.357455 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1e720b2d-c424-455c-add2-bf60df9b8584 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.358248 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1e720b2d-c424-455c-add2-bf60df9b8584 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.358690 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1e720b2d-c424-455c-add2-bf60df9b8584 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.363773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-057d5f60-ec4f-470d-843a-3ddde224c1dd tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Calling method '.version_select at 0x7f5e0a751280>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:11.369723 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:11.369723 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:11.371427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-057d5f60-ec4f-470d-843a-3ddde224c1dd tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.372515 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-057d5f60-ec4f-470d-843a-3ddde224c1dd tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.375772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-057d5f60-ec4f-470d-843a-3ddde224c1dd tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.376435 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-057d5f60-ec4f-470d-843a-3ddde224c1dd tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.437290 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-057d5f60-ec4f-470d-843a-3ddde224c1dd tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.081692 Jul 12 11:50:11.444212 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 190/368] 10.222.0.50 () {58 vars in 1144 bytes} [Tue Jul 12 11:50:11 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:50:11.460853 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fc378962-21ed-433b-92cb-cebf3dec37cb tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Calling method '.version_select at 0x7f5e0a8b4040>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:11.461752 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:11.461752 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:11.480747 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-fc378962-21ed-433b-92cb-cebf3dec37cb tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fc378962-21ed-433b-92cb-cebf3dec37cb tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Request method failure captured: Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_xMIQbV3-LPbC4zSdmhvjmTRAISNXBVmUE0A8dNibBDjp4WcccGb6Zj5lsv7oFfedNI9RH_NzmVL7Slnft287wJsOSfIGOtPgM1PuzLuP_ucMymcnI1D6BHSLk28YyaVHWa1Xh40NyKtx5atO5oxYQzVrxn8oyah63VxUH_F5UMH4 Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:50:11.482454 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:50:11.483839 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72772cfdcfe441ca84b7b6d563346560", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:11.483839 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:11.483839 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:11.483839 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:11.483839 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:11.483839 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:11.483839 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:11.483839 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 57b7b6e10736483e9cbd9b62a6daf67d Jul 12 11:50:11.483839 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:11.483839 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:50:11.483839 n-d-849104-4 devstack@n-api.service[125984]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:11.483839 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'nonexistent_hostname'} Jul 12 11:50:11.483839 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:50:11.484857 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 12 11:50:11.486145 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:50:11.487909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:11.487909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.487909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:11.487909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.487909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:11.487909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:11.487909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:11.487909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:11.487909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:11.487909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:11.487909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.487909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fc378962-21ed-433b-92cb-cebf3dec37cb tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:11.487909 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fc378962-21ed-433b-92cb-cebf3dec37cb tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.044175 Jul 12 11:50:11.501056 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 191/369] 10.222.0.50 () {58 vars in 1211 bytes} [Tue Jul 12 11:50:11 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:50:11.511926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5c230ac8-4525-4c35-8734-9cd8ecb37d7e tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Calling method '.version_select at 0x7f5e0a751b80>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:11.513491 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:11.513491 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:11.514932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5c230ac8-4525-4c35-8734-9cd8ecb37d7e tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.515693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5c230ac8-4525-4c35-8734-9cd8ecb37d7e tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.516689 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5c230ac8-4525-4c35-8734-9cd8ecb37d7e tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.517623 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5c230ac8-4525-4c35-8734-9cd8ecb37d7e tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.570527 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5c230ac8-4525-4c35-8734-9cd8ecb37d7e tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.067433 Jul 12 11:50:11.571803 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 192/370] 10.222.0.50 () {58 vars in 1127 bytes} [Tue Jul 12 11:50:11 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:11.591237 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2f333c88-390c-48a7-a491-352921c17f8d tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Calling method '.version_select at 0x7f5e0a7514c0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:11.595560 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:11.595560 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:11.596888 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2f333c88-390c-48a7-a491-352921c17f8d tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '705fefc27c224b27b09e69fc091b141e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68da6b886d44f15926a021f02de8f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2f333c88-390c-48a7-a491-352921c17f8d tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Request method failure captured: Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-hosts/n-d-849104-4 HTTP/1.1 Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_ux-t5NlKjoY_Jo9aCpDNnj_4GgqA_pYmqd9c1QW-SHI-vove3tKKkr7oUQqGbI3H-i-kuAKrjySe2SJsK6MWK7xWGCgaHxzUznCu6JB9H0Sgu4cCUo1VAo-B61J9Ljpw0XwMv3-roK_MvpKTFaB3E5D6-Bi869_HD1fh8ikOD1Ss Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a68da6b886d44f15926a021f02de8f3f Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:50:11.598496 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:50:11.600222 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a68da6b886d44f15926a021f02de8f3f", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:11.600222 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:11.600222 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a68da6b886d44f15926a021f02de8f3f Jul 12 11:50:11.600222 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:11.600222 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HostsAdminNegativeTestJSON-2011992324-project Jul 12 11:50:11.600222 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:11.600222 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:11.600222 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 705fefc27c224b27b09e69fc091b141e Jul 12 11:50:11.600222 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2011992324-project Jul 12 11:50:11.600222 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:50:11.600222 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 12 11:50:11.600222 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'n-d-849104-4'} Jul 12 11:50:11.600222 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:50:11.601252 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 12 11:50:11.602361 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.603413 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2f333c88-390c-48a7-a491-352921c17f8d tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:11.603413 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2f333c88-390c-48a7-a491-352921c17f8d tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-849104-4" status: 403 len: 109 microversion: 2.1 time: 0.026058 Jul 12 11:50:11.603413 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 193/371] 10.222.0.50 () {58 vars in 1166 bytes} [Tue Jul 12 11:50:11 2022] GET /compute/v2.1/os-hosts/n-d-849104-4 => generated 109 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:11.620940 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-33288d1a-ca29-498d-a956-45bcc469cb77 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Calling method '.version_select at 0x7f5e0a7acdc0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:11.622845 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:11.622845 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:11.624554 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-33288d1a-ca29-498d-a956-45bcc469cb77 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.626730 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-33288d1a-ca29-498d-a956-45bcc469cb77 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.629170 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-33288d1a-ca29-498d-a956-45bcc469cb77 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.630603 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-33288d1a-ca29-498d-a956-45bcc469cb77 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.689042 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-33288d1a-ca29-498d-a956-45bcc469cb77 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.080830 Jul 12 11:50:11.696916 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 194/372] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Jul 12 11:50:11 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:11.701670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6e29545f-e061-484d-960e-5b26d019003f tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Calling method '.version_select at 0x7f5e0a8b4820>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:11.702657 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:11.702657 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:11.708775 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-6e29545f-e061-484d-960e-5b26d019003f tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6e29545f-e061-484d-960e-5b26d019003f tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Request method failure captured: Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_xMIQbV3-LPbC4zSdmhvjmTRAISNXBVmUE0A8dNibBDjp4WcccGb6Zj5lsv7oFfedNI9RH_NzmVL7Slnft287wJsOSfIGOtPgM1PuzLuP_ucMymcnI1D6BHSLk28YyaVHWa1Xh40NyKtx5atO5oxYQzVrxn8oyah63VxUH_F5UMH4 Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:50:11.710550 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:50:11.712002 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72772cfdcfe441ca84b7b6d563346560", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:11.712002 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:11.712002 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:11.712002 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:11.712002 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:11.712002 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:11.712002 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:11.712002 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 57b7b6e10736483e9cbd9b62a6daf67d Jul 12 11:50:11.712002 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:11.712002 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:50:11.712002 n-d-849104-4 devstack@n-api.service[125984]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:11.712002 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'nonexistent_hostname'} Jul 12 11:50:11.712002 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:11.712909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:11.714137 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:11.716018 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6e29545f-e061-484d-960e-5b26d019003f tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:11.717035 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6e29545f-e061-484d-960e-5b26d019003f tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.019007 Jul 12 11:50:11.718677 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 195/373] 10.222.0.50 () {58 vars in 1190 bytes} [Tue Jul 12 11:50:11 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:50:11.724185 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-56b100c8-f7ae-4117-aee0-a18f29b9c775 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:11.725000 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-56b100c8-f7ae-4117-aee0-a18f29b9c775 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:11.732567 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-56b100c8-f7ae-4117-aee0-a18f29b9c775 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.733191 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-56b100c8-f7ae-4117-aee0-a18f29b9c775 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:11.734160 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-56b100c8-f7ae-4117-aee0-a18f29b9c775 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:11.734768 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-56b100c8-f7ae-4117-aee0-a18f29b9c775 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:12.044702 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-56b100c8-f7ae-4117-aee0-a18f29b9c775 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e629578143548dc8ba0cf77404c259b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48f95c0a90c463f809af1fcdf65da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:12.060825 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-56b100c8-f7ae-4117-aee0-a18f29b9c775 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 200 len: 1315 microversion: 2.1 time: 0.338721 Jul 12 11:50:12.061676 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 196/374] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:11 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:12.081180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1405844b-531f-4fc0-96fd-44a616ded1bc tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Calling method '.version_select at 0x7f5e0a7ac790>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:12.082591 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:12.082591 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:12.083774 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1405844b-531f-4fc0-96fd-44a616ded1bc tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:12.084636 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1405844b-531f-4fc0-96fd-44a616ded1bc tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:12.085284 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1405844b-531f-4fc0-96fd-44a616ded1bc tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:12.085722 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1405844b-531f-4fc0-96fd-44a616ded1bc tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:12.140073 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1405844b-531f-4fc0-96fd-44a616ded1bc tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.074339 Jul 12 11:50:12.140682 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 197/375] 10.222.0.50 () {58 vars in 1127 bytes} [Tue Jul 12 11:50:12 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:12.154178 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d3bd926f-838a-4459-bf91-b754dad20226 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Calling method '.version_select at 0x7f5e0a71f5e0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:12.155013 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:12.155013 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:12.156136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d3bd926f-838a-4459-bf91-b754dad20226 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '705fefc27c224b27b09e69fc091b141e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68da6b886d44f15926a021f02de8f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d3bd926f-838a-4459-bf91-b754dad20226 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Request method failure captured: Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-hosts/n-d-849104-4/shutdown HTTP/1.1 Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_ux-t5NlKjoY_Jo9aCpDNnj_4GgqA_pYmqd9c1QW-SHI-vove3tKKkr7oUQqGbI3H-i-kuAKrjySe2SJsK6MWK7xWGCgaHxzUznCu6JB9H0Sgu4cCUo1VAo-B61J9Ljpw0XwMv3-roK_MvpKTFaB3E5D6-Bi869_HD1fh8ikOD1Ss Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a68da6b886d44f15926a021f02de8f3f Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:50:12.159745 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:50:12.161215 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a68da6b886d44f15926a021f02de8f3f", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:12.161215 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:12.161215 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a68da6b886d44f15926a021f02de8f3f Jul 12 11:50:12.161215 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:12.161215 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HostsAdminNegativeTestJSON-2011992324-project Jul 12 11:50:12.161215 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:12.161215 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:12.161215 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 705fefc27c224b27b09e69fc091b141e Jul 12 11:50:12.161215 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2011992324-project Jul 12 11:50:12.161215 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:50:12.161215 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 12 11:50:12.161215 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'n-d-849104-4'} Jul 12 11:50:12.161215 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:50:12.162064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 12 11:50:12.163294 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.164414 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d3bd926f-838a-4459-bf91-b754dad20226 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:12.164414 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d3bd926f-838a-4459-bf91-b754dad20226 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-849104-4/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.021317 Jul 12 11:50:12.172543 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 198/376] 10.222.0.50 () {58 vars in 1193 bytes} [Tue Jul 12 11:50:12 2022] GET /compute/v2.1/os-hosts/n-d-849104-4/shutdown => generated 113 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:12.178931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-51f8404a-f663-4e81-a3d7-3cbf83f3cb99 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Calling method '.version_select at 0x7f5e0a8b4670>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:12.179749 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:12.179749 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:12.191181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51f8404a-f663-4e81-a3d7-3cbf83f3cb99 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:12.191850 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51f8404a-f663-4e81-a3d7-3cbf83f3cb99 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:12.233966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1e720b2d-c424-455c-add2-bf60df9b8584 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:12.254604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51f8404a-f663-4e81-a3d7-3cbf83f3cb99 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:12.254604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51f8404a-f663-4e81-a3d7-3cbf83f3cb99 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:12.267602 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1e720b2d-c424-455c-add2-bf60df9b8584 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1476 microversion: 2.1 time: 0.949070 Jul 12 11:50:12.285681 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-51f8404a-f663-4e81-a3d7-3cbf83f3cb99 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-h1-849104-4" status: 200 len: 467 microversion: 2.1 time: 0.111199 Jul 12 11:50:12.286251 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 199/378] 10.222.0.50 () {58 vars in 1169 bytes} [Tue Jul 12 11:50:12 2022] GET /compute/v2.1/os-hosts/n-h1-849104-4 => generated 467 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:12.286379 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 179/378] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:11 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1476 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:12.294954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7bca6c76-f8cb-4e63-863f-dee68623eb75 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Calling method '.version_select at 0x7f5e0b23e790>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:12.300010 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:12.300010 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:12.309998 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ef13683f-607d-4698-8252-53eb5d33a717 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Calling method '.version_select at 0x7f5e0abf1820>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:12.317958 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:12.317958 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:12.323364 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-7bca6c76-f8cb-4e63-863f-dee68623eb75 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7bca6c76-f8cb-4e63-863f-dee68623eb75 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Request method failure captured: Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_xMIQbV3-LPbC4zSdmhvjmTRAISNXBVmUE0A8dNibBDjp4WcccGb6Zj5lsv7oFfedNI9RH_NzmVL7Slnft287wJsOSfIGOtPgM1PuzLuP_ucMymcnI1D6BHSLk28YyaVHWa1Xh40NyKtx5atO5oxYQzVrxn8oyah63VxUH_F5UMH4 Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:50:12.325766 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:50:12.326987 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72772cfdcfe441ca84b7b6d563346560", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:12.326987 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.326987 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:12.326987 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.326987 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:12.326987 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:50:12.326987 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:50:12.326987 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 57b7b6e10736483e9cbd9b62a6daf67d Jul 12 11:50:12.326987 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:12.326987 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:50:12.326987 n-d-849104-4 devstack@n-api.service[125983]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.326987 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'nonexistent_hostname'} Jul 12 11:50:12.326987 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:50:12.327725 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 12 11:50:12.329044 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:50:12.335552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.335552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.335552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.335552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.335552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.335552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.335552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.335552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:12.335552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:12.335552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.335552 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.335552 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7bca6c76-f8cb-4e63-863f-dee68623eb75 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:12.337787 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ef13683f-607d-4698-8252-53eb5d33a717 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:12.337883 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7bca6c76-f8cb-4e63-863f-dee68623eb75 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.036280 Jul 12 11:50:12.337965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ef13683f-607d-4698-8252-53eb5d33a717 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:12.338038 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 180/379] 10.222.0.50 () {58 vars in 1217 bytes} [Tue Jul 12 11:50:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:50:12.338038 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d370cb59-592d-4b41-b191-4f2b931af564 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Calling method '.version_select at 0x7f5e0b21da60>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:12.339268 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:12.339268 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:12.353110 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d370cb59-592d-4b41-b191-4f2b931af564 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '705fefc27c224b27b09e69fc091b141e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68da6b886d44f15926a021f02de8f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d370cb59-592d-4b41-b191-4f2b931af564 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Request method failure captured: Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-hosts/n-d-849104-4/startup HTTP/1.1 Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_ux-t5NlKjoY_Jo9aCpDNnj_4GgqA_pYmqd9c1QW-SHI-vove3tKKkr7oUQqGbI3H-i-kuAKrjySe2SJsK6MWK7xWGCgaHxzUznCu6JB9H0Sgu4cCUo1VAo-B61J9Ljpw0XwMv3-roK_MvpKTFaB3E5D6-Bi869_HD1fh8ikOD1Ss Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: a68da6b886d44f15926a021f02de8f3f Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:50:12.354515 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:50:12.355660 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a68da6b886d44f15926a021f02de8f3f", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:12.355660 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:12.355660 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: a68da6b886d44f15926a021f02de8f3f Jul 12 11:50:12.355660 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:12.355660 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-HostsAdminNegativeTestJSON-2011992324-project Jul 12 11:50:12.355660 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:50:12.355660 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:50:12.355660 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 705fefc27c224b27b09e69fc091b141e Jul 12 11:50:12.355660 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2011992324-project Jul 12 11:50:12.355660 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:50:12.355660 n-d-849104-4 devstack@n-api.service[125983]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 12 11:50:12.355660 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'n-d-849104-4'} Jul 12 11:50:12.355660 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:50:12.357054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 12 11:50:12.358104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.360318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d370cb59-592d-4b41-b191-4f2b931af564 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:12.360318 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d370cb59-592d-4b41-b191-4f2b931af564 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-849104-4/startup" status: 403 len: 110 microversion: 2.1 time: 0.021754 Jul 12 11:50:12.360318 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 181/380] 10.222.0.50 () {58 vars in 1190 bytes} [Tue Jul 12 11:50:12 2022] GET /compute/v2.1/os-hosts/n-d-849104-4/startup => generated 110 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:12.365394 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ef13683f-607d-4698-8252-53eb5d33a717 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:12.366121 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ef13683f-607d-4698-8252-53eb5d33a717 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:12.367171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0b04914a-4e88-4cfe-aeaf-8b2ff561e752 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Calling method '.version_select at 0x7f5e0beab0d0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:12.391096 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ef13683f-607d-4698-8252-53eb5d33a717 tempest-HostsAdminTestJSON-1023471924 tempest-HostsAdminTestJSON-1023471924-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-h2-849104-4" status: 200 len: 467 microversion: 2.1 time: 0.093816 Jul 12 11:50:12.391698 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 200/381] 10.222.0.50 () {58 vars in 1169 bytes} [Tue Jul 12 11:50:12 2022] GET /compute/v2.1/os-hosts/n-h2-849104-4 => generated 467 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:12.391891 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-0b04914a-4e88-4cfe-aeaf-8b2ff561e752 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0b04914a-4e88-4cfe-aeaf-8b2ff561e752 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Request method failure captured: Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_xMIQbV3-LPbC4zSdmhvjmTRAISNXBVmUE0A8dNibBDjp4WcccGb6Zj5lsv7oFfedNI9RH_NzmVL7Slnft287wJsOSfIGOtPgM1PuzLuP_ucMymcnI1D6BHSLk28YyaVHWa1Xh40NyKtx5atO5oxYQzVrxn8oyah63VxUH_F5UMH4 Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:50:12.394573 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:50:12.395885 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72772cfdcfe441ca84b7b6d563346560", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:12.395885 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.395885 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:12.395885 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.395885 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:12.395885 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:50:12.395885 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:50:12.395885 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 57b7b6e10736483e9cbd9b62a6daf67d Jul 12 11:50:12.395885 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:12.395885 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:50:12.395885 n-d-849104-4 devstack@n-api.service[125983]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.395885 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'nonexistent_hostname'} Jul 12 11:50:12.395885 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:50:12.396631 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 12 11:50:12.397625 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:50:12.398640 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.398640 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.398640 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.398640 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.398640 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.398640 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.398640 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.398640 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:12.398640 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:12.398640 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.398640 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.398640 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0b04914a-4e88-4cfe-aeaf-8b2ff561e752 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:12.398640 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0b04914a-4e88-4cfe-aeaf-8b2ff561e752 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.033439 Jul 12 11:50:12.398640 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 182/382] 10.222.0.50 () {58 vars in 1214 bytes} [Tue Jul 12 11:50:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 12 11:50:12.408152 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cb9319f7-d728-4550-81f6-1e6f4d6d27d0 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Action: 'update', calling method: .version_select at 0x7f5e0a899b80>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cb9319f7-d728-4550-81f6-1e6f4d6d27d0 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Request method failure captured: Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: request: PUT /compute/v2.1/os-hosts/n-d-849104-4 HTTP/1.1 Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 51 Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_xMIQbV3-LPbC4zSdmhvjmTRAISNXBVmUE0A8dNibBDjp4WcccGb6Zj5lsv7oFfedNI9RH_NzmVL7Slnft287wJsOSfIGOtPgM1PuzLuP_ucMymcnI1D6BHSLk28YyaVHWa1Xh40NyKtx5atO5oxYQzVrxn8oyah63VxUH_F5UMH4 Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:50:12.410830 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:50:12.413479 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72772cfdcfe441ca84b7b6d563346560", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:12.413479 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.413479 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:12.413479 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.413479 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:12.413479 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:12.413479 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:12.413479 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 57b7b6e10736483e9cbd9b62a6daf67d Jul 12 11:50:12.413479 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:12.413479 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:50:12.413479 n-d-849104-4 devstack@n-api.service[125984]: {"status": "enable", "maintenance_mode": "invalid"} Jul 12 11:50:12.413479 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:50:12.413479 n-d-849104-4 devstack@n-api.service[125984]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'n-d-849104-4', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise error Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'disable', Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'Enable', Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'Disable', Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi On instance: Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'invalid' Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.414778 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.418041 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.420620 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.420620 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 11:50:12.420620 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 11:50:12.420620 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 12 11:50:12.420620 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.420620 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cb9319f7-d728-4550-81f6-1e6f4d6d27d0 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:12.420620 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cb9319f7-d728-4550-81f6-1e6f4d6d27d0 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-849104-4" status: 400 len: 199 microversion: 2.1 time: 0.008414 Jul 12 11:50:12.420620 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 201/383] 10.222.0.50 () {60 vars in 1186 bytes} [Tue Jul 12 11:50:12 2022] PUT /compute/v2.1/os-hosts/n-d-849104-4 => generated 199 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:50:12.423609 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-be8ef0c6-27a7-425f-abb7-1e9a4709395d tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Action: 'update', calling method: .version_select at 0x7f5e0b23e790>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-be8ef0c6-27a7-425f-abb7-1e9a4709395d tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Request method failure captured: Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: request: PUT /compute/v2.1/os-hosts/n-d-849104-4 HTTP/1.1 Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 51 Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_xMIQbV3-LPbC4zSdmhvjmTRAISNXBVmUE0A8dNibBDjp4WcccGb6Zj5lsv7oFfedNI9RH_NzmVL7Slnft287wJsOSfIGOtPgM1PuzLuP_ucMymcnI1D6BHSLk28YyaVHWa1Xh40NyKtx5atO5oxYQzVrxn8oyah63VxUH_F5UMH4 Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:50:12.435557 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:50:12.437166 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72772cfdcfe441ca84b7b6d563346560", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:12.437166 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.437166 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:12.437166 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.437166 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:12.437166 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:50:12.437166 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:50:12.437166 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 57b7b6e10736483e9cbd9b62a6daf67d Jul 12 11:50:12.437166 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:12.437166 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:50:12.437166 n-d-849104-4 devstack@n-api.service[125983]: {"status": "invalid", "maintenance_mode": "enable"} Jul 12 11:50:12.437166 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:50:12.437166 n-d-849104-4 devstack@n-api.service[125983]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'n-d-849104-4', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise error Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'disable', Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'Enable', Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'Disable', Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi On instance: Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'invalid' Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.438058 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.440315 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.441554 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.441554 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 11:50:12.441554 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 11:50:12.441554 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 12 11:50:12.441554 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.446624 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-be8ef0c6-27a7-425f-abb7-1e9a4709395d tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:12.449679 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-be8ef0c6-27a7-425f-abb7-1e9a4709395d tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-849104-4" status: 400 len: 189 microversion: 2.1 time: 0.030818 Jul 12 11:50:12.450811 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 183/384] 10.222.0.50 () {60 vars in 1186 bytes} [Tue Jul 12 11:50:12 2022] PUT /compute/v2.1/os-hosts/n-d-849104-4 => generated 189 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:50:12.460718 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c63b3a73-0a23-4804-baca-f4fb72e8be17 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Action: 'update', calling method: .version_select at 0x7f5e0a775c10>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:12.465552 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:12.465552 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:12.466894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c63b3a73-0a23-4804-baca-f4fb72e8be17 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '705fefc27c224b27b09e69fc091b141e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68da6b886d44f15926a021f02de8f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c63b3a73-0a23-4804-baca-f4fb72e8be17 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Request method failure captured: Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: request: PUT /compute/v2.1/os-hosts/n-d-849104-4 HTTP/1.1 Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 50 Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_ux-t5NlKjoY_Jo9aCpDNnj_4GgqA_pYmqd9c1QW-SHI-vove3tKKkr7oUQqGbI3H-i-kuAKrjySe2SJsK6MWK7xWGCgaHxzUznCu6JB9H0Sgu4cCUo1VAo-B61J9Ljpw0XwMv3-roK_MvpKTFaB3E5D6-Bi869_HD1fh8ikOD1Ss Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a68da6b886d44f15926a021f02de8f3f Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:50:12.468613 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:50:12.469981 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a68da6b886d44f15926a021f02de8f3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a68da6b886d44f15926a021f02de8f3f", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:12.469981 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:12.469981 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a68da6b886d44f15926a021f02de8f3f Jul 12 11:50:12.469981 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2011992324 Jul 12 11:50:12.469981 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HostsAdminNegativeTestJSON-2011992324-project Jul 12 11:50:12.469981 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:12.469981 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:12.469981 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 705fefc27c224b27b09e69fc091b141e Jul 12 11:50:12.469981 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2011992324-project Jul 12 11:50:12.469981 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:50:12.469981 n-d-849104-4 devstack@n-api.service[125984]: {"status": "enable", "maintenance_mode": "enable"} Jul 12 11:50:12.469981 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:50:12.469981 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 12 11:50:12.469981 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'n-d-849104-4', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:50:12.471026 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 12 11:50:12.472407 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.474996 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c63b3a73-0a23-4804-baca-f4fb72e8be17 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:12.474996 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c63b3a73-0a23-4804-baca-f4fb72e8be17 tempest-HostsAdminNegativeTestJSON-2011992324 tempest-HostsAdminNegativeTestJSON-2011992324-project] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-849104-4" status: 403 len: 111 microversion: 2.1 time: 0.017567 Jul 12 11:50:12.478962 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 202/385] 10.222.0.50 () {60 vars in 1186 bytes} [Tue Jul 12 11:50:12 2022] PUT /compute/v2.1/os-hosts/n-d-849104-4 => generated 111 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:12.489103 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7b3d2d5c-91ae-419a-8d79-88e95cdd8a41 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Action: 'update', calling method: .version_select at 0x7f5e0b1d3310>, body: {"status": null, "maintenance_mode": null} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7b3d2d5c-91ae-419a-8d79-88e95cdd8a41 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Request method failure captured: Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: request: PUT /compute/v2.1/os-hosts/n-d-849104-4 HTTP/1.1 Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 42 Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_xMIQbV3-LPbC4zSdmhvjmTRAISNXBVmUE0A8dNibBDjp4WcccGb6Zj5lsv7oFfedNI9RH_NzmVL7Slnft287wJsOSfIGOtPgM1PuzLuP_ucMymcnI1D6BHSLk28YyaVHWa1Xh40NyKtx5atO5oxYQzVrxn8oyah63VxUH_F5UMH4 Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:50:12.495419 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:50:12.496749 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72772cfdcfe441ca84b7b6d563346560", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:12.496749 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.496749 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:12.496749 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.496749 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:12.496749 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:50:12.496749 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:50:12.496749 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 57b7b6e10736483e9cbd9b62a6daf67d Jul 12 11:50:12.496749 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:12.496749 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:50:12.496749 n-d-849104-4 devstack@n-api.service[125983]: {"status": null, "maintenance_mode": null} Jul 12 11:50:12.496749 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:50:12.496749 n-d-849104-4 devstack@n-api.service[125983]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 12 11:50:12.496749 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'n-d-849104-4', 'body': {'status': None, 'maintenance_mode': None}} Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise error Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'disable', Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'Enable', Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'Disable', Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi On instance: Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi None Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.497633 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.499296 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.500425 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 11:50:12.500425 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 11:50:12.500425 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 12 11:50:12.500425 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.501736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7b3d2d5c-91ae-419a-8d79-88e95cdd8a41 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:12.503458 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7b3d2d5c-91ae-419a-8d79-88e95cdd8a41 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-849104-4" status: 400 len: 127 microversion: 2.1 time: 0.019390 Jul 12 11:50:12.504744 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 184/386] 10.222.0.50 () {60 vars in 1186 bytes} [Tue Jul 12 11:50:12 2022] PUT /compute/v2.1/os-hosts/n-d-849104-4 => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:50:12.522217 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-df7b001f-109f-41a7-a2df-2f292ff321d3 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Action: 'update', calling method: .version_select at 0x7f5e0ab2e0d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:12.525102 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.hosts [None req-df7b001f-109f-41a7-a2df-2f292ff321d3 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Enabling host nonexistent_hostname. Jul 12 11:50:12.535546 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-df7b001f-109f-41a7-a2df-2f292ff321d3 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-df7b001f-109f-41a7-a2df-2f292ff321d3 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Request method failure captured: Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 50 Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_xMIQbV3-LPbC4zSdmhvjmTRAISNXBVmUE0A8dNibBDjp4WcccGb6Zj5lsv7oFfedNI9RH_NzmVL7Slnft287wJsOSfIGOtPgM1PuzLuP_ucMymcnI1D6BHSLk28YyaVHWa1Xh40NyKtx5atO5oxYQzVrxn8oyah63VxUH_F5UMH4 Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:50:12.537784 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:50:12.539184 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72772cfdcfe441ca84b7b6d563346560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72772cfdcfe441ca84b7b6d563346560", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:12.539184 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.539184 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 72772cfdcfe441ca84b7b6d563346560 Jul 12 11:50:12.539184 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-774566090 Jul 12 11:50:12.539184 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:12.539184 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:12.539184 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:12.539184 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 57b7b6e10736483e9cbd9b62a6daf67d Jul 12 11:50:12.539184 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HostsAdminNegativeTestJSON-774566090-project-admin Jul 12 11:50:12.539184 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:50:12.539184 n-d-849104-4 devstack@n-api.service[125984]: {"status": "enable", "maintenance_mode": "enable"} Jul 12 11:50:12.539184 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:50:12.539184 n-d-849104-4 devstack@n-api.service[125984]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.539184 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 12 11:50:12.539980 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:50:12.541441 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:12.542730 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-df7b001f-109f-41a7-a2df-2f292ff321d3 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:12.543764 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-df7b001f-109f-41a7-a2df-2f292ff321d3 tempest-HostsAdminNegativeTestJSON-774566090 tempest-HostsAdminNegativeTestJSON-774566090-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.029240 Jul 12 11:50:12.543764 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 203/387] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Jul 12 11:50:12 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:50:13.080213 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a02448e0-01ae-4acb-964f-664befe8da36 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:13.081852 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a02448e0-01ae-4acb-964f-664befe8da36 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:13.100760 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a02448e0-01ae-4acb-964f-664befe8da36 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:13.101522 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a02448e0-01ae-4acb-964f-664befe8da36 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:13.105314 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a02448e0-01ae-4acb-964f-664befe8da36 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:13.107378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a02448e0-01ae-4acb-964f-664befe8da36 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:13.293436 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-af1d8fb2-0ec6-4ac0-9c8d-1e9234c1f4cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:13.294410 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-af1d8fb2-0ec6-4ac0-9c8d-1e9234c1f4cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:13.311182 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af1d8fb2-0ec6-4ac0-9c8d-1e9234c1f4cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:13.311580 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af1d8fb2-0ec6-4ac0-9c8d-1e9234c1f4cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:13.314228 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af1d8fb2-0ec6-4ac0-9c8d-1e9234c1f4cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:13.316436 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af1d8fb2-0ec6-4ac0-9c8d-1e9234c1f4cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:13.590866 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a02448e0-01ae-4acb-964f-664befe8da36 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e629578143548dc8ba0cf77404c259b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48f95c0a90c463f809af1fcdf65da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:13.604158 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a02448e0-01ae-4acb-964f-664befe8da36 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 200 len: 1315 microversion: 2.1 time: 0.528838 Jul 12 11:50:13.621896 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 185/388] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:13 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:14.252636 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-af1d8fb2-0ec6-4ac0-9c8d-1e9234c1f4cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:14.261422 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-af1d8fb2-0ec6-4ac0-9c8d-1e9234c1f4cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1476 microversion: 2.1 time: 0.973089 Jul 12 11:50:14.273171 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 204/389] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:13 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1476 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:14.631294 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-52e841ae-e90d-4bed-8dcc-c7e0f98c58d9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:14.631927 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-52e841ae-e90d-4bed-8dcc-c7e0f98c58d9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:14.639848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-52e841ae-e90d-4bed-8dcc-c7e0f98c58d9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:14.640345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-52e841ae-e90d-4bed-8dcc-c7e0f98c58d9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:14.641311 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-52e841ae-e90d-4bed-8dcc-c7e0f98c58d9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:14.641911 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-52e841ae-e90d-4bed-8dcc-c7e0f98c58d9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:15.007563 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-52e841ae-e90d-4bed-8dcc-c7e0f98c58d9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e629578143548dc8ba0cf77404c259b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48f95c0a90c463f809af1fcdf65da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:15.017426 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-52e841ae-e90d-4bed-8dcc-c7e0f98c58d9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 200 len: 1315 microversion: 2.1 time: 0.391657 Jul 12 11:50:15.029265 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 186/390] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:14 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:15.290314 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6c10f523-26a6-4a65-9f33-706d70c040f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:15.291685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6c10f523-26a6-4a65-9f33-706d70c040f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:15.295287 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=8 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:15.303844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c10f523-26a6-4a65-9f33-706d70c040f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:15.305844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c10f523-26a6-4a65-9f33-706d70c040f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:15.306876 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c10f523-26a6-4a65-9f33-706d70c040f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:15.310243 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c10f523-26a6-4a65-9f33-706d70c040f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:15.697140 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6c10f523-26a6-4a65-9f33-706d70c040f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:15.716267 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6c10f523-26a6-4a65-9f33-706d70c040f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1476 microversion: 2.1 time: 0.428980 Jul 12 11:50:15.717651 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 205/391] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:15 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1476 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:16.034982 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-01c2ac8b-6fc1-4ef1-9583-4b2b921c8f6c tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:16.035674 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-01c2ac8b-6fc1-4ef1-9583-4b2b921c8f6c tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:16.043573 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-01c2ac8b-6fc1-4ef1-9583-4b2b921c8f6c tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:16.043968 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-01c2ac8b-6fc1-4ef1-9583-4b2b921c8f6c tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:16.044792 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-01c2ac8b-6fc1-4ef1-9583-4b2b921c8f6c tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:16.045229 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-01c2ac8b-6fc1-4ef1-9583-4b2b921c8f6c tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:16.483065 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-a08ee8db-61eb-4b9c-82f5-d654c36f6c80 req-24605e25-452c-479d-8075-06e59a824467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b7d384-5f54-44be-9eda-4a88ee5280a5", "name": "network-vif-plugged", "status": "completed", "tag": "da388a5c-094b-414a-b7ad-78fcb21b53d4"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:16.503242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-a08ee8db-61eb-4b9c-82f5-d654c36f6c80 req-24605e25-452c-479d-8075-06e59a824467 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:16.503686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-a08ee8db-61eb-4b9c-82f5-d654c36f6c80 req-24605e25-452c-479d-8075-06e59a824467 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:16.535203 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-a08ee8db-61eb-4b9c-82f5-d654c36f6c80 req-24605e25-452c-479d-8075-06e59a824467 service nova] Creating event network-vif-plugged:da388a5c-094b-414a-b7ad-78fcb21b53d4 for instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 on n-h2-849104-4 Jul 12 11:50:16.554012 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-a08ee8db-61eb-4b9c-82f5-d654c36f6c80 req-24605e25-452c-479d-8075-06e59a824467 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074590 Jul 12 11:50:16.554624 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 206/392] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:50:16.734165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-689f71f2-9081-4ad2-8415-4836a8c2eae5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:16.735273 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-689f71f2-9081-4ad2-8415-4836a8c2eae5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:16.737559 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:16.746441 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-689f71f2-9081-4ad2-8415-4836a8c2eae5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:16.753294 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-689f71f2-9081-4ad2-8415-4836a8c2eae5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:16.754365 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-689f71f2-9081-4ad2-8415-4836a8c2eae5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:16.754973 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-689f71f2-9081-4ad2-8415-4836a8c2eae5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:16.811688 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-01c2ac8b-6fc1-4ef1-9583-4b2b921c8f6c tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e629578143548dc8ba0cf77404c259b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48f95c0a90c463f809af1fcdf65da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:16.820343 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-01c2ac8b-6fc1-4ef1-9583-4b2b921c8f6c tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 200 len: 1315 microversion: 2.1 time: 0.789780 Jul 12 11:50:16.820935 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 187/393] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:16 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 1315 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:17.639420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-689f71f2-9081-4ad2-8415-4836a8c2eae5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:17.650391 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-689f71f2-9081-4ad2-8415-4836a8c2eae5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1476 microversion: 2.1 time: 0.920791 Jul 12 11:50:17.658839 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 207/394] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:16 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1476 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:17.841823 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fabb03ef-9fbd-4631-abd9-f7158081b144 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:17.842663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fabb03ef-9fbd-4631-abd9-f7158081b144 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:17.864132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fabb03ef-9fbd-4631-abd9-f7158081b144 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:17.866078 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fabb03ef-9fbd-4631-abd9-f7158081b144 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:17.867737 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fabb03ef-9fbd-4631-abd9-f7158081b144 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:17.869709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fabb03ef-9fbd-4631-abd9-f7158081b144 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:18.018854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2101604733", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:18.066424 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=44,nova_cell0:UPDATE=12 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:18.163174 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] validate_networks() for None {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:50:18.275859 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fabb03ef-9fbd-4631-abd9-f7158081b144 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e629578143548dc8ba0cf77404c259b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48f95c0a90c463f809af1fcdf65da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:18.286702 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fabb03ef-9fbd-4631-abd9-f7158081b144 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 200 len: 1315 microversion: 2.1 time: 0.452189 Jul 12 11:50:18.291320 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 208/395] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:17 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:18.594492 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:50:18.594813 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:50:18.595291 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:50:18.596312 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:50:18.596734 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:50:18.636820 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:18.640165 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:18.641134 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:18.641582 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:18.683472 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-35600206-370c-42e9-90f2-da9cf44249b1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:18.685035 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-35600206-370c-42e9-90f2-da9cf44249b1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:18.704229 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35600206-370c-42e9-90f2-da9cf44249b1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:18.705586 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Getting quotas for project 9e002ce28f634fce8ba26179a838e06f. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:18.707742 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35600206-370c-42e9-90f2-da9cf44249b1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:18.708905 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35600206-370c-42e9-90f2-da9cf44249b1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:18.715544 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35600206-370c-42e9-90f2-da9cf44249b1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:18.720207 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Getting quotas for user d4a0531e6f154ebda9d67aa23bce427f and project 9e002ce28f634fce8ba26179a838e06f. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:18.756552 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:50:18.759281 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:50:18.852078 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-199866d6-c369-4078-9e93-77f2fc4266cd tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466837 Jul 12 11:50:18.853053 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 188/396] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:50:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:50:18.863694 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-98925069-c311-415f-b502-a17bfe19127d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:18.872078 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-98925069-c311-415f-b502-a17bfe19127d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:19.542173 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-98925069-c311-415f-b502-a17bfe19127d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:19.592072 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-98925069-c311-415f-b502-a17bfe19127d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1223 microversion: 2.1 time: 0.715989 Jul 12 11:50:19.603887 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 189/397] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:18 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1223 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:19.614935 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4a2ab1e2-b8a4-4666-8d8a-f01121f7a8c2 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:19.616870 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4a2ab1e2-b8a4-4666-8d8a-f01121f7a8c2 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:19.625117 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4a2ab1e2-b8a4-4666-8d8a-f01121f7a8c2 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:19.626529 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4a2ab1e2-b8a4-4666-8d8a-f01121f7a8c2 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:19.628175 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4a2ab1e2-b8a4-4666-8d8a-f01121f7a8c2 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:19.628824 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4a2ab1e2-b8a4-4666-8d8a-f01121f7a8c2 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:19.655762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-35600206-370c-42e9-90f2-da9cf44249b1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:19.668833 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-35600206-370c-42e9-90f2-da9cf44249b1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1476 microversion: 2.1 time: 0.989364 Jul 12 11:50:19.673741 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 209/398] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:18 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1476 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:19.957202 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4a2ab1e2-b8a4-4666-8d8a-f01121f7a8c2 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e629578143548dc8ba0cf77404c259b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48f95c0a90c463f809af1fcdf65da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:19.965749 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4a2ab1e2-b8a4-4666-8d8a-f01121f7a8c2 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 200 len: 1502 microversion: 2.1 time: 0.360667 Jul 12 11:50:19.969300 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 190/399] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:19 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 1502 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:19.986838 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-19a7e3fd-167a-4466-bcd3-36e98447ce89 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:19.988182 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-19a7e3fd-167a-4466-bcd3-36e98447ce89 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:19.998717 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-19a7e3fd-167a-4466-bcd3-36e98447ce89 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:20.000792 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-19a7e3fd-167a-4466-bcd3-36e98447ce89 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:20.002951 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-19a7e3fd-167a-4466-bcd3-36e98447ce89 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:20.009974 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-19a7e3fd-167a-4466-bcd3-36e98447ce89 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:20.088958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-19a7e3fd-167a-4466-bcd3-36e98447ce89 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:50:20.341262 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-19a7e3fd-167a-4466-bcd3-36e98447ce89 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "DELETE /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 204 len: 0 microversion: 2.1 time: 0.358144 Jul 12 11:50:20.346609 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 210/400] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:50:19 2022] DELETE /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:50:20.360186 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-962d0c33-a441-4904-aad4-5e0a5fa71f8a tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:20.362368 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-962d0c33-a441-4904-aad4-5e0a5fa71f8a tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:20.378427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-962d0c33-a441-4904-aad4-5e0a5fa71f8a tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:20.384331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-962d0c33-a441-4904-aad4-5e0a5fa71f8a tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:20.388482 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-962d0c33-a441-4904-aad4-5e0a5fa71f8a tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:20.390379 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-962d0c33-a441-4904-aad4-5e0a5fa71f8a tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:20.813490 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-476179002", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:20.967037 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-962d0c33-a441-4904-aad4-5e0a5fa71f8a tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e629578143548dc8ba0cf77404c259b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48f95c0a90c463f809af1fcdf65da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:20.976653 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-962d0c33-a441-4904-aad4-5e0a5fa71f8a tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 200 len: 1508 microversion: 2.1 time: 0.625922 Jul 12 11:50:20.980625 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] validate_networks() for None {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:50:21.000145 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 211/401] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:20 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 1508 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:21.016589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b7cd2f3c-9a5a-421a-bf1b-6161ed15e103 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:21.020383 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b7cd2f3c-9a5a-421a-bf1b-6161ed15e103 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:21.037947 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7cd2f3c-9a5a-421a-bf1b-6161ed15e103 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:21.047029 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7cd2f3c-9a5a-421a-bf1b-6161ed15e103 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:21.047991 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7cd2f3c-9a5a-421a-bf1b-6161ed15e103 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:21.048984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7cd2f3c-9a5a-421a-bf1b-6161ed15e103 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:21.659415 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:50:21.660367 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:50:21.662692 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:50:21.663413 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:50:21.665433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:50:21.681008 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:21.681936 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:21.685088 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:21.685779 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:21.734378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Getting quotas for project 8fff158fbe4b47d6a0c50888c251e8e7. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:21.742732 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Getting quotas for user 7f4c711ca1f44a2ca6c08ee99931cdcc and project 8fff158fbe4b47d6a0c50888c251e8e7. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:21.769166 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:50:21.773139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:50:21.897890 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-995e9486-4ba6-4ac6-93a3-b9fa7fef32a0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.841961 Jul 12 11:50:21.899196 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 191/402] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:50:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 11:50:21.955713 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d021a542-5c5c-4b0d-87c5-42663735c6b2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:21.964986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d021a542-5c5c-4b0d-87c5-42663735c6b2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:21.990572 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d021a542-5c5c-4b0d-87c5-42663735c6b2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:21.991958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d021a542-5c5c-4b0d-87c5-42663735c6b2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:21.995441 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d021a542-5c5c-4b0d-87c5-42663735c6b2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:21.999563 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d021a542-5c5c-4b0d-87c5-42663735c6b2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:22.018250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b7cd2f3c-9a5a-421a-bf1b-6161ed15e103 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:22.038794 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b7cd2f3c-9a5a-421a-bf1b-6161ed15e103 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1275 microversion: 2.1 time: 1.037339 Jul 12 11:50:22.045532 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 212/403] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:21 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1275 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:22.055262 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-37432f4d-6b54-44e9-a5bc-a1656f5a318f tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:22.062843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-37432f4d-6b54-44e9-a5bc-a1656f5a318f tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:22.139317 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=12 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:22.308503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-37432f4d-6b54-44e9-a5bc-a1656f5a318f tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:22.317494 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-37432f4d-6b54-44e9-a5bc-a1656f5a318f tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1218 microversion: 2.1 time: 0.270380 Jul 12 11:50:22.327679 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 213/404] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:22 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1218 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:22.333247 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3d51d5a0-5e4f-41e8-83a5-5479d44341c7 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:22.333943 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3d51d5a0-5e4f-41e8-83a5-5479d44341c7 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:22.359564 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d51d5a0-5e4f-41e8-83a5-5479d44341c7 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:22.360323 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d51d5a0-5e4f-41e8-83a5-5479d44341c7 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:22.367221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d51d5a0-5e4f-41e8-83a5-5479d44341c7 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:22.367683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d51d5a0-5e4f-41e8-83a5-5479d44341c7 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:22.678255 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d021a542-5c5c-4b0d-87c5-42663735c6b2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:22.692606 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d021a542-5c5c-4b0d-87c5-42663735c6b2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1476 microversion: 2.1 time: 0.787944 Jul 12 11:50:22.693422 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 192/405] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:21 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1476 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:23.366205 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-db0b611d-7b3a-4aff-a6e3-d7b8de890d57 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Calling method '.version_select at 0x7f5e0b1d1790>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:23.368798 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:23.368798 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:23.370535 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db0b611d-7b3a-4aff-a6e3-d7b8de890d57 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:23.371258 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db0b611d-7b3a-4aff-a6e3-d7b8de890d57 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:23.412543 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3d51d5a0-5e4f-41e8-83a5-5479d44341c7 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e629578143548dc8ba0cf77404c259b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48f95c0a90c463f809af1fcdf65da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:23.416171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db0b611d-7b3a-4aff-a6e3-d7b8de890d57 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:23.417376 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db0b611d-7b3a-4aff-a6e3-d7b8de890d57 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:23.424443 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3d51d5a0-5e4f-41e8-83a5-5479d44341c7 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 200 len: 1508 microversion: 2.1 time: 1.091349 Jul 12 11:50:23.426440 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 214/406] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:22 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 1508 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:23.437718 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=10,nova_api:INSERT=6 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:23.439982 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fc221cdf-02d2-4d78-bb01-f1e5a080eef0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:23.447008 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fc221cdf-02d2-4d78-bb01-f1e5a080eef0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:23.447459 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db0b611d-7b3a-4aff-a6e3-d7b8de890d57 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:23.458273 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db0b611d-7b3a-4aff-a6e3-d7b8de890d57 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:23.463217 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc221cdf-02d2-4d78-bb01-f1e5a080eef0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:23.464558 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc221cdf-02d2-4d78-bb01-f1e5a080eef0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:23.472918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc221cdf-02d2-4d78-bb01-f1e5a080eef0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:23.473622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc221cdf-02d2-4d78-bb01-f1e5a080eef0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:23.477555 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-db0b611d-7b3a-4aff-a6e3-d7b8de890d57 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.450150 Jul 12 11:50:23.481280 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 193/407] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:50:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:23.488335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e32f99a4-6827-4742-9b41-a990d4145fd3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:23.493366 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e32f99a4-6827-4742-9b41-a990d4145fd3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:23.508517 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e32f99a4-6827-4742-9b41-a990d4145fd3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:23.513916 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e32f99a4-6827-4742-9b41-a990d4145fd3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:23.514749 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e32f99a4-6827-4742-9b41-a990d4145fd3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:23.522991 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e32f99a4-6827-4742-9b41-a990d4145fd3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:23.671429 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e32f99a4-6827-4742-9b41-a990d4145fd3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:23.682816 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e32f99a4-6827-4742-9b41-a990d4145fd3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1214 microversion: 2.1 time: 0.200226 Jul 12 11:50:23.685020 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 194/408] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:23 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1214 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:23.977976 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-828f26bd-7173-485a-badc-db341fecbacd tempest-HypervisorAdminNegativeUnderV252Test-1775862207 tempest-HypervisorAdminNegativeUnderV252Test-1775862207-project] Calling method '.version_select at 0x7f5e0b21df70>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:23.979296 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:23.979296 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:23.980683 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-828f26bd-7173-485a-badc-db341fecbacd tempest-HypervisorAdminNegativeUnderV252Test-1775862207 tempest-HypervisorAdminNegativeUnderV252Test-1775862207-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'd7cbe13fc8b343a296cc592eb0563515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b1ef3868154a9181086ce314e0a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-828f26bd-7173-485a-badc-db341fecbacd tempest-HypervisorAdminNegativeUnderV252Test-1775862207 tempest-HypervisorAdminNegativeUnderV252Test-1775862207-project] Request method failure captured: Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-hypervisors/n-h2-849104-4/search HTTP/1.1 Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_8Mv7rdwWiad-VD-TUQV50YVaILSzwGBTOUQAYYTQ6gvyWgNzX1n9zRsWoHfijiBX00iScYp1xYnNy82R7SbrOr0yos0fKm33ntT7Fji7uliwNtfh4rwNDp1w7MiY-fyW8EFFGNR9g48fdG9Q0pFk6vM7TljZMXRaHy-FtkvnTp2Y Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: e0b1ef3868154a9181086ce314e0a0a3 Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1775862207 Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:50:23.983857 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:50:23.985585 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0b1ef3868154a9181086ce314e0a0a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0b1ef3868154a9181086ce314e0a0a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e0b1ef3868154a9181086ce314e0a0a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e0b1ef3868154a9181086ce314e0a0a3", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:23.985585 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1775862207 Jul 12 11:50:23.985585 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: e0b1ef3868154a9181086ce314e0a0a3 Jul 12 11:50:23.985585 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1775862207 Jul 12 11:50:23.985585 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1775862207-project Jul 12 11:50:23.985585 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:50:23.985585 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:50:23.985585 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: d7cbe13fc8b343a296cc592eb0563515 Jul 12 11:50:23.985585 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1775862207-project Jul 12 11:50:23.985585 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:50:23.985585 n-d-849104-4 devstack@n-api.service[125983]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 12 11:50:23.985585 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'n-h2-849104-4'} Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:50:23.986959 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 12 11:50:23.988453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:23.991405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-828f26bd-7173-485a-badc-db341fecbacd tempest-HypervisorAdminNegativeUnderV252Test-1775862207 tempest-HypervisorAdminNegativeUnderV252Test-1775862207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:23.992465 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-828f26bd-7173-485a-badc-db341fecbacd tempest-HypervisorAdminNegativeUnderV252Test-1775862207 tempest-HypervisorAdminNegativeUnderV252Test-1775862207-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h2-849104-4/search" status: 403 len: 117 microversion: 2.1 time: 0.306276 Jul 12 11:50:23.994056 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 195/409] 10.222.0.50 () {58 vars in 1208 bytes} [Tue Jul 12 11:50:23 2022] GET /compute/v2.1/os-hypervisors/n-h2-849104-4/search => generated 117 bytes in 308 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:24.106496 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3da08055-a6fd-4138-a518-da13d5515819 tempest-HypervisorAdminV228Test-521765441 tempest-HypervisorAdminV228Test-521765441-project-admin] Calling method '.version_select at 0x7f5e0b1d1280>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:24.107339 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:24.107339 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:24.109607 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3da08055-a6fd-4138-a518-da13d5515819 tempest-HypervisorAdminV228Test-521765441 tempest-HypervisorAdminV228Test-521765441-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:24.110087 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3da08055-a6fd-4138-a518-da13d5515819 tempest-HypervisorAdminV228Test-521765441 tempest-HypervisorAdminV228Test-521765441-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:24.132609 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3da08055-a6fd-4138-a518-da13d5515819 tempest-HypervisorAdminV228Test-521765441 tempest-HypervisorAdminV228Test-521765441-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:24.133324 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3da08055-a6fd-4138-a518-da13d5515819 tempest-HypervisorAdminV228Test-521765441 tempest-HypervisorAdminV228Test-521765441-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:24.175456 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3da08055-a6fd-4138-a518-da13d5515819 tempest-HypervisorAdminV228Test-521765441 tempest-HypervisorAdminV228Test-521765441-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:24.176236 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3da08055-a6fd-4138-a518-da13d5515819 tempest-HypervisorAdminV228Test-521765441 tempest-HypervisorAdminV228Test-521765441-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:24.185535 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:24.200309 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3da08055-a6fd-4138-a518-da13d5515819 tempest-HypervisorAdminV228Test-521765441 tempest-HypervisorAdminV228Test-521765441-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.198550 Jul 12 11:50:24.201242 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 196/410] 10.222.0.50 () {60 vars in 1186 bytes} [Tue Jul 12 11:50:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:50:24.214290 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f02924a4-ac1b-4e8e-9dca-1419bbfa42c3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:24.216588 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f02924a4-ac1b-4e8e-9dca-1419bbfa42c3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:24.230243 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f02924a4-ac1b-4e8e-9dca-1419bbfa42c3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:24.234466 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f02924a4-ac1b-4e8e-9dca-1419bbfa42c3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:24.235514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f02924a4-ac1b-4e8e-9dca-1419bbfa42c3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:24.238838 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f02924a4-ac1b-4e8e-9dca-1419bbfa42c3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:24.629811 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f02924a4-ac1b-4e8e-9dca-1419bbfa42c3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:24.642069 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f02924a4-ac1b-4e8e-9dca-1419bbfa42c3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1476 microversion: 2.1 time: 0.438979 Jul 12 11:50:24.643604 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 197/411] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:24 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1476 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:24.648002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fc221cdf-02d2-4d78-bb01-f1e5a080eef0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:24.658711 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:24.680893 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-62a95e5e-66f8-4d94-acfe-6df4b5979c48 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Calling method '.version_select at 0x7f5e0bdd9940>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:24.685632 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fc221cdf-02d2-4d78-bb01-f1e5a080eef0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1323 microversion: 2.1 time: 1.248192 Jul 12 11:50:24.687002 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 215/412] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:23 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1323 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:24.692686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7e3b2af2-ba63-43ea-9638-0069287fa4b7 tempest-HypervisorAdminV228Test-521765441 tempest-HypervisorAdminV228Test-521765441-project-admin] Calling method '.version_select at 0x7f5e0a899ca0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:24.696500 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:24.696500 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:24.698673 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-62a95e5e-66f8-4d94-acfe-6df4b5979c48 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:24.705930 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-62a95e5e-66f8-4d94-acfe-6df4b5979c48 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:24.708937 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:24.708937 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:24.716992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7e3b2af2-ba63-43ea-9638-0069287fa4b7 tempest-HypervisorAdminV228Test-521765441 tempest-HypervisorAdminV228Test-521765441-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:24.717843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7e3b2af2-ba63-43ea-9638-0069287fa4b7 tempest-HypervisorAdminV228Test-521765441 tempest-HypervisorAdminV228Test-521765441-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:24.741767 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-62a95e5e-66f8-4d94-acfe-6df4b5979c48 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-62a95e5e-66f8-4d94-acfe-6df4b5979c48 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Request method failure captured: Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_-8fN_csfGEo71cuNiboQNoISZGKcW7opbrbp34kXpTc0fUBAuqGnD094Lsa_Yv3GNBEPlLjCLNwEKi_hJFnJX0vIHFqBC-uTWOwSC740tklz6NZy31Yhr6z3mEtK-eKDIKijLhGalr2a_xIZ5wGkzhZLhDWw-TbVq8NINUzZcZSY Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 8e62fc777df54147901a20b64642014b Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-873624097 Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:50:24.743832 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:50:24.745388 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e62fc777df54147901a20b64642014b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e62fc777df54147901a20b64642014b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e62fc777df54147901a20b64642014b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e62fc777df54147901a20b64642014b", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:24.745388 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-873624097 Jul 12 11:50:24.745388 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 8e62fc777df54147901a20b64642014b Jul 12 11:50:24.745388 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-873624097 Jul 12 11:50:24.745388 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin Jul 12 11:50:24.745388 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:50:24.745388 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:50:24.745388 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 9c8643ddbf4b46039a028e3b154fc10c Jul 12 11:50:24.745388 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin Jul 12 11:50:24.745388 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:50:24.745388 n-d-849104-4 devstack@n-api.service[125983]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 12 11:50:24.745388 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:24.746268 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:24.747622 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:24.747622 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:24.747622 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:24.747622 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 12 11:50:24.747622 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:24.750041 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-62a95e5e-66f8-4d94-acfe-6df4b5979c48 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:24.751266 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-62a95e5e-66f8-4d94-acfe-6df4b5979c48 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.106443 Jul 12 11:50:24.755184 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7e3b2af2-ba63-43ea-9638-0069287fa4b7 tempest-HypervisorAdminV228Test-521765441 tempest-HypervisorAdminV228Test-521765441-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:24.757445 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7e3b2af2-ba63-43ea-9638-0069287fa4b7 tempest-HypervisorAdminV228Test-521765441 tempest-HypervisorAdminV228Test-521765441-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:24.760166 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 198/413] 10.222.0.50 () {58 vars in 1250 bytes} [Tue Jul 12 11:50:24 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:24.765398 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8633caab-7407-4a94-9a7e-ed960b62fcf9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:24.766206 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8633caab-7407-4a94-9a7e-ed960b62fcf9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:24.774611 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7e3b2af2-ba63-43ea-9638-0069287fa4b7 tempest-HypervisorAdminV228Test-521765441 tempest-HypervisorAdminV228Test-521765441-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.086405 Jul 12 11:50:24.776169 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 216/414] 10.222.0.50 () {60 vars in 1192 bytes} [Tue Jul 12 11:50:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:50:24.781856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8633caab-7407-4a94-9a7e-ed960b62fcf9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:24.782224 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9387831b-6862-41b3-baec-31574f54608b tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:24.783196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9387831b-6862-41b3-baec-31574f54608b tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:24.783417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8633caab-7407-4a94-9a7e-ed960b62fcf9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:24.785740 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8633caab-7407-4a94-9a7e-ed960b62fcf9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:24.788145 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8633caab-7407-4a94-9a7e-ed960b62fcf9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:24.817533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9387831b-6862-41b3-baec-31574f54608b tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:24.821388 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9387831b-6862-41b3-baec-31574f54608b tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:24.831025 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9387831b-6862-41b3-baec-31574f54608b tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:24.833987 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9387831b-6862-41b3-baec-31574f54608b tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:25.046056 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9387831b-6862-41b3-baec-31574f54608b tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:25.061157 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9387831b-6862-41b3-baec-31574f54608b tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1276 microversion: 2.1 time: 0.281753 Jul 12 11:50:25.064498 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 217/415] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:24 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1276 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:25.079537 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c806360a-5e6a-4d06-9844-ebaa2bb03a47 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Calling method '.version_select at 0x7f5e0a8b4b80>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:25.080788 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:25.080788 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:25.084321 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c806360a-5e6a-4d06-9844-ebaa2bb03a47 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:25.090468 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c806360a-5e6a-4d06-9844-ebaa2bb03a47 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:25.133909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c806360a-5e6a-4d06-9844-ebaa2bb03a47 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:25.135733 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c806360a-5e6a-4d06-9844-ebaa2bb03a47 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:25.193732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c806360a-5e6a-4d06-9844-ebaa2bb03a47 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:25.194533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c806360a-5e6a-4d06-9844-ebaa2bb03a47 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:25.205500 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c806360a-5e6a-4d06-9844-ebaa2bb03a47 tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.137680 Jul 12 11:50:25.206998 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 218/416] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:50:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:25.219202 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fba369c9-bd8e-4e55-8edd-4840f3131252 tempest-HypervisorAdminNegativeUnderV252Test-1775862207 tempest-HypervisorAdminNegativeUnderV252Test-1775862207-project] Calling method '.version_select at 0x7f5e0a7ac550>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:25.221913 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:25.221913 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:25.223412 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fba369c9-bd8e-4e55-8edd-4840f3131252 tempest-HypervisorAdminNegativeUnderV252Test-1775862207 tempest-HypervisorAdminNegativeUnderV252Test-1775862207-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'd7cbe13fc8b343a296cc592eb0563515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b1ef3868154a9181086ce314e0a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fba369c9-bd8e-4e55-8edd-4840f3131252 tempest-HypervisorAdminNegativeUnderV252Test-1775862207 tempest-HypervisorAdminNegativeUnderV252Test-1775862207-project] Request method failure captured: Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_8Mv7rdwWiad-VD-TUQV50YVaILSzwGBTOUQAYYTQ6gvyWgNzX1n9zRsWoHfijiBX00iScYp1xYnNy82R7SbrOr0yos0fKm33ntT7Fji7uliwNtfh4rwNDp1w7MiY-fyW8EFFGNR9g48fdG9Q0pFk6vM7TljZMXRaHy-FtkvnTp2Y Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: e0b1ef3868154a9181086ce314e0a0a3 Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1775862207 Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:50:25.231131 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:50:25.232368 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0b1ef3868154a9181086ce314e0a0a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0b1ef3868154a9181086ce314e0a0a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e0b1ef3868154a9181086ce314e0a0a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e0b1ef3868154a9181086ce314e0a0a3", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:25.232368 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1775862207 Jul 12 11:50:25.232368 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: e0b1ef3868154a9181086ce314e0a0a3 Jul 12 11:50:25.232368 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1775862207 Jul 12 11:50:25.232368 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1775862207-project Jul 12 11:50:25.232368 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:25.232368 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:25.232368 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: d7cbe13fc8b343a296cc592eb0563515 Jul 12 11:50:25.232368 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1775862207-project Jul 12 11:50:25.232368 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:50:25.232368 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 12 11:50:25.232368 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '1'} Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:50:25.233056 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 12 11:50:25.234159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:25.236774 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fba369c9-bd8e-4e55-8edd-4840f3131252 tempest-HypervisorAdminNegativeUnderV252Test-1775862207 tempest-HypervisorAdminNegativeUnderV252Test-1775862207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:25.240752 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fba369c9-bd8e-4e55-8edd-4840f3131252 tempest-HypervisorAdminNegativeUnderV252Test-1775862207 tempest-HypervisorAdminNegativeUnderV252Test-1775862207-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.027612 Jul 12 11:50:25.241865 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 219/417] 10.222.0.50 () {58 vars in 1175 bytes} [Tue Jul 12 11:50:25 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:25.253966 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c289eb8f-8dca-475f-9fdf-be177d6836bd tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Calling method '.version_select at 0x7f5e0a7510d0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:25.257140 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c289eb8f-8dca-475f-9fdf-be177d6836bd tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:25.257895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c289eb8f-8dca-475f-9fdf-be177d6836bd tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:25.266780 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-c289eb8f-8dca-475f-9fdf-be177d6836bd tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] HTTP exception thrown: No hypervisor matching '7580d02b-5a44-4de7-a731-f85691ba2534' could be found. Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c289eb8f-8dca-475f-9fdf-be177d6836bd tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Request method failure captured: Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-hypervisors/7580d02b-5a44-4de7-a731-f85691ba2534/servers HTTP/1.1 Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_-8fN_csfGEo71cuNiboQNoISZGKcW7opbrbp34kXpTc0fUBAuqGnD094Lsa_Yv3GNBEPlLjCLNwEKi_hJFnJX0vIHFqBC-uTWOwSC740tklz6NZy31Yhr6z3mEtK-eKDIKijLhGalr2a_xIZ5wGkzhZLhDWw-TbVq8NINUzZcZSY Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 8e62fc777df54147901a20b64642014b Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-873624097 Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:50:25.270447 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:50:25.271688 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e62fc777df54147901a20b64642014b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e62fc777df54147901a20b64642014b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e62fc777df54147901a20b64642014b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e62fc777df54147901a20b64642014b", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:25.271688 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-873624097 Jul 12 11:50:25.271688 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 8e62fc777df54147901a20b64642014b Jul 12 11:50:25.271688 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-873624097 Jul 12 11:50:25.271688 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin Jul 12 11:50:25.271688 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:25.271688 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:25.271688 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 9c8643ddbf4b46039a028e3b154fc10c Jul 12 11:50:25.271688 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin Jul 12 11:50:25.271688 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:50:25.271688 n-d-849104-4 devstack@n-api.service[125984]: exception: No hypervisor matching '7580d02b-5a44-4de7-a731-f85691ba2534' could be found. Jul 12 11:50:25.271688 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '7580d02b-5a44-4de7-a731-f85691ba2534'} Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '7580d02b-5a44-4de7-a731-f85691ba2534' could be found. Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:25.272437 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:25.273503 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:25.273503 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:25.273503 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:25.273503 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:25.273503 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '7580d02b-5a44-4de7-a731-f85691ba2534' could be found. Jul 12 11:50:25.273503 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:25.276208 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c289eb8f-8dca-475f-9fdf-be177d6836bd tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] Returning 404 to user: No hypervisor matching '7580d02b-5a44-4de7-a731-f85691ba2534' could be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:25.277536 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c289eb8f-8dca-475f-9fdf-be177d6836bd tempest-HypervisorAdminNegativeUnderV252Test-873624097 tempest-HypervisorAdminNegativeUnderV252Test-873624097-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/7580d02b-5a44-4de7-a731-f85691ba2534/servers" status: 404 len: 123 microversion: 2.1 time: 0.029254 Jul 12 11:50:25.278653 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 220/418] 10.222.0.50 () {58 vars in 1280 bytes} [Tue Jul 12 11:50:25 2022] GET /compute/v2.1/os-hypervisors/7580d02b-5a44-4de7-a731-f85691ba2534/servers => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:25.285556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8633caab-7407-4a94-9a7e-ed960b62fcf9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e629578143548dc8ba0cf77404c259b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48f95c0a90c463f809af1fcdf65da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:25.294681 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8633caab-7407-4a94-9a7e-ed960b62fcf9 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 200 len: 1508 microversion: 2.1 time: 0.532999 Jul 12 11:50:25.304704 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 199/419] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:24 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 1508 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:25.669026 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a179cd7f-2991-490e-94cd-8176e8395104 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:25.670000 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a179cd7f-2991-490e-94cd-8176e8395104 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:25.686719 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a179cd7f-2991-490e-94cd-8176e8395104 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:25.687175 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a179cd7f-2991-490e-94cd-8176e8395104 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:25.694522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a179cd7f-2991-490e-94cd-8176e8395104 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:25.694998 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a179cd7f-2991-490e-94cd-8176e8395104 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:25.723495 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d19c9138-e3c4-4f7c-90e1-6076418c0385 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:25.729410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d19c9138-e3c4-4f7c-90e1-6076418c0385 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:25.766114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d19c9138-e3c4-4f7c-90e1-6076418c0385 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:25.769835 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d19c9138-e3c4-4f7c-90e1-6076418c0385 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:25.771754 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d19c9138-e3c4-4f7c-90e1-6076418c0385 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:25.776560 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d19c9138-e3c4-4f7c-90e1-6076418c0385 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:26.296799 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a179cd7f-2991-490e-94cd-8176e8395104 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:26.309569 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a179cd7f-2991-490e-94cd-8176e8395104 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1475 microversion: 2.1 time: 0.653582 Jul 12 11:50:26.326896 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 221/420] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:25 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1475 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:26.343517 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-524668f0-a240-481e-807a-d999c36e41c5 req-981b1e29-3d5c-4be0-951e-052a9e9c6d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cd45543-217b-4a5e-94be-1196a6d8f087", "tag": "151e9b0c-ca3b-499d-848a-7f387ea59451"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:26.377019 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-524668f0-a240-481e-807a-d999c36e41c5 req-981b1e29-3d5c-4be0-951e-052a9e9c6d3a service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:26.378552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-524668f0-a240-481e-807a-d999c36e41c5 req-981b1e29-3d5c-4be0-951e-052a9e9c6d3a service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:26.397462 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-524668f0-a240-481e-807a-d999c36e41c5 req-981b1e29-3d5c-4be0-951e-052a9e9c6d3a service nova] Creating event network-changed:151e9b0c-ca3b-499d-848a-7f387ea59451 for instance 9cd45543-217b-4a5e-94be-1196a6d8f087 on n-h1-849104-4 Jul 12 11:50:26.404001 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-524668f0-a240-481e-807a-d999c36e41c5 req-981b1e29-3d5c-4be0-951e-052a9e9c6d3a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073044 Jul 12 11:50:26.405866 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 222/421] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:26.411972 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-ac025a68-dad5-4b59-900d-e305728e187e req-ccfaa145-43ad-4f34-b294-346af815b9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b7d384-5f54-44be-9eda-4a88ee5280a5", "name": "network-vif-deleted", "tag": "da388a5c-094b-414a-b7ad-78fcb21b53d4"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:26.424882 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-ac025a68-dad5-4b59-900d-e305728e187e req-ccfaa145-43ad-4f34-b294-346af815b9ff service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:26.425792 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-ac025a68-dad5-4b59-900d-e305728e187e req-ccfaa145-43ad-4f34-b294-346af815b9ff service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:26.438833 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-ac025a68-dad5-4b59-900d-e305728e187e req-ccfaa145-43ad-4f34-b294-346af815b9ff service nova] Creating event network-vif-deleted:da388a5c-094b-414a-b7ad-78fcb21b53d4 for instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 on n-h2-849104-4 Jul 12 11:50:26.446407 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-ac025a68-dad5-4b59-900d-e305728e187e req-ccfaa145-43ad-4f34-b294-346af815b9ff service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038617 Jul 12 11:50:26.447505 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 223/422] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:26.453914 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-371d76d7-3d31-4d0f-ab72-e9e05edc3edc tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:26.457716 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-371d76d7-3d31-4d0f-ab72-e9e05edc3edc tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:26.470762 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d19c9138-e3c4-4f7c-90e1-6076418c0385 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:26.481078 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d19c9138-e3c4-4f7c-90e1-6076418c0385 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1323 microversion: 2.1 time: 0.780538 Jul 12 11:50:26.482105 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 200/423] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:25 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1323 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:26.482939 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-371d76d7-3d31-4d0f-ab72-e9e05edc3edc tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:26.485869 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-371d76d7-3d31-4d0f-ab72-e9e05edc3edc tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:26.487895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-371d76d7-3d31-4d0f-ab72-e9e05edc3edc tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:26.488386 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-371d76d7-3d31-4d0f-ab72-e9e05edc3edc tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:26.488506 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c41665f6-7fd3-4757-89db-50eaf3100d53 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:26.489247 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c41665f6-7fd3-4757-89db-50eaf3100d53 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:26.496654 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c41665f6-7fd3-4757-89db-50eaf3100d53 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:26.497620 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c41665f6-7fd3-4757-89db-50eaf3100d53 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:26.498655 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c41665f6-7fd3-4757-89db-50eaf3100d53 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:26.499795 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c41665f6-7fd3-4757-89db-50eaf3100d53 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:26.546572 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c41665f6-7fd3-4757-89db-50eaf3100d53 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:26.547507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c41665f6-7fd3-4757-89db-50eaf3100d53 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:26.548529 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-c41665f6-7fd3-4757-89db-50eaf3100d53 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lazy-loading 'fault' on Instance uuid 86b7d384-5f54-44be-9eda-4a88ee5280a5 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:50:26.819057 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-371d76d7-3d31-4d0f-ab72-e9e05edc3edc tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:26.849210 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-371d76d7-3d31-4d0f-ab72-e9e05edc3edc tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1276 microversion: 2.1 time: 0.400059 Jul 12 11:50:26.860295 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 224/424] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:26 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1276 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:27.325419 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c41665f6-7fd3-4757-89db-50eaf3100d53 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e629578143548dc8ba0cf77404c259b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48f95c0a90c463f809af1fcdf65da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:27.331131 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-32a31fc7-e47d-4819-9a52-ab59024ab1fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:27.331985 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c41665f6-7fd3-4757-89db-50eaf3100d53 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 200 len: 1305 microversion: 2.1 time: 0.848747 Jul 12 11:50:27.332149 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-32a31fc7-e47d-4819-9a52-ab59024ab1fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:27.334056 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 201/425] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:26 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 1305 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:27.348430 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-32a31fc7-e47d-4819-9a52-ab59024ab1fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:27.349012 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-32a31fc7-e47d-4819-9a52-ab59024ab1fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:27.354239 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-32a31fc7-e47d-4819-9a52-ab59024ab1fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:27.354756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-32a31fc7-e47d-4819-9a52-ab59024ab1fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:27.497741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-56aebcd5-1ae5-4742-8e55-9c2c86b42982 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:27.498355 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-56aebcd5-1ae5-4742-8e55-9c2c86b42982 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:27.508002 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56aebcd5-1ae5-4742-8e55-9c2c86b42982 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:27.508496 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56aebcd5-1ae5-4742-8e55-9c2c86b42982 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:27.509287 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56aebcd5-1ae5-4742-8e55-9c2c86b42982 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:27.509729 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56aebcd5-1ae5-4742-8e55-9c2c86b42982 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:27.772755 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-32a31fc7-e47d-4819-9a52-ab59024ab1fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:27.782127 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-32a31fc7-e47d-4819-9a52-ab59024ab1fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1475 microversion: 2.1 time: 0.454887 Jul 12 11:50:27.785875 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 225/426] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:27 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1475 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:27.877784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d319e56f-c4ea-4eac-a4e2-727228890edd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:27.880823 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d319e56f-c4ea-4eac-a4e2-727228890edd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:27.892654 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d319e56f-c4ea-4eac-a4e2-727228890edd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:27.897593 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d319e56f-c4ea-4eac-a4e2-727228890edd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:27.899099 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d319e56f-c4ea-4eac-a4e2-727228890edd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:27.900419 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d319e56f-c4ea-4eac-a4e2-727228890edd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:28.034784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d319e56f-c4ea-4eac-a4e2-727228890edd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:28.045203 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d319e56f-c4ea-4eac-a4e2-727228890edd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1276 microversion: 2.1 time: 0.174300 Jul 12 11:50:28.050002 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 226/427] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:27 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:28.278081 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-56aebcd5-1ae5-4742-8e55-9c2c86b42982 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:28.297546 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-56aebcd5-1ae5-4742-8e55-9c2c86b42982 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1323 microversion: 2.1 time: 0.802320 Jul 12 11:50:28.308721 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 202/428] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:27 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1323 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:28.354461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-905a9366-3a7b-4dd2-8502-f7952c316aba tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:28.355213 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-905a9366-3a7b-4dd2-8502-f7952c316aba tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:28.370346 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-905a9366-3a7b-4dd2-8502-f7952c316aba tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:28.370807 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-905a9366-3a7b-4dd2-8502-f7952c316aba tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:28.371596 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-905a9366-3a7b-4dd2-8502-f7952c316aba tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:28.372348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-905a9366-3a7b-4dd2-8502-f7952c316aba tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:28.411595 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-905a9366-3a7b-4dd2-8502-f7952c316aba tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] HTTP exception thrown: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-905a9366-3a7b-4dd2-8502-f7952c316aba tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Request method failure captured: Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 HTTP/1.1 Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_q19wQrc5Ko1Pq9BTRt-lPhyY8YJOBr10yw4IBmPp9Bschb8sP8QRH8W8BA0PP0rdE7_7JUHRrbuMikVCwjWvIx_jtIClsc8dsXBKzhHtaFPcC6qZZaIJ25-Kwq6C3mAzIYgF_B4XLJ3nywcg54I_aAC7zbPO1BbWwKw20a9h7Y3I Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a48f95c0a90c463f809af1fcdf65da82 Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:50:28.415128 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:50:28.416861 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a48f95c0a90c463f809af1fcdf65da82", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:28.416861 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.416861 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a48f95c0a90c463f809af1fcdf65da82 Jul 12 11:50:28.416861 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.416861 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ImagesNegativeTestJSON-1944334537-project Jul 12 11:50:28.416861 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:28.416861 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:28.416861 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0e629578143548dc8ba0cf77404c259b Jul 12 11:50:28.416861 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ImagesNegativeTestJSON-1944334537-project Jul 12 11:50:28.416861 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:50:28.416861 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.416861 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '86b7d384-5f54-44be-9eda-4a88ee5280a5'} Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:28.417762 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.419119 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.422696 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-905a9366-3a7b-4dd2-8502-f7952c316aba tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Returning 404 to user: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:28.425044 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-905a9366-3a7b-4dd2-8502-f7952c316aba tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 404 len: 111 microversion: 2.1 time: 0.078561 Jul 12 11:50:28.426444 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 227/429] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:28 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 11:50:28.437082 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cb9395d6-5bf4-4404-b383-5e58934c5eaf tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-582525293", "metadata": {"image_type": "test"}}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:28.439834 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cb9395d6-5bf4-4404-b383-5e58934c5eaf tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:28.455724 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb9395d6-5bf4-4404-b383-5e58934c5eaf tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:28.458743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb9395d6-5bf4-4404-b383-5e58934c5eaf tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:28.463150 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb9395d6-5bf4-4404-b383-5e58934c5eaf tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:28.463922 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb9395d6-5bf4-4404-b383-5e58934c5eaf tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:28.490752 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-cb9395d6-5bf4-4404-b383-5e58934c5eaf tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] HTTP exception thrown: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cb9395d6-5bf4-4404-b383-5e58934c5eaf tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Request method failure captured: Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5/action HTTP/1.1 Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 111 Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_q19wQrc5Ko1Pq9BTRt-lPhyY8YJOBr10yw4IBmPp9Bschb8sP8QRH8W8BA0PP0rdE7_7JUHRrbuMikVCwjWvIx_jtIClsc8dsXBKzhHtaFPcC6qZZaIJ25-Kwq6C3mAzIYgF_B4XLJ3nywcg54I_aAC7zbPO1BbWwKw20a9h7Y3I Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: a48f95c0a90c463f809af1fcdf65da82 Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:50:28.493100 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:50:28.494431 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a48f95c0a90c463f809af1fcdf65da82", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:28.494431 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.494431 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: a48f95c0a90c463f809af1fcdf65da82 Jul 12 11:50:28.494431 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.494431 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ImagesNegativeTestJSON-1944334537-project Jul 12 11:50:28.494431 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:50:28.494431 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:50:28.494431 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 0e629578143548dc8ba0cf77404c259b Jul 12 11:50:28.494431 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ImagesNegativeTestJSON-1944334537-project Jul 12 11:50:28.494431 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:50:28.494431 n-d-849104-4 devstack@n-api.service[125983]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-582525293", "metadata": {"image_type": "test"}}} Jul 12 11:50:28.494431 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '86b7d384-5f54-44be-9eda-4a88ee5280a5', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-582525293', 'metadata': {'image_type': 'test'}}}} Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:28.495154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.496258 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:28.498629 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:28.498629 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:28.498629 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:28.498629 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.498629 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.501584 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cb9395d6-5bf4-4404-b383-5e58934c5eaf tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Returning 404 to user: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:28.503094 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cb9395d6-5bf4-4404-b383-5e58934c5eaf tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "POST /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5/action" status: 404 len: 111 microversion: 2.1 time: 0.071135 Jul 12 11:50:28.504243 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 203/430] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Jul 12 11:50:28 2022] POST /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5/action => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:28.519255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5258db73-6c6d-49dd-a0f0-08ff340f7211 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1995728547", "metadata": {"image_type": "test"}}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:28.520842 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5258db73-6c6d-49dd-a0f0-08ff340f7211 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Failed to fetch instance by id tempest-invalid-436122443 {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 12 11:50:28.522443 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-5258db73-6c6d-49dd-a0f0-08ff340f7211 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] HTTP exception thrown: Instance tempest-invalid-436122443 could not be found. Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5258db73-6c6d-49dd-a0f0-08ff340f7211 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Request method failure captured: Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/servers/tempest-invalid-436122443/action HTTP/1.1 Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 112 Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_q19wQrc5Ko1Pq9BTRt-lPhyY8YJOBr10yw4IBmPp9Bschb8sP8QRH8W8BA0PP0rdE7_7JUHRrbuMikVCwjWvIx_jtIClsc8dsXBKzhHtaFPcC6qZZaIJ25-Kwq6C3mAzIYgF_B4XLJ3nywcg54I_aAC7zbPO1BbWwKw20a9h7Y3I Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a48f95c0a90c463f809af1fcdf65da82 Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:50:28.525097 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:50:28.526476 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a48f95c0a90c463f809af1fcdf65da82", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:28.526476 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.526476 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a48f95c0a90c463f809af1fcdf65da82 Jul 12 11:50:28.526476 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.526476 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ImagesNegativeTestJSON-1944334537-project Jul 12 11:50:28.526476 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:28.526476 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:28.526476 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0e629578143548dc8ba0cf77404c259b Jul 12 11:50:28.526476 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ImagesNegativeTestJSON-1944334537-project Jul 12 11:50:28.526476 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:50:28.526476 n-d-849104-4 devstack@n-api.service[125984]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1995728547", "metadata": {"image_type": "test"}}} Jul 12 11:50:28.526476 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:50:28.526476 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance tempest-invalid-436122443 could not be found. Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'tempest-invalid-436122443', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1995728547', 'metadata': {'image_type': 'test'}}}} Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-436122443 could not be found. Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:50:28.527227 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-436122443 could not be found. Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-436122443 could not be found. Jul 12 11:50:28.529725 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.533634 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5258db73-6c6d-49dd-a0f0-08ff340f7211 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Returning 404 to user: Instance tempest-invalid-436122443 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:28.535266 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5258db73-6c6d-49dd-a0f0-08ff340f7211 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "POST /compute/v2.1/servers/tempest-invalid-436122443/action" status: 404 len: 100 microversion: 2.1 time: 0.022686 Jul 12 11:50:28.536414 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 228/431] 10.222.0.50 () {60 vars in 1245 bytes} [Tue Jul 12 11:50:28 2022] POST /compute/v2.1/servers/tempest-invalid-436122443/action => generated 100 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:28.552438 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ecfb7c79-d1dc-44bb-b3f8-72aa6f09f1fe tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2135534776"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:28.555861 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ecfb7c79-d1dc-44bb-b3f8-72aa6f09f1fe tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 12 11:50:28.561895 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-ecfb7c79-d1dc-44bb-b3f8-72aa6f09f1fe tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ecfb7c79-d1dc-44bb-b3f8-72aa6f09f1fe tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Request method failure captured: Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 57 Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_q19wQrc5Ko1Pq9BTRt-lPhyY8YJOBr10yw4IBmPp9Bschb8sP8QRH8W8BA0PP0rdE7_7JUHRrbuMikVCwjWvIx_jtIClsc8dsXBKzhHtaFPcC6qZZaIJ25-Kwq6C3mAzIYgF_B4XLJ3nywcg54I_aAC7zbPO1BbWwKw20a9h7Y3I Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: a48f95c0a90c463f809af1fcdf65da82 Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:50:28.563715 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:50:28.565740 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a48f95c0a90c463f809af1fcdf65da82", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:28.565740 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.565740 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: a48f95c0a90c463f809af1fcdf65da82 Jul 12 11:50:28.565740 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.565740 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ImagesNegativeTestJSON-1944334537-project Jul 12 11:50:28.565740 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:50:28.565740 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:50:28.565740 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 0e629578143548dc8ba0cf77404c259b Jul 12 11:50:28.565740 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ImagesNegativeTestJSON-1944334537-project Jul 12 11:50:28.565740 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:50:28.565740 n-d-849104-4 devstack@n-api.service[125983]: {"createImage": {"name": "tempest-test-snap-2135534776"}} Jul 12 11:50:28.565740 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:50:28.565740 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2135534776'}}} Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:50:28.566639 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 12 11:50:28.567987 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.573327 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ecfb7c79-d1dc-44bb-b3f8-72aa6f09f1fe tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:28.575527 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ecfb7c79-d1dc-44bb-b3f8-72aa6f09f1fe tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.034001 Jul 12 11:50:28.578157 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 204/432] 10.222.0.50 () {60 vars in 1274 bytes} [Tue Jul 12 11:50:28 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:28.587048 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-832a982d-b399-48a6-b4fd-e405a986117b tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-95496297"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:28.588788 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-832a982d-b399-48a6-b4fd-e405a986117b tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 12 11:50:28.589970 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-832a982d-b399-48a6-b4fd-e405a986117b tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-832a982d-b399-48a6-b4fd-e405a986117b tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Request method failure captured: Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 55 Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_q19wQrc5Ko1Pq9BTRt-lPhyY8YJOBr10yw4IBmPp9Bschb8sP8QRH8W8BA0PP0rdE7_7JUHRrbuMikVCwjWvIx_jtIClsc8dsXBKzhHtaFPcC6qZZaIJ25-Kwq6C3mAzIYgF_B4XLJ3nywcg54I_aAC7zbPO1BbWwKw20a9h7Y3I Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a48f95c0a90c463f809af1fcdf65da82 Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:50:28.591662 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:50:28.592980 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a48f95c0a90c463f809af1fcdf65da82", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:28.592980 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.592980 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a48f95c0a90c463f809af1fcdf65da82 Jul 12 11:50:28.592980 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.592980 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ImagesNegativeTestJSON-1944334537-project Jul 12 11:50:28.592980 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:28.592980 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:28.592980 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0e629578143548dc8ba0cf77404c259b Jul 12 11:50:28.592980 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ImagesNegativeTestJSON-1944334537-project Jul 12 11:50:28.592980 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:50:28.592980 n-d-849104-4 devstack@n-api.service[125984]: {"createImage": {"name": "tempest-test-snap-95496297"}} Jul 12 11:50:28.592980 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:50:28.592980 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-95496297'}}} Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:50:28.593733 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 12 11:50:28.594894 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.596427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-832a982d-b399-48a6-b4fd-e405a986117b tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:28.596427 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-832a982d-b399-48a6-b4fd-e405a986117b tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010837 Jul 12 11:50:28.604426 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 229/433] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Jul 12 11:50:28 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:28.605042 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d7826d5d-0fe7-4bd8-9c6b-9947880bf6e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:28.605763 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d7826d5d-0fe7-4bd8-9c6b-9947880bf6e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:28.618855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7826d5d-0fe7-4bd8-9c6b-9947880bf6e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:28.620342 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7826d5d-0fe7-4bd8-9c6b-9947880bf6e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:28.621707 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7826d5d-0fe7-4bd8-9c6b-9947880bf6e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:28.625898 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7826d5d-0fe7-4bd8-9c6b-9947880bf6e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:28.660947 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-d7826d5d-0fe7-4bd8-9c6b-9947880bf6e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] HTTP exception thrown: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d7826d5d-0fe7-4bd8-9c6b-9947880bf6e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Request method failure captured: Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 HTTP/1.1 Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_q19wQrc5Ko1Pq9BTRt-lPhyY8YJOBr10yw4IBmPp9Bschb8sP8QRH8W8BA0PP0rdE7_7JUHRrbuMikVCwjWvIx_jtIClsc8dsXBKzhHtaFPcC6qZZaIJ25-Kwq6C3mAzIYgF_B4XLJ3nywcg54I_aAC7zbPO1BbWwKw20a9h7Y3I Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: a48f95c0a90c463f809af1fcdf65da82 Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:50:28.665504 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:50:28.666804 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a48f95c0a90c463f809af1fcdf65da82", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:28.666804 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.666804 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: a48f95c0a90c463f809af1fcdf65da82 Jul 12 11:50:28.666804 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.666804 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ImagesNegativeTestJSON-1944334537-project Jul 12 11:50:28.666804 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:50:28.666804 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:50:28.666804 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 0e629578143548dc8ba0cf77404c259b Jul 12 11:50:28.666804 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ImagesNegativeTestJSON-1944334537-project Jul 12 11:50:28.666804 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:50:28.666804 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.666804 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '86b7d384-5f54-44be-9eda-4a88ee5280a5'} Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:28.667512 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.669968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.679183 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d7826d5d-0fe7-4bd8-9c6b-9947880bf6e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Returning 404 to user: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:28.680871 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d7826d5d-0fe7-4bd8-9c6b-9947880bf6e1 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "DELETE /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 404 len: 111 microversion: 2.1 time: 0.081202 Jul 12 11:50:28.681973 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 205/434] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:50:28 2022] DELETE /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:28.691322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-450a2c03-0089-4840-9d06-458703372618 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:28.691955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-450a2c03-0089-4840-9d06-458703372618 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] [instance: 86b7d384-5f54-44be-9eda-4a88ee5280a5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:28.703459 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-450a2c03-0089-4840-9d06-458703372618 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:28.703921 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-450a2c03-0089-4840-9d06-458703372618 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:28.705335 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-450a2c03-0089-4840-9d06-458703372618 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:28.716181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-450a2c03-0089-4840-9d06-458703372618 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:28.743760 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-450a2c03-0089-4840-9d06-458703372618 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] HTTP exception thrown: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-450a2c03-0089-4840-9d06-458703372618 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Request method failure captured: Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 HTTP/1.1 Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_q19wQrc5Ko1Pq9BTRt-lPhyY8YJOBr10yw4IBmPp9Bschb8sP8QRH8W8BA0PP0rdE7_7JUHRrbuMikVCwjWvIx_jtIClsc8dsXBKzhHtaFPcC6qZZaIJ25-Kwq6C3mAzIYgF_B4XLJ3nywcg54I_aAC7zbPO1BbWwKw20a9h7Y3I Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a48f95c0a90c463f809af1fcdf65da82 Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:50:28.745903 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:50:28.747386 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a48f95c0a90c463f809af1fcdf65da82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a48f95c0a90c463f809af1fcdf65da82", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:28.747386 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.747386 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a48f95c0a90c463f809af1fcdf65da82 Jul 12 11:50:28.747386 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1944334537 Jul 12 11:50:28.747386 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ImagesNegativeTestJSON-1944334537-project Jul 12 11:50:28.747386 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:28.747386 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:28.747386 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0e629578143548dc8ba0cf77404c259b Jul 12 11:50:28.747386 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ImagesNegativeTestJSON-1944334537-project Jul 12 11:50:28.747386 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:50:28.747386 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.747386 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '86b7d384-5f54-44be-9eda-4a88ee5280a5'} Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:28.748442 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. Jul 12 11:50:28.749817 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:28.754388 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-450a2c03-0089-4840-9d06-458703372618 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] Returning 404 to user: Instance 86b7d384-5f54-44be-9eda-4a88ee5280a5 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:28.755518 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-450a2c03-0089-4840-9d06-458703372618 tempest-ImagesNegativeTestJSON-1944334537 tempest-ImagesNegativeTestJSON-1944334537-project] 10.222.0.50 "GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5" status: 404 len: 111 microversion: 2.1 time: 0.068784 Jul 12 11:50:28.759787 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 230/435] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:28 2022] GET /compute/v2.1/servers/86b7d384-5f54-44be-9eda-4a88ee5280a5 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:28.802792 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-322a7fb2-2f25-4cf1-97d2-9a0f702f24be tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:28.803591 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-322a7fb2-2f25-4cf1-97d2-9a0f702f24be tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:28.815291 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-322a7fb2-2f25-4cf1-97d2-9a0f702f24be tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:28.818644 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-322a7fb2-2f25-4cf1-97d2-9a0f702f24be tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:28.822006 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-322a7fb2-2f25-4cf1-97d2-9a0f702f24be tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:28.824003 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-322a7fb2-2f25-4cf1-97d2-9a0f702f24be tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:29.066013 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-53deb360-d905-45dd-8cfd-5c7a42b3eced tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:29.075516 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-53deb360-d905-45dd-8cfd-5c7a42b3eced tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:29.082980 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53deb360-d905-45dd-8cfd-5c7a42b3eced tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:29.086788 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53deb360-d905-45dd-8cfd-5c7a42b3eced tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:29.087822 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53deb360-d905-45dd-8cfd-5c7a42b3eced tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:29.088495 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53deb360-d905-45dd-8cfd-5c7a42b3eced tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:29.612374 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-53deb360-d905-45dd-8cfd-5c7a42b3eced tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:29.633603 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-53deb360-d905-45dd-8cfd-5c7a42b3eced tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1318 microversion: 2.1 time: 0.568776 Jul 12 11:50:29.637527 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 231/436] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:29 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1318 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:29.650633 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d12fb83a-8de4-43ad-a48c-00b3858f7574 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:29.651594 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d12fb83a-8de4-43ad-a48c-00b3858f7574 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:29.679142 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d12fb83a-8de4-43ad-a48c-00b3858f7574 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:29.685582 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d12fb83a-8de4-43ad-a48c-00b3858f7574 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:29.686349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d12fb83a-8de4-43ad-a48c-00b3858f7574 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:29.686800 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d12fb83a-8de4-43ad-a48c-00b3858f7574 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:29.986205 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-322a7fb2-2f25-4cf1-97d2-9a0f702f24be tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:30.000633 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-322a7fb2-2f25-4cf1-97d2-9a0f702f24be tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1475 microversion: 2.1 time: 1.202088 Jul 12 11:50:30.004104 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 206/437] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:28 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1475 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:30.016084 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-5f20f0ad-6fb2-4d1d-9527-d3e59adb817e req-c4cb0691-800d-47ca-b258-455e6c3d7dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e100f265-e0cc-405b-87d0-d4c524c2e333", "name": "network-vif-unplugged", "status": "completed", "tag": "46a1ed7f-84a2-4d5e-b3d7-20e1261b3c88"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:30.033143 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-5f20f0ad-6fb2-4d1d-9527-d3e59adb817e req-c4cb0691-800d-47ca-b258-455e6c3d7dda service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:30.041405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-5f20f0ad-6fb2-4d1d-9527-d3e59adb817e req-c4cb0691-800d-47ca-b258-455e6c3d7dda service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:30.061022 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-5f20f0ad-6fb2-4d1d-9527-d3e59adb817e req-c4cb0691-800d-47ca-b258-455e6c3d7dda service nova] Creating event network-vif-unplugged:46a1ed7f-84a2-4d5e-b3d7-20e1261b3c88 for instance e100f265-e0cc-405b-87d0-d4c524c2e333 on n-h2-849104-4 Jul 12 11:50:30.074667 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [req-5f20f0ad-6fb2-4d1d-9527-d3e59adb817e req-c4cb0691-800d-47ca-b258-455e6c3d7dda service nova] Instance e100f265-e0cc-405b-87d0-d4c524c2e333 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849104-4', 'n-h1-849104-4'} {{(pid=125983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 12 11:50:30.101733 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-5f20f0ad-6fb2-4d1d-9527-d3e59adb817e req-c4cb0691-800d-47ca-b258-455e6c3d7dda service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096087 Jul 12 11:50:30.102650 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 207/438] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:30.656246 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7c1fa6d4-1263-463f-b27d-98c404999e60 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:30.658438 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7c1fa6d4-1263-463f-b27d-98c404999e60 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:30.664342 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d12fb83a-8de4-43ad-a48c-00b3858f7574 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:30.679686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c1fa6d4-1263-463f-b27d-98c404999e60 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:30.680077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c1fa6d4-1263-463f-b27d-98c404999e60 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:30.680867 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c1fa6d4-1263-463f-b27d-98c404999e60 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:30.680981 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d12fb83a-8de4-43ad-a48c-00b3858f7574 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1323 microversion: 2.1 time: 1.041847 Jul 12 11:50:30.681300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c1fa6d4-1263-463f-b27d-98c404999e60 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:30.682696 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 232/439] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:29 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1323 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:31.027766 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3ae61c0f-0ea8-497b-a80c-1ae7504f4f95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:31.028458 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3ae61c0f-0ea8-497b-a80c-1ae7504f4f95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:31.049052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3ae61c0f-0ea8-497b-a80c-1ae7504f4f95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:31.050300 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3ae61c0f-0ea8-497b-a80c-1ae7504f4f95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:31.054344 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3ae61c0f-0ea8-497b-a80c-1ae7504f4f95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:31.055481 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3ae61c0f-0ea8-497b-a80c-1ae7504f4f95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:31.664622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3ae61c0f-0ea8-497b-a80c-1ae7504f4f95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:31.686628 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3ae61c0f-0ea8-497b-a80c-1ae7504f4f95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1475 microversion: 2.1 time: 0.661072 Jul 12 11:50:31.705379 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 233/440] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:31 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1475 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:31.715200 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1da66ee4-f1ea-4e06-8e9e-27799b343d54 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:31.716603 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1da66ee4-f1ea-4e06-8e9e-27799b343d54 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:31.718248 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=10 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:31.738161 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1da66ee4-f1ea-4e06-8e9e-27799b343d54 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:31.743794 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1da66ee4-f1ea-4e06-8e9e-27799b343d54 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:31.744955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1da66ee4-f1ea-4e06-8e9e-27799b343d54 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:31.745629 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1da66ee4-f1ea-4e06-8e9e-27799b343d54 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:31.762940 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=14 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:32.219626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1da66ee4-f1ea-4e06-8e9e-27799b343d54 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:32.231929 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1da66ee4-f1ea-4e06-8e9e-27799b343d54 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1323 microversion: 2.1 time: 0.525221 Jul 12 11:50:32.234873 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 234/441] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:31 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1323 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:32.256970 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-cc82ab08-6a6d-4363-b5a3-705f8e86ccfd req-9b6c0fec-b5ca-4aea-819f-b2d171a1008d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e100f265-e0cc-405b-87d0-d4c524c2e333", "tag": "46a1ed7f-84a2-4d5e-b3d7-20e1261b3c88"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:32.291526 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-cc82ab08-6a6d-4363-b5a3-705f8e86ccfd req-9b6c0fec-b5ca-4aea-819f-b2d171a1008d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:32.293769 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-cc82ab08-6a6d-4363-b5a3-705f8e86ccfd req-9b6c0fec-b5ca-4aea-819f-b2d171a1008d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:32.322889 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:32.334054 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-cc82ab08-6a6d-4363-b5a3-705f8e86ccfd req-9b6c0fec-b5ca-4aea-819f-b2d171a1008d service nova] Creating event network-changed:46a1ed7f-84a2-4d5e-b3d7-20e1261b3c88 for instance e100f265-e0cc-405b-87d0-d4c524c2e333 on n-h2-849104-4 Jul 12 11:50:32.373534 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [req-cc82ab08-6a6d-4363-b5a3-705f8e86ccfd req-9b6c0fec-b5ca-4aea-819f-b2d171a1008d service nova] Instance e100f265-e0cc-405b-87d0-d4c524c2e333 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849104-4', 'n-h1-849104-4'} {{(pid=125984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 12 11:50:32.394236 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-cc82ab08-6a6d-4363-b5a3-705f8e86ccfd req-9b6c0fec-b5ca-4aea-819f-b2d171a1008d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156629 Jul 12 11:50:32.403507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7c1fa6d4-1263-463f-b27d-98c404999e60 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:32.404682 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 235/442] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:32.447576 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7c1fa6d4-1263-463f-b27d-98c404999e60 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1318 microversion: 2.1 time: 1.796420 Jul 12 11:50:32.458106 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 208/443] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:30 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1318 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:32.707297 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-eb05c122-f15a-44ea-af68-83bc0453c157 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:32.714326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-eb05c122-f15a-44ea-af68-83bc0453c157 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:32.740530 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb05c122-f15a-44ea-af68-83bc0453c157 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:32.751433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb05c122-f15a-44ea-af68-83bc0453c157 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:32.756068 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb05c122-f15a-44ea-af68-83bc0453c157 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:32.757496 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb05c122-f15a-44ea-af68-83bc0453c157 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:32.913697 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-689401555", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "d3804aae-e5e6-40af-a993-2653361ea3e0"}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:33.030977 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] validate_networks() for [('d3804aae-e5e6-40af-a993-2653361ea3e0', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:50:33.966493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eb05c122-f15a-44ea-af68-83bc0453c157 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:33.974401 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-eb05c122-f15a-44ea-af68-83bc0453c157 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1475 microversion: 2.1 time: 1.272041 Jul 12 11:50:33.990427 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 209/444] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:32 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1475 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:34.003635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0ad28998-5354-4cd9-838f-865308673bb3 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:34.005365 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0ad28998-5354-4cd9-838f-865308673bb3 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:34.027866 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ad28998-5354-4cd9-838f-865308673bb3 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:34.033877 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ad28998-5354-4cd9-838f-865308673bb3 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:34.035415 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ad28998-5354-4cd9-838f-865308673bb3 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:34.036059 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ad28998-5354-4cd9-838f-865308673bb3 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:34.502690 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0ad28998-5354-4cd9-838f-865308673bb3 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:34.519200 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0ad28998-5354-4cd9-838f-865308673bb3 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1323 microversion: 2.1 time: 0.527327 Jul 12 11:50:34.519819 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 210/445] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:33 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1323 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:34.532799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-19ffd57d-f078-496d-aa4a-6e33be520ee3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:34.533667 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-19ffd57d-f078-496d-aa4a-6e33be520ee3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:34.544409 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-19ffd57d-f078-496d-aa4a-6e33be520ee3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:34.545109 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-19ffd57d-f078-496d-aa4a-6e33be520ee3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:34.546065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-19ffd57d-f078-496d-aa4a-6e33be520ee3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:34.546662 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-19ffd57d-f078-496d-aa4a-6e33be520ee3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:34.851399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:50:34.853352 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:50:34.855488 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:50:34.856850 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:50:34.858136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:50:34.878668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:34.879612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:34.881427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:34.882245 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:34.931346 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Getting quotas for project d9393a32f934440e975f62b7d59eed32. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:34.941749 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Getting quotas for user 86ca9c0d2f474f1f9c35aaf5fb9c6064 and project d9393a32f934440e975f62b7d59eed32. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:34.984697 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:50:34.988445 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:50:35.127003 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1c01a603-ca1b-49d1-a28c-b96b78d890e8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.693190 Jul 12 11:50:35.130662 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 236/446] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:50:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:50:35.546854 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8345b030-ae09-40f4-a512-ced8a1d59082 tempest-InstanceUsageAuditLogTestJSON-800722954 tempest-InstanceUsageAuditLogTestJSON-800722954-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:35.548685 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:35.548685 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:35.580846 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8345b030-ae09-40f4-a512-ced8a1d59082 tempest-InstanceUsageAuditLogTestJSON-800722954 tempest-InstanceUsageAuditLogTestJSON-800722954-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-12 11:50:33" status: 200 len: 318 microversion: 2.1 time: 0.446764 Jul 12 11:50:35.590198 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 237/447] 10.222.0.50 () {58 vars in 1250 bytes} [Tue Jul 12 11:50:35 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-12%2011%3A50%3A33 => generated 318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:35.600677 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-19ffd57d-f078-496d-aa4a-6e33be520ee3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:35.612201 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-19ffd57d-f078-496d-aa4a-6e33be520ee3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1318 microversion: 2.1 time: 1.090627 Jul 12 11:50:35.623071 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 211/448] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:34 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1318 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:35.639554 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e28d55d5-9c88-4834-b7c1-a90e181a5c8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:35.641265 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e28d55d5-9c88-4834-b7c1-a90e181a5c8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:35.648968 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e28d55d5-9c88-4834-b7c1-a90e181a5c8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:35.649641 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e28d55d5-9c88-4834-b7c1-a90e181a5c8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:35.651015 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e28d55d5-9c88-4834-b7c1-a90e181a5c8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:35.651600 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e28d55d5-9c88-4834-b7c1-a90e181a5c8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:35.703772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-590351912", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:35.810662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] validate_networks() for None {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:50:35.918765 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e28d55d5-9c88-4834-b7c1-a90e181a5c8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:35.929034 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e28d55d5-9c88-4834-b7c1-a90e181a5c8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1473 microversion: 2.1 time: 0.304509 Jul 12 11:50:35.929625 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 212/449] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:35 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1473 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:35.948391 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-71f07bb2-5419-4d5c-a767-d55f1880d1b3 req-23de5cb6-a48a-40ab-94ea-582c9c7478fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da438037-1861-4a92-8be3-267aa902bcfa", "tag": "e0a67407-6851-4155-aed9-b269c71d7329"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:35.957927 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-71f07bb2-5419-4d5c-a767-d55f1880d1b3 req-23de5cb6-a48a-40ab-94ea-582c9c7478fe service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:35.958599 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-71f07bb2-5419-4d5c-a767-d55f1880d1b3 req-23de5cb6-a48a-40ab-94ea-582c9c7478fe service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:35.979824 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-71f07bb2-5419-4d5c-a767-d55f1880d1b3 req-23de5cb6-a48a-40ab-94ea-582c9c7478fe service nova] Creating event network-changed:e0a67407-6851-4155-aed9-b269c71d7329 for instance da438037-1861-4a92-8be3-267aa902bcfa on n-h2-849104-4 Jul 12 11:50:35.996205 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-71f07bb2-5419-4d5c-a767-d55f1880d1b3 req-23de5cb6-a48a-40ab-94ea-582c9c7478fe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051787 Jul 12 11:50:35.997039 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 213/450] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:36.005263 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-073f6df5-63df-4d0d-a5e9-f601318c198c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:36.009329 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-073f6df5-63df-4d0d-a5e9-f601318c198c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:36.136200 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-073f6df5-63df-4d0d-a5e9-f601318c198c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:36.146455 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-073f6df5-63df-4d0d-a5e9-f601318c198c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1210 microversion: 2.1 time: 0.147882 Jul 12 11:50:36.147582 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 214/451] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:35 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1210 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:36.152391 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-327b2583-09f5-481f-bd04-9f24aaf461b5 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:36.153019 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-327b2583-09f5-481f-bd04-9f24aaf461b5 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:36.160164 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-327b2583-09f5-481f-bd04-9f24aaf461b5 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:36.160914 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-327b2583-09f5-481f-bd04-9f24aaf461b5 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:36.161703 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-327b2583-09f5-481f-bd04-9f24aaf461b5 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:36.162154 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-327b2583-09f5-481f-bd04-9f24aaf461b5 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:36.345931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-327b2583-09f5-481f-bd04-9f24aaf461b5 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:36.355240 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-327b2583-09f5-481f-bd04-9f24aaf461b5 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1323 microversion: 2.1 time: 0.206538 Jul 12 11:50:36.357696 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 215/452] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:36 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1323 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:36.363458 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0ea69965-6f56-41c7-ab38-2ee13fea9414 tempest-InstanceUsageAuditLogTestJSON-800722954 tempest-InstanceUsageAuditLogTestJSON-800722954-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:36.364933 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:36.364933 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:36.389299 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0ea69965-6f56-41c7-ab38-2ee13fea9414 tempest-InstanceUsageAuditLogTestJSON-800722954 tempest-InstanceUsageAuditLogTestJSON-800722954-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.030087 Jul 12 11:50:36.390445 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 216/453] 10.222.0.50 () {58 vars in 1184 bytes} [Tue Jul 12 11:50:36 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:36.629632 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8b1cee59-6803-45ad-b2ce-87bd8ad0caf0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:36.630980 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8b1cee59-6803-45ad-b2ce-87bd8ad0caf0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:36.638776 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8b1cee59-6803-45ad-b2ce-87bd8ad0caf0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:36.642658 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8b1cee59-6803-45ad-b2ce-87bd8ad0caf0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:36.644708 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8b1cee59-6803-45ad-b2ce-87bd8ad0caf0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:36.646790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8b1cee59-6803-45ad-b2ce-87bd8ad0caf0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:36.724808 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:50:36.725363 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:50:36.725699 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:50:36.726111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:50:36.726527 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:50:36.743097 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:36.743559 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:36.744394 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:36.744834 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:36.819514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:36.831798 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:36.899049 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:50:36.909569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:50:37.084531 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c97781a4-56da-4086-be1f-0b02803d91df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.497789 Jul 12 11:50:37.085241 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 238/454] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:50:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:50:37.113462 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-91342330-0663-4f4f-9d51-d5dd3bf3f28c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:37.114375 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-91342330-0663-4f4f-9d51-d5dd3bf3f28c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:37.141058 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-91342330-0663-4f4f-9d51-d5dd3bf3f28c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:37.157422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-91342330-0663-4f4f-9d51-d5dd3bf3f28c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:37.160362 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-91342330-0663-4f4f-9d51-d5dd3bf3f28c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:37.171209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-91342330-0663-4f4f-9d51-d5dd3bf3f28c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:37.539753 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-91342330-0663-4f4f-9d51-d5dd3bf3f28c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:37.550091 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-91342330-0663-4f4f-9d51-d5dd3bf3f28c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1473 microversion: 2.1 time: 0.462192 Jul 12 11:50:37.552795 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 239/455] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:37 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1473 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:37.564250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-613a6969-1322-43ab-8f8f-f7a109a91326 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:37.564884 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-613a6969-1322-43ab-8f8f-f7a109a91326 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:37.683447 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8b1cee59-6803-45ad-b2ce-87bd8ad0caf0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:37.722476 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8b1cee59-6803-45ad-b2ce-87bd8ad0caf0 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1318 microversion: 2.1 time: 1.096520 Jul 12 11:50:37.724414 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 217/456] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:36 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1318 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:37.749482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b3ddfc16-b41c-4b68-88e9-fc0dc7f191d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:37.757944 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b3ddfc16-b41c-4b68-88e9-fc0dc7f191d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:37.814774 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3ddfc16-b41c-4b68-88e9-fc0dc7f191d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:37.819003 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3ddfc16-b41c-4b68-88e9-fc0dc7f191d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:37.820470 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3ddfc16-b41c-4b68-88e9-fc0dc7f191d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:37.821192 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3ddfc16-b41c-4b68-88e9-fc0dc7f191d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:37.970264 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-613a6969-1322-43ab-8f8f-f7a109a91326 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:38.004582 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-613a6969-1322-43ab-8f8f-f7a109a91326 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1216 microversion: 2.1 time: 0.444847 Jul 12 11:50:38.005487 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 240/457] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:37 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1216 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:38.029805 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f1a76873-7a23-498b-8c4b-46a94b3e3489 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:38.030517 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f1a76873-7a23-498b-8c4b-46a94b3e3489 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:38.058520 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f1a76873-7a23-498b-8c4b-46a94b3e3489 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:38.059045 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f1a76873-7a23-498b-8c4b-46a94b3e3489 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:38.059998 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f1a76873-7a23-498b-8c4b-46a94b3e3489 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:38.062689 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f1a76873-7a23-498b-8c4b-46a94b3e3489 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:38.406112 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b3ddfc16-b41c-4b68-88e9-fc0dc7f191d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:38.418638 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b3ddfc16-b41c-4b68-88e9-fc0dc7f191d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1262 microversion: 2.1 time: 0.672119 Jul 12 11:50:38.422289 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 218/458] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:37 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1262 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:38.433696 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-15e17456-1f07-43be-8c0d-8b49c398d373 req-160217af-7d36-4656-857d-50e903e049e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cd45543-217b-4a5e-94be-1196a6d8f087", "name": "network-vif-plugged", "status": "completed", "tag": "151e9b0c-ca3b-499d-848a-7f387ea59451"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:38.464809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-15e17456-1f07-43be-8c0d-8b49c398d373 req-160217af-7d36-4656-857d-50e903e049e7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:38.465546 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-15e17456-1f07-43be-8c0d-8b49c398d373 req-160217af-7d36-4656-857d-50e903e049e7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:38.489077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:38.497066 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-15e17456-1f07-43be-8c0d-8b49c398d373 req-160217af-7d36-4656-857d-50e903e049e7 service nova] Creating event network-vif-plugged:151e9b0c-ca3b-499d-848a-7f387ea59451 for instance 9cd45543-217b-4a5e-94be-1196a6d8f087 on n-h1-849104-4 Jul 12 11:50:38.514053 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-15e17456-1f07-43be-8c0d-8b49c398d373 req-160217af-7d36-4656-857d-50e903e049e7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088019 Jul 12 11:50:38.517437 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 219/459] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:38.571779 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b01e39bb-4cad-4047-8a2b-714a729d7cb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:38.574416 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b01e39bb-4cad-4047-8a2b-714a729d7cb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:38.590715 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b01e39bb-4cad-4047-8a2b-714a729d7cb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:38.592822 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b01e39bb-4cad-4047-8a2b-714a729d7cb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:38.595297 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b01e39bb-4cad-4047-8a2b-714a729d7cb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:38.598259 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b01e39bb-4cad-4047-8a2b-714a729d7cb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:38.724300 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f1a76873-7a23-498b-8c4b-46a94b3e3489 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:38.737700 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f1a76873-7a23-498b-8c4b-46a94b3e3489 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1323 microversion: 2.1 time: 0.727405 Jul 12 11:50:38.738339 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 241/460] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:38 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1323 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:38.746523 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f8de070c-0c81-495c-8c58-878eb8cc270e tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:38.747139 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f8de070c-0c81-495c-8c58-878eb8cc270e tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:38.757640 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:38.761433 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8de070c-0c81-495c-8c58-878eb8cc270e tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:38.762116 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8de070c-0c81-495c-8c58-878eb8cc270e tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:38.763039 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8de070c-0c81-495c-8c58-878eb8cc270e tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:38.763697 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8de070c-0c81-495c-8c58-878eb8cc270e tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:39.296712 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b01e39bb-4cad-4047-8a2b-714a729d7cb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:39.306380 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b01e39bb-4cad-4047-8a2b-714a729d7cb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1470 microversion: 2.1 time: 0.739849 Jul 12 11:50:39.323338 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 220/461] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:38 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1470 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:39.327790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e679f6ec-b296-4576-b308-0d6049c46115 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:39.332876 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e679f6ec-b296-4576-b308-0d6049c46115 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:39.355835 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e679f6ec-b296-4576-b308-0d6049c46115 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:39.361457 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e679f6ec-b296-4576-b308-0d6049c46115 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:39.366957 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e679f6ec-b296-4576-b308-0d6049c46115 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:39.369867 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e679f6ec-b296-4576-b308-0d6049c46115 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:39.622923 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e679f6ec-b296-4576-b308-0d6049c46115 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:39.649810 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e679f6ec-b296-4576-b308-0d6049c46115 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1274 microversion: 2.1 time: 0.329490 Jul 12 11:50:39.664793 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 221/462] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:39 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1274 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:39.677684 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-89a7e2b5-1b26-4137-8ac4-a409a2c18662 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:39.679080 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-89a7e2b5-1b26-4137-8ac4-a409a2c18662 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:39.699559 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89a7e2b5-1b26-4137-8ac4-a409a2c18662 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:39.701072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89a7e2b5-1b26-4137-8ac4-a409a2c18662 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:39.704770 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89a7e2b5-1b26-4137-8ac4-a409a2c18662 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:39.705935 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89a7e2b5-1b26-4137-8ac4-a409a2c18662 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:39.790568 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f8de070c-0c81-495c-8c58-878eb8cc270e tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:39.802258 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:39.824602 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f8de070c-0c81-495c-8c58-878eb8cc270e tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1318 microversion: 2.1 time: 1.084737 Jul 12 11:50:39.825607 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 242/463] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:38 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1318 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:39.853028 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ff54fb4c-e4e2-449e-8acd-b6f99fe1c6c4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:39.854348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ff54fb4c-e4e2-449e-8acd-b6f99fe1c6c4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:39.865822 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-89a7e2b5-1b26-4137-8ac4-a409a2c18662 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "POST /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333/action" status: 204 len: 0 microversion: 2.1 time: 0.199192 Jul 12 11:50:39.866573 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ff54fb4c-e4e2-449e-8acd-b6f99fe1c6c4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:39.868516 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ff54fb4c-e4e2-449e-8acd-b6f99fe1c6c4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:39.870007 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 222/464] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:50:39 2022] POST /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333/action => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:50:39.870636 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ff54fb4c-e4e2-449e-8acd-b6f99fe1c6c4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:39.871764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ff54fb4c-e4e2-449e-8acd-b6f99fe1c6c4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:39.881456 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5c10f4cb-8fd0-4a9a-a018-5df915242c4d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:39.882197 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5c10f4cb-8fd0-4a9a-a018-5df915242c4d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:39.889864 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5c10f4cb-8fd0-4a9a-a018-5df915242c4d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:39.890688 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5c10f4cb-8fd0-4a9a-a018-5df915242c4d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:39.892376 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5c10f4cb-8fd0-4a9a-a018-5df915242c4d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:39.892979 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5c10f4cb-8fd0-4a9a-a018-5df915242c4d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:40.161976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ff54fb4c-e4e2-449e-8acd-b6f99fe1c6c4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:40.181697 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ff54fb4c-e4e2-449e-8acd-b6f99fe1c6c4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1268 microversion: 2.1 time: 0.337543 Jul 12 11:50:40.183335 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 243/465] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:39 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1268 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:40.207729 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a26458b2-1322-4315-a028-b02117ee9961 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:40.210233 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a26458b2-1322-4315-a028-b02117ee9961 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:40.233568 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a26458b2-1322-4315-a028-b02117ee9961 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:40.236156 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a26458b2-1322-4315-a028-b02117ee9961 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:40.237194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a26458b2-1322-4315-a028-b02117ee9961 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:40.240695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a26458b2-1322-4315-a028-b02117ee9961 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:40.290134 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5c10f4cb-8fd0-4a9a-a018-5df915242c4d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:40.311068 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5c10f4cb-8fd0-4a9a-a018-5df915242c4d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1323 microversion: 2.1 time: 0.439800 Jul 12 11:50:40.312103 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 223/466] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:39 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1323 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:40.681885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4eae9183-e23a-4710-933b-7834d3c5cf56 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:40.682541 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4eae9183-e23a-4710-933b-7834d3c5cf56 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:40.690236 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4eae9183-e23a-4710-933b-7834d3c5cf56 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:40.690697 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4eae9183-e23a-4710-933b-7834d3c5cf56 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:40.691842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4eae9183-e23a-4710-933b-7834d3c5cf56 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:40.692321 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4eae9183-e23a-4710-933b-7834d3c5cf56 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:40.843039 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a26458b2-1322-4315-a028-b02117ee9961 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:40.852734 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a26458b2-1322-4315-a028-b02117ee9961 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1470 microversion: 2.1 time: 0.667435 Jul 12 11:50:40.853396 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 244/467] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:40 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1470 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:40.858741 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d0cb60b0-f41c-4f05-ac4f-1e75917eaa3a tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:40.859695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d0cb60b0-f41c-4f05-ac4f-1e75917eaa3a tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:40.869033 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0cb60b0-f41c-4f05-ac4f-1e75917eaa3a tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:40.869887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0cb60b0-f41c-4f05-ac4f-1e75917eaa3a tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:40.870889 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0cb60b0-f41c-4f05-ac4f-1e75917eaa3a tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:40.871563 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0cb60b0-f41c-4f05-ac4f-1e75917eaa3a tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:41.149755 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4eae9183-e23a-4710-933b-7834d3c5cf56 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:41.164814 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4eae9183-e23a-4710-933b-7834d3c5cf56 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1274 microversion: 2.1 time: 0.489867 Jul 12 11:50:41.165839 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 224/468] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:40 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1274 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:41.201711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-659447dc-8950-4f47-b15f-c5408884c63f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:41.202313 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-659447dc-8950-4f47-b15f-c5408884c63f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:41.217098 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-659447dc-8950-4f47-b15f-c5408884c63f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:41.218124 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-659447dc-8950-4f47-b15f-c5408884c63f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:41.219226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-659447dc-8950-4f47-b15f-c5408884c63f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:41.225566 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-659447dc-8950-4f47-b15f-c5408884c63f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:41.328824 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d0cb60b0-f41c-4f05-ac4f-1e75917eaa3a tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:41.339202 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d0cb60b0-f41c-4f05-ac4f-1e75917eaa3a tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1318 microversion: 2.1 time: 0.483651 Jul 12 11:50:41.350970 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 245/469] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:40 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:41.357204 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f5d73e4e-3c61-46ff-8b07-48c50df65c88 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:41.358042 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f5d73e4e-3c61-46ff-8b07-48c50df65c88 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:41.368162 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5d73e4e-3c61-46ff-8b07-48c50df65c88 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:41.368865 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5d73e4e-3c61-46ff-8b07-48c50df65c88 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:41.369984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5d73e4e-3c61-46ff-8b07-48c50df65c88 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:41.370703 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5d73e4e-3c61-46ff-8b07-48c50df65c88 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:41.550933 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-659447dc-8950-4f47-b15f-c5408884c63f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:41.571068 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-659447dc-8950-4f47-b15f-c5408884c63f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1268 microversion: 2.1 time: 0.374271 Jul 12 11:50:41.572625 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 225/470] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:41 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1268 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:41.871341 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f82bc36e-420e-432f-b090-eeae628d06bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:41.871954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f82bc36e-420e-432f-b090-eeae628d06bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:41.884555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f82bc36e-420e-432f-b090-eeae628d06bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:41.886264 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f82bc36e-420e-432f-b090-eeae628d06bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:41.888657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f82bc36e-420e-432f-b090-eeae628d06bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:41.891739 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f82bc36e-420e-432f-b090-eeae628d06bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:42.252967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f5d73e4e-3c61-46ff-8b07-48c50df65c88 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:42.262190 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f5d73e4e-3c61-46ff-8b07-48c50df65c88 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1473 microversion: 2.1 time: 0.909873 Jul 12 11:50:42.267979 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 246/471] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:41 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1473 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:42.287883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a0f786bb-2426-4b0a-aee7-e4b35779e28e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:42.288718 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a0f786bb-2426-4b0a-aee7-e4b35779e28e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:42.314417 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0f786bb-2426-4b0a-aee7-e4b35779e28e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:42.315026 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0f786bb-2426-4b0a-aee7-e4b35779e28e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:42.316711 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0f786bb-2426-4b0a-aee7-e4b35779e28e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:42.317309 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0f786bb-2426-4b0a-aee7-e4b35779e28e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:42.854119 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f82bc36e-420e-432f-b090-eeae628d06bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:42.876463 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f82bc36e-420e-432f-b090-eeae628d06bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1470 microversion: 2.1 time: 1.009028 Jul 12 11:50:42.877647 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 226/472] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:41 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1470 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:42.887892 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-41e82fe1-cec6-4df2-8713-ca6b61375952 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:42.888667 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-41e82fe1-cec6-4df2-8713-ca6b61375952 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:42.896541 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-41e82fe1-cec6-4df2-8713-ca6b61375952 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:42.898339 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-41e82fe1-cec6-4df2-8713-ca6b61375952 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:42.899474 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-41e82fe1-cec6-4df2-8713-ca6b61375952 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:42.900454 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-41e82fe1-cec6-4df2-8713-ca6b61375952 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:42.934614 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-41e82fe1-cec6-4df2-8713-ca6b61375952 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-41e82fe1-cec6-4df2-8713-ca6b61375952 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Request method failure captured: Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087/diagnostics HTTP/1.1 Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_2j9BnHiJ6xeqXANh7E3q2xjYDfSYKpCcH9LvBSGw6C8-dyU2Ur9DwEYrmRjbQZvt4rsOQDq0spulyd22uQikPHgg-OXNBahXUuKzGsYtU068eU4FdE_lnB9UTZRvQ7u2VszDcLqIiy8sbDBEhA8bhWHlKogNwpANxVjTGYcRvCyQ Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 9e002ce28f634fce8ba26179a838e06f Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1462341937 Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:50:42.938405 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:50:42.939869 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e002ce28f634fce8ba26179a838e06f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e002ce28f634fce8ba26179a838e06f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9e002ce28f634fce8ba26179a838e06f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9e002ce28f634fce8ba26179a838e06f", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:42.939869 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1462341937 Jul 12 11:50:42.939869 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 9e002ce28f634fce8ba26179a838e06f Jul 12 11:50:42.939869 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1462341937 Jul 12 11:50:42.939869 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServerDiagnosticsNegativeTest-1462341937-project Jul 12 11:50:42.939869 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:50:42.939869 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:50:42.939869 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: d4a0531e6f154ebda9d67aa23bce427f Jul 12 11:50:42.939869 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1462341937-project Jul 12 11:50:42.939869 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:50:42.939869 n-d-849104-4 devstack@n-api.service[125983]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'server_id': '9cd45543-217b-4a5e-94be-1196a6d8f087'} Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:50:42.940603 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 12 11:50:42.941897 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:50:42.948538 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-41e82fe1-cec6-4df2-8713-ca6b61375952 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:42.949689 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-41e82fe1-cec6-4df2-8713-ca6b61375952 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.070851 Jul 12 11:50:42.951503 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 227/473] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:50:42 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087/diagnostics => generated 117 bytes in 73 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:42.956745 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a8616d37-dbc0-4640-b972-514209391fbb tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:42.957828 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a8616d37-dbc0-4640-b972-514209391fbb tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:42.966998 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a8616d37-dbc0-4640-b972-514209391fbb tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:42.967750 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a8616d37-dbc0-4640-b972-514209391fbb tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:42.971559 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a8616d37-dbc0-4640-b972-514209391fbb tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:42.972308 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a8616d37-dbc0-4640-b972-514209391fbb tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:42.975244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a0f786bb-2426-4b0a-aee7-e4b35779e28e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:43.003300 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a0f786bb-2426-4b0a-aee7-e4b35779e28e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1316 microversion: 2.1 time: 0.732074 Jul 12 11:50:43.004115 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 247/474] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:42 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1316 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:43.023207 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7116b030-21f7-43f2-909d-a85cdab4459c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:43.023961 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7116b030-21f7-43f2-909d-a85cdab4459c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:43.040135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7116b030-21f7-43f2-909d-a85cdab4459c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:43.040860 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7116b030-21f7-43f2-909d-a85cdab4459c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:43.043927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7116b030-21f7-43f2-909d-a85cdab4459c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:43.048935 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7116b030-21f7-43f2-909d-a85cdab4459c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:44.041466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7116b030-21f7-43f2-909d-a85cdab4459c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:44.048312 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7116b030-21f7-43f2-909d-a85cdab4459c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1310 microversion: 2.1 time: 1.038568 Jul 12 11:50:44.048894 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 248/475] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:43 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1310 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:44.053560 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c9644454-ff7f-4be0-92aa-179c465205f1 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:44.054068 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c9644454-ff7f-4be0-92aa-179c465205f1 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:44.081263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c9644454-ff7f-4be0-92aa-179c465205f1 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:44.082289 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c9644454-ff7f-4be0-92aa-179c465205f1 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:44.083571 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c9644454-ff7f-4be0-92aa-179c465205f1 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:44.084319 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c9644454-ff7f-4be0-92aa-179c465205f1 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:44.128934 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c9644454-ff7f-4be0-92aa-179c465205f1 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:50:44.199035 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a8616d37-dbc0-4640-b972-514209391fbb tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:44.207648 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a8616d37-dbc0-4640-b972-514209391fbb tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1318 microversion: 2.1 time: 1.254802 Jul 12 11:50:44.218376 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 228/476] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:42 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1318 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:44.225354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-4abba85e-a105-4ca3-a126-8c41c41c5970 req-1d911b4c-83b8-43a3-9f85-0e292a9367b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e100f265-e0cc-405b-87d0-d4c524c2e333", "name": "network-vif-plugged", "status": "completed", "tag": "46a1ed7f-84a2-4d5e-b3d7-20e1261b3c88"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:44.234872 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4abba85e-a105-4ca3-a126-8c41c41c5970 req-1d911b4c-83b8-43a3-9f85-0e292a9367b9 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:44.236295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4abba85e-a105-4ca3-a126-8c41c41c5970 req-1d911b4c-83b8-43a3-9f85-0e292a9367b9 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:44.250328 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-4abba85e-a105-4ca3-a126-8c41c41c5970 req-1d911b4c-83b8-43a3-9f85-0e292a9367b9 service nova] Creating event network-vif-plugged:46a1ed7f-84a2-4d5e-b3d7-20e1261b3c88 for instance e100f265-e0cc-405b-87d0-d4c524c2e333 on n-h2-849104-4 Jul 12 11:50:44.263724 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [req-4abba85e-a105-4ca3-a126-8c41c41c5970 req-1d911b4c-83b8-43a3-9f85-0e292a9367b9 service nova] Instance e100f265-e0cc-405b-87d0-d4c524c2e333 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849104-4', 'n-h1-849104-4'} {{(pid=125983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 12 11:50:44.289381 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-4abba85e-a105-4ca3-a126-8c41c41c5970 req-1d911b4c-83b8-43a3-9f85-0e292a9367b9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069081 Jul 12 11:50:44.291115 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 229/477] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:44.303579 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-692c9ecf-d7fc-484b-a73a-55939a7ddabc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:44.306555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-692c9ecf-d7fc-484b-a73a-55939a7ddabc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:44.314736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-692c9ecf-d7fc-484b-a73a-55939a7ddabc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:44.315540 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-692c9ecf-d7fc-484b-a73a-55939a7ddabc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:44.316600 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-692c9ecf-d7fc-484b-a73a-55939a7ddabc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:44.317274 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-692c9ecf-d7fc-484b-a73a-55939a7ddabc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:44.320500 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c9644454-ff7f-4be0-92aa-179c465205f1 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 204 len: 0 microversion: 2.1 time: 0.268733 Jul 12 11:50:44.323081 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 249/478] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:50:44 2022] DELETE /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:50:44.335576 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-78b555ca-4118-4e91-a71e-bfd78f4a3df0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:44.336364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-78b555ca-4118-4e91-a71e-bfd78f4a3df0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:44.369776 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78b555ca-4118-4e91-a71e-bfd78f4a3df0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:44.370241 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78b555ca-4118-4e91-a71e-bfd78f4a3df0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:44.371042 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78b555ca-4118-4e91-a71e-bfd78f4a3df0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:44.371486 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78b555ca-4118-4e91-a71e-bfd78f4a3df0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:44.955700 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-78b555ca-4118-4e91-a71e-bfd78f4a3df0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:44.975321 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-78b555ca-4118-4e91-a71e-bfd78f4a3df0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1316 microversion: 2.1 time: 0.648010 Jul 12 11:50:44.976549 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 250/479] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:44 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1316 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:45.000297 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ead907d7-d770-4a3d-b7ae-3561bb733f0d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:45.003342 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ead907d7-d770-4a3d-b7ae-3561bb733f0d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:45.018229 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ead907d7-d770-4a3d-b7ae-3561bb733f0d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:45.018683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ead907d7-d770-4a3d-b7ae-3561bb733f0d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:45.019481 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ead907d7-d770-4a3d-b7ae-3561bb733f0d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:45.019921 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ead907d7-d770-4a3d-b7ae-3561bb733f0d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:45.143579 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-692c9ecf-d7fc-484b-a73a-55939a7ddabc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:45.155498 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-692c9ecf-d7fc-484b-a73a-55939a7ddabc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1470 microversion: 2.1 time: 0.859905 Jul 12 11:50:45.156413 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 230/480] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:44 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1470 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:45.169975 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f03bafe0-a1c1-4b5c-8baa-1a5fd6f9f68a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:45.170923 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f03bafe0-a1c1-4b5c-8baa-1a5fd6f9f68a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:45.186049 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f03bafe0-a1c1-4b5c-8baa-1a5fd6f9f68a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:45.189274 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f03bafe0-a1c1-4b5c-8baa-1a5fd6f9f68a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:45.190151 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f03bafe0-a1c1-4b5c-8baa-1a5fd6f9f68a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:45.190644 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f03bafe0-a1c1-4b5c-8baa-1a5fd6f9f68a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:45.561277 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ead907d7-d770-4a3d-b7ae-3561bb733f0d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:45.579731 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ead907d7-d770-4a3d-b7ae-3561bb733f0d tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1479 microversion: 2.1 time: 0.591610 Jul 12 11:50:45.591749 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 251/481] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:44 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1479 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:45.600102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0ca9e7de-84cf-4fa2-9eb1-7fc70668add7 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:45.601216 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0ca9e7de-84cf-4fa2-9eb1-7fc70668add7 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:45.636904 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ca9e7de-84cf-4fa2-9eb1-7fc70668add7 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:45.638011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ca9e7de-84cf-4fa2-9eb1-7fc70668add7 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:45.640929 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ca9e7de-84cf-4fa2-9eb1-7fc70668add7 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:45.641674 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ca9e7de-84cf-4fa2-9eb1-7fc70668add7 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:46.026915 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0ca9e7de-84cf-4fa2-9eb1-7fc70668add7 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:46.047322 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0ca9e7de-84cf-4fa2-9eb1-7fc70668add7 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1318 microversion: 2.1 time: 0.453313 Jul 12 11:50:46.051974 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 252/482] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:45 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:46.087315 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-d079ec97-d604-4a55-bbaa-dbeefa63023f req-c3e7405f-49d5-4a6c-884c-4f8a70d7ce1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3975f6-39e7-4b52-abe1-975c4215f167", "tag": "0722db67-d841-4498-a390-6a19339383b3"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:46.120889 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d079ec97-d604-4a55-bbaa-dbeefa63023f req-c3e7405f-49d5-4a6c-884c-4f8a70d7ce1f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:46.124111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d079ec97-d604-4a55-bbaa-dbeefa63023f req-c3e7405f-49d5-4a6c-884c-4f8a70d7ce1f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:46.152554 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-d079ec97-d604-4a55-bbaa-dbeefa63023f req-c3e7405f-49d5-4a6c-884c-4f8a70d7ce1f service nova] Creating event network-changed:0722db67-d841-4498-a390-6a19339383b3 for instance ae3975f6-39e7-4b52-abe1-975c4215f167 on n-h2-849104-4 Jul 12 11:50:46.165509 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-d079ec97-d604-4a55-bbaa-dbeefa63023f req-c3e7405f-49d5-4a6c-884c-4f8a70d7ce1f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098366 Jul 12 11:50:46.166548 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 253/483] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:46.198292 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-773862f5-db19-4d93-9a57-7c3d9ccb8c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:46.201059 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-773862f5-db19-4d93-9a57-7c3d9ccb8c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:46.218573 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-773862f5-db19-4d93-9a57-7c3d9ccb8c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:46.219350 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-773862f5-db19-4d93-9a57-7c3d9ccb8c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:46.220379 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-773862f5-db19-4d93-9a57-7c3d9ccb8c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:46.221088 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-773862f5-db19-4d93-9a57-7c3d9ccb8c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:46.383821 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=6 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:46.502268 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f03bafe0-a1c1-4b5c-8baa-1a5fd6f9f68a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:46.522327 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f03bafe0-a1c1-4b5c-8baa-1a5fd6f9f68a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1310 microversion: 2.1 time: 1.356138 Jul 12 11:50:46.522958 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 231/484] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:45 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1310 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:46.760647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-773862f5-db19-4d93-9a57-7c3d9ccb8c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:46.780148 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-773862f5-db19-4d93-9a57-7c3d9ccb8c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1316 microversion: 2.1 time: 0.610324 Jul 12 11:50:46.790088 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 254/485] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:46 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1316 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:46.792364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=4 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:46.802749 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e9f39290-5b01-4981-a7db-38adceca933f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:46.806615 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e9f39290-5b01-4981-a7db-38adceca933f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:46.825144 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9f39290-5b01-4981-a7db-38adceca933f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:46.825612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9f39290-5b01-4981-a7db-38adceca933f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:46.826407 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9f39290-5b01-4981-a7db-38adceca933f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:46.826855 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9f39290-5b01-4981-a7db-38adceca933f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:46.853352 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-064071f7-5390-47ff-896e-aac4aeba31ef tempest-ListImagesTestJSON-282547807 tempest-ListImagesTestJSON-282547807-project] Calling method '.version_select at 0x7f5e0b19d4c0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:46.952329 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-064071f7-5390-47ff-896e-aac4aeba31ef tempest-ListImagesTestJSON-282547807 tempest-ListImagesTestJSON-282547807-project] 10.222.0.50 "GET /compute/v2.1/images/5ee904a7-466a-46fc-89be-d728bca3527e" status: 200 len: 784 microversion: 2.1 time: 0.428230 Jul 12 11:50:46.966167 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 232/486] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 11:50:46 2022] GET /compute/v2.1/images/5ee904a7-466a-46fc-89be-d728bca3527e => generated 784 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:46.974739 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-5f791f34-709c-471e-bb0a-7549c089c2fe req-e5b54d81-52f4-4359-8133-97041a53938c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da438037-1861-4a92-8be3-267aa902bcfa", "name": "network-vif-plugged", "status": "completed", "tag": "e0a67407-6851-4155-aed9-b269c71d7329"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:47.020115 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-5f791f34-709c-471e-bb0a-7549c089c2fe req-e5b54d81-52f4-4359-8133-97041a53938c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:47.021010 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-5f791f34-709c-471e-bb0a-7549c089c2fe req-e5b54d81-52f4-4359-8133-97041a53938c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:47.052395 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-5f791f34-709c-471e-bb0a-7549c089c2fe req-e5b54d81-52f4-4359-8133-97041a53938c service nova] Creating event network-vif-plugged:e0a67407-6851-4155-aed9-b269c71d7329 for instance da438037-1861-4a92-8be3-267aa902bcfa on n-h2-849104-4 Jul 12 11:50:47.064057 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-5f791f34-709c-471e-bb0a-7549c089c2fe req-e5b54d81-52f4-4359-8133-97041a53938c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092494 Jul 12 11:50:47.065213 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 233/487] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:47.071165 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-b4e9f146-8117-4b2c-b2b2-b460e61b37ad req-09a49d83-228c-4178-b29d-61dd5169133f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df49a9f0-90aa-4bd7-91c8-1df741ab59a3", "tag": "88b8b92e-2020-4be2-b13b-31bb1eee241a"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:47.092244 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-b4e9f146-8117-4b2c-b2b2-b460e61b37ad req-09a49d83-228c-4178-b29d-61dd5169133f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:47.093184 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-b4e9f146-8117-4b2c-b2b2-b460e61b37ad req-09a49d83-228c-4178-b29d-61dd5169133f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:47.107201 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-b4e9f146-8117-4b2c-b2b2-b460e61b37ad req-09a49d83-228c-4178-b29d-61dd5169133f service nova] Creating event network-changed:88b8b92e-2020-4be2-b13b-31bb1eee241a for instance df49a9f0-90aa-4bd7-91c8-1df741ab59a3 on n-h1-849104-4 Jul 12 11:50:47.113223 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-b4e9f146-8117-4b2c-b2b2-b460e61b37ad req-09a49d83-228c-4178-b29d-61dd5169133f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046402 Jul 12 11:50:47.114437 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 234/488] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:47.121038 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4211fc83-aa6e-4d7f-8b5e-0f031edb7cf0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:47.122055 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4211fc83-aa6e-4d7f-8b5e-0f031edb7cf0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:47.130152 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4211fc83-aa6e-4d7f-8b5e-0f031edb7cf0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:47.131222 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4211fc83-aa6e-4d7f-8b5e-0f031edb7cf0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:47.132890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4211fc83-aa6e-4d7f-8b5e-0f031edb7cf0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:47.133585 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4211fc83-aa6e-4d7f-8b5e-0f031edb7cf0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:47.448891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e9f39290-5b01-4981-a7db-38adceca933f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:47.468206 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e9f39290-5b01-4981-a7db-38adceca933f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1462 microversion: 2.1 time: 0.676605 Jul 12 11:50:47.470637 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 255/489] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:46 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1462 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:47.475965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-24d03594-58d0-492c-ae0c-869c8883f1e2 tempest-ListImagesTestJSON-282547807 tempest-ListImagesTestJSON-282547807-project] Calling method '.version_select at 0x7f5e0a651ca0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:47.567561 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-24d03594-58d0-492c-ae0c-869c8883f1e2 tempest-ListImagesTestJSON-282547807 tempest-ListImagesTestJSON-282547807-project] 10.222.0.50 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.095630 Jul 12 11:50:47.600853 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 256/490] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 11:50:47 2022] GET /compute/v2.1/images => generated 445 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:47.615398 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-258da7ef-d5fd-4a48-bcdc-4a76173c85ae tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:47.615398 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-258da7ef-d5fd-4a48-bcdc-4a76173c85ae tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:47.626528 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-258da7ef-d5fd-4a48-bcdc-4a76173c85ae tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:47.627127 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-258da7ef-d5fd-4a48-bcdc-4a76173c85ae tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:47.629261 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-258da7ef-d5fd-4a48-bcdc-4a76173c85ae tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:47.629994 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-258da7ef-d5fd-4a48-bcdc-4a76173c85ae tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:47.813172 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4211fc83-aa6e-4d7f-8b5e-0f031edb7cf0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:47.825081 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4211fc83-aa6e-4d7f-8b5e-0f031edb7cf0 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1479 microversion: 2.1 time: 0.708504 Jul 12 11:50:47.825849 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 235/491] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:47 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1479 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:47.835633 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-36bdcd31-1242-4d3c-ae05-70d3f435cec9 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:47.836722 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-36bdcd31-1242-4d3c-ae05-70d3f435cec9 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:47.844312 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-36bdcd31-1242-4d3c-ae05-70d3f435cec9 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:47.845096 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-36bdcd31-1242-4d3c-ae05-70d3f435cec9 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:47.848331 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-36bdcd31-1242-4d3c-ae05-70d3f435cec9 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:47.848811 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-36bdcd31-1242-4d3c-ae05-70d3f435cec9 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:47.879275 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-258da7ef-d5fd-4a48-bcdc-4a76173c85ae tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:47.894314 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-258da7ef-d5fd-4a48-bcdc-4a76173c85ae tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1318 microversion: 2.1 time: 0.290929 Jul 12 11:50:47.896617 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 257/492] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:47 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:47.909122 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-69d8faa7-bf58-4bc0-b80b-4caf7973c74f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:47.914124 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-69d8faa7-bf58-4bc0-b80b-4caf7973c74f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:47.923076 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-69d8faa7-bf58-4bc0-b80b-4caf7973c74f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:47.924686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-69d8faa7-bf58-4bc0-b80b-4caf7973c74f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:47.925695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-69d8faa7-bf58-4bc0-b80b-4caf7973c74f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:47.926422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-69d8faa7-bf58-4bc0-b80b-4caf7973c74f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:47.984294 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=18 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:48.468847 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-36bdcd31-1242-4d3c-ae05-70d3f435cec9 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1613 microversion: 2.1 time: 0.641096 Jul 12 11:50:48.492768 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 236/493] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:47 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1613 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:48.501513 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c38f825d-d330-49ec-9184-b29c1f224ef0 tempest-ListImagesTestJSON-282547807 tempest-ListImagesTestJSON-282547807-project] Calling method '.version_select at 0x7f5e0b19d790>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:48.557242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-69d8faa7-bf58-4bc0-b80b-4caf7973c74f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:48.573803 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-69d8faa7-bf58-4bc0-b80b-4caf7973c74f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1310 microversion: 2.1 time: 0.675579 Jul 12 11:50:48.575749 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 258/494] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:47 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1310 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:48.576173 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c38f825d-d330-49ec-9184-b29c1f224ef0 tempest-ListImagesTestJSON-282547807 tempest-ListImagesTestJSON-282547807-project] 10.222.0.50 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.080767 Jul 12 11:50:48.578248 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 237/495] 10.222.0.50 () {58 vars in 1142 bytes} [Tue Jul 12 11:50:48 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:48.587147 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e4801099-9996-45c3-92f0-83e4b5d0a8eb tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Calling method '.version_select at 0x7f5e0b18cee0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:48.588506 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-18707efe-bdc8-4442-9a56-0a9d4d328c3a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:48.589441 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-18707efe-bdc8-4442-9a56-0a9d4d328c3a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:48.598245 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-18707efe-bdc8-4442-9a56-0a9d4d328c3a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:48.599067 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-18707efe-bdc8-4442-9a56-0a9d4d328c3a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:48.600241 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-18707efe-bdc8-4442-9a56-0a9d4d328c3a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:48.600841 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-18707efe-bdc8-4442-9a56-0a9d4d328c3a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:48.624956 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:48.639578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4801099-9996-45c3-92f0-83e4b5d0a8eb tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:48.640084 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4801099-9996-45c3-92f0-83e4b5d0a8eb tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:48.655939 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e4801099-9996-45c3-92f0-83e4b5d0a8eb tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.075836 Jul 12 11:50:48.656889 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 238/496] 10.222.0.50 () {58 vars in 1142 bytes} [Tue Jul 12 11:50:48 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:48.847003 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7c62cb36-8c2c-4e81-b641-80ecd3ed56d4 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:48.847928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7c62cb36-8c2c-4e81-b641-80ecd3ed56d4 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:48.858570 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c62cb36-8c2c-4e81-b641-80ecd3ed56d4 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:48.859128 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c62cb36-8c2c-4e81-b641-80ecd3ed56d4 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:48.868409 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c62cb36-8c2c-4e81-b641-80ecd3ed56d4 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:48.868939 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c62cb36-8c2c-4e81-b641-80ecd3ed56d4 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:48.908431 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-18707efe-bdc8-4442-9a56-0a9d4d328c3a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:48.920502 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-18707efe-bdc8-4442-9a56-0a9d4d328c3a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1316 microversion: 2.1 time: 0.341770 Jul 12 11:50:48.931933 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 259/497] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:48 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:48.937159 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d6c101ed-2fd7-4dc3-98b0-ce79c1223e47 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:48.937934 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d6c101ed-2fd7-4dc3-98b0-ce79c1223e47 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:48.946744 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6c101ed-2fd7-4dc3-98b0-ce79c1223e47 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:48.948406 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6c101ed-2fd7-4dc3-98b0-ce79c1223e47 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:48.949511 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6c101ed-2fd7-4dc3-98b0-ce79c1223e47 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:48.950174 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6c101ed-2fd7-4dc3-98b0-ce79c1223e47 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:48.968584 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c62cb36-8c2c-4e81-b641-80ecd3ed56d4 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:48.969934 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c62cb36-8c2c-4e81-b641-80ecd3ed56d4 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:48.970660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-7c62cb36-8c2c-4e81-b641-80ecd3ed56d4 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lazy-loading 'fault' on Instance uuid 9cd45543-217b-4a5e-94be-1196a6d8f087 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:50:48.979382 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:49.089245 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7c62cb36-8c2c-4e81-b641-80ecd3ed56d4 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a0531e6f154ebda9d67aa23bce427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e002ce28f634fce8ba26179a838e06f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:49.100511 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7c62cb36-8c2c-4e81-b641-80ecd3ed56d4 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 200 len: 1313 microversion: 2.1 time: 0.258010 Jul 12 11:50:49.107169 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 239/498] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:48 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:49.196525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d6c101ed-2fd7-4dc3-98b0-ce79c1223e47 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:49.209549 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d6c101ed-2fd7-4dc3-98b0-ce79c1223e47 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1318 microversion: 2.1 time: 0.276159 Jul 12 11:50:49.209997 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 260/499] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:48 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:49.216297 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-457030282", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:49.310971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] validate_networks() for None {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:50:49.493523 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-41c93c48-4810-4c5e-8670-47c77aac4d20 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:49.509309 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-41c93c48-4810-4c5e-8670-47c77aac4d20 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.400618 Jul 12 11:50:49.512315 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 240/500] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:50:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:49.528655 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-5fdacf7a-aa43-4308-a614-e79d5d9eb5a3 req-8f67e9df-3bda-4e9d-ba00-4cc4b12e80d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cd45543-217b-4a5e-94be-1196a6d8f087", "name": "network-vif-deleted", "tag": "151e9b0c-ca3b-499d-848a-7f387ea59451"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:49.550469 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-5fdacf7a-aa43-4308-a614-e79d5d9eb5a3 req-8f67e9df-3bda-4e9d-ba00-4cc4b12e80d4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:49.553114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-5fdacf7a-aa43-4308-a614-e79d5d9eb5a3 req-8f67e9df-3bda-4e9d-ba00-4cc4b12e80d4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:49.576285 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-5fdacf7a-aa43-4308-a614-e79d5d9eb5a3 req-8f67e9df-3bda-4e9d-ba00-4cc4b12e80d4 service nova] Creating event network-vif-deleted:151e9b0c-ca3b-499d-848a-7f387ea59451 for instance 9cd45543-217b-4a5e-94be-1196a6d8f087 on n-h1-849104-4 Jul 12 11:50:49.600160 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-5fdacf7a-aa43-4308-a614-e79d5d9eb5a3 req-8f67e9df-3bda-4e9d-ba00-4cc4b12e80d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083494 Jul 12 11:50:49.604356 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 241/501] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:49.680263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:50:49.680957 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:50:49.681652 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:50:49.682484 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:50:49.683174 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:50:49.696697 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:49.697256 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:49.698164 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:49.698670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:49.718076 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Getting quotas for project 4c6a6e22d13840698ada0866ea3f4913. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:49.724880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Getting quotas for user d42140cf6bac4674ba0515ca28531222 and project 4c6a6e22d13840698ada0866ea3f4913. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:49.741377 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:50:49.745341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:50:49.873232 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5db0896f-e58d-4c3a-a8b6-7fae11964d35 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660271 Jul 12 11:50:49.875083 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 261/502] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:50:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:50:49.882330 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-17404be2-aaa4-4a80-8e8b-84eec5c0aa32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:49.889173 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-17404be2-aaa4-4a80-8e8b-84eec5c0aa32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:49.905293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17404be2-aaa4-4a80-8e8b-84eec5c0aa32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:49.906084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17404be2-aaa4-4a80-8e8b-84eec5c0aa32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:49.909286 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17404be2-aaa4-4a80-8e8b-84eec5c0aa32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:49.910927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17404be2-aaa4-4a80-8e8b-84eec5c0aa32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:50.131249 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e4913d9e-251c-4623-af49-9fac5d6f06f5 tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-631150231", "id": 1512588295, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:50.133173 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:50.133173 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:50.212358 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e4913d9e-251c-4623-af49-9fac5d6f06f5 tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.602449 Jul 12 11:50:50.236808 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 242/503] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:50:49 2022] POST /compute/v2.1/flavors => generated 424 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:50.245144 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3dea5aff-f40f-4ed7-a7e6-abf43269a512 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:50.247654 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3dea5aff-f40f-4ed7-a7e6-abf43269a512 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:50.533174 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3dea5aff-f40f-4ed7-a7e6-abf43269a512 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:50.549282 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3dea5aff-f40f-4ed7-a7e6-abf43269a512 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1212 microversion: 2.1 time: 0.311095 Jul 12 11:50:50.558772 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 243/504] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:50 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1212 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:50.590376 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d79e8cb8-3bb2-4f14-9e51-c6143b4c393f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:50.591181 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d79e8cb8-3bb2-4f14-9e51-c6143b4c393f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:50.615203 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:50.636124 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d79e8cb8-3bb2-4f14-9e51-c6143b4c393f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:50.637263 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d79e8cb8-3bb2-4f14-9e51-c6143b4c393f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:50.638546 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d79e8cb8-3bb2-4f14-9e51-c6143b4c393f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:50.643741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d79e8cb8-3bb2-4f14-9e51-c6143b4c393f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:50.884842 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-17404be2-aaa4-4a80-8e8b-84eec5c0aa32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:50.898243 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-17404be2-aaa4-4a80-8e8b-84eec5c0aa32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1310 microversion: 2.1 time: 1.021364 Jul 12 11:50:50.899747 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 262/505] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:49 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1310 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:50.914705 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5a65798f-b702-4918-9211-6d1e23730f02 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:50.916205 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5a65798f-b702-4918-9211-6d1e23730f02 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] [instance: 9cd45543-217b-4a5e-94be-1196a6d8f087] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:50.928167 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a65798f-b702-4918-9211-6d1e23730f02 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:50.932150 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a65798f-b702-4918-9211-6d1e23730f02 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:50.938716 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a65798f-b702-4918-9211-6d1e23730f02 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:50.939997 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a65798f-b702-4918-9211-6d1e23730f02 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:50.977516 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-5a65798f-b702-4918-9211-6d1e23730f02 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] HTTP exception thrown: Instance 9cd45543-217b-4a5e-94be-1196a6d8f087 could not be found. Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5a65798f-b702-4918-9211-6d1e23730f02 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Request method failure captured: Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 HTTP/1.1 Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_2j9BnHiJ6xeqXANh7E3q2xjYDfSYKpCcH9LvBSGw6C8-dyU2Ur9DwEYrmRjbQZvt4rsOQDq0spulyd22uQikPHgg-OXNBahXUuKzGsYtU068eU4FdE_lnB9UTZRvQ7u2VszDcLqIiy8sbDBEhA8bhWHlKogNwpANxVjTGYcRvCyQ Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 9e002ce28f634fce8ba26179a838e06f Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1462341937 Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:50:51.008045 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:50:51.009714 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e002ce28f634fce8ba26179a838e06f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e002ce28f634fce8ba26179a838e06f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9e002ce28f634fce8ba26179a838e06f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9e002ce28f634fce8ba26179a838e06f", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:51.009714 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1462341937 Jul 12 11:50:51.009714 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 9e002ce28f634fce8ba26179a838e06f Jul 12 11:50:51.009714 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1462341937 Jul 12 11:50:51.009714 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServerDiagnosticsNegativeTest-1462341937-project Jul 12 11:50:51.009714 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:51.009714 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:51.009714 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: d4a0531e6f154ebda9d67aa23bce427f Jul 12 11:50:51.009714 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1462341937-project Jul 12 11:50:51.009714 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:50:51.009714 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 9cd45543-217b-4a5e-94be-1196a6d8f087 could not be found. Jul 12 11:50:51.009714 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '9cd45543-217b-4a5e-94be-1196a6d8f087'} Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cd45543-217b-4a5e-94be-1196a6d8f087 could not be found. Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:51.010540 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cd45543-217b-4a5e-94be-1196a6d8f087 could not be found. Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cd45543-217b-4a5e-94be-1196a6d8f087 could not be found. Jul 12 11:50:51.011946 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:51.014121 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5a65798f-b702-4918-9211-6d1e23730f02 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] Returning 404 to user: Instance 9cd45543-217b-4a5e-94be-1196a6d8f087 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:51.015152 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5a65798f-b702-4918-9211-6d1e23730f02 tempest-ServerDiagnosticsNegativeTest-1462341937 tempest-ServerDiagnosticsNegativeTest-1462341937-project] 10.222.0.50 "GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087" status: 404 len: 111 microversion: 2.1 time: 0.114082 Jul 12 11:50:51.019371 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 263/506] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:50 2022] GET /compute/v2.1/servers/9cd45543-217b-4a5e-94be-1196a6d8f087 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:50:51.028478 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4f8a4e04-fc78-4f80-a40c-fb7755660030 tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:51.045387 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4f8a4e04-fc78-4f80-a40c-fb7755660030 tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024602 Jul 12 11:50:51.052123 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 264/507] 10.222.0.50 () {58 vars in 1181 bytes} [Tue Jul 12 11:50:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:50:51.077459 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-20215009-5f56-4c24-896e-1e97e23b034f tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:51.078352 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-20215009-5f56-4c24-896e-1e97e23b034f tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:51.084924 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20215009-5f56-4c24-896e-1e97e23b034f tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:51.085857 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20215009-5f56-4c24-896e-1e97e23b034f tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:51.086823 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20215009-5f56-4c24-896e-1e97e23b034f tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:51.089512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20215009-5f56-4c24-896e-1e97e23b034f tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:51.316012 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d79e8cb8-3bb2-4f14-9e51-c6143b4c393f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:51.325392 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d79e8cb8-3bb2-4f14-9e51-c6143b4c393f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1316 microversion: 2.1 time: 0.764157 Jul 12 11:50:51.325969 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 244/508] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:50 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1316 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:51.347936 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-167ced2e-e73d-480e-908f-a036095c9eb9 tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1787368591", "id": 284031101, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:51.368895 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:51.368895 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:50:51.422929 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-167ced2e-e73d-480e-908f-a036095c9eb9 tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.091974 Jul 12 11:50:51.423713 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 245/509] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:50:51 2022] POST /compute/v2.1/flavors => generated 422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:51.434006 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-439cc081-5b83-41ce-9915-70438c52f70b tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:51.474008 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-439cc081-5b83-41ce-9915-70438c52f70b tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.043543 Jul 12 11:50:51.480248 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 246/510] 10.222.0.50 () {58 vars in 1181 bytes} [Tue Jul 12 11:50:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:50:51.499778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cef97cf5-cd0f-4ea0-a837-2d357fda4690 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Action: 'create', calling method: .version_select at 0x7f5e0b19d700>, body: {"keypair": {"name": "tempest-keypair-1689767150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC41lkbprJqLS7hJrAL2BNowwf/Dug0e2vxipc5NzdjzQW759k0ymM5oPG494rBRtgEQdMYVdqqsnoxSuc6kQMxbtLOzANXlA1Y77I+0k5I3cbcQCNgZI9f5eO+7AmQYUw=="}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:51.589352 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-cef97cf5-cd0f-4ea0-a837-2d357fda4690 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Getting quotas for project 1394824ad6fd4ef686fafb5fb3c0b4e1. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:51.607250 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-cef97cf5-cd0f-4ea0-a837-2d357fda4690 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Getting quotas for user 02fcbf37964b49dfb597a4a1e95a299c and project 1394824ad6fd4ef686fafb5fb3c0b4e1. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:51.703287 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cef97cf5-cd0f-4ea0-a837-2d357fda4690 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.216920 Jul 12 11:50:51.706108 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 247/511] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:50:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:51.722114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-aa39db3a-06d7-4b84-a828-a4b98a915b23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:51.723718 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-aa39db3a-06d7-4b84-a828-a4b98a915b23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:51.759454 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aa39db3a-06d7-4b84-a828-a4b98a915b23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:51.759965 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aa39db3a-06d7-4b84-a828-a4b98a915b23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:51.760837 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aa39db3a-06d7-4b84-a828-a4b98a915b23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:51.761287 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aa39db3a-06d7-4b84-a828-a4b98a915b23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:51.799680 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-20215009-5f56-4c24-896e-1e97e23b034f tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:51.824601 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-20215009-5f56-4c24-896e-1e97e23b034f tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1468 microversion: 2.1 time: 0.770985 Jul 12 11:50:51.830622 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 265/512] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:51 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1468 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:51.947298 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-aa39db3a-06d7-4b84-a828-a4b98a915b23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:51.963755 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-aa39db3a-06d7-4b84-a828-a4b98a915b23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1264 microversion: 2.1 time: 0.252970 Jul 12 11:50:51.964436 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 248/513] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:51 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1264 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:51.985366 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-17a8090a-ad1a-40a0-90c6-38538fd4d6c9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:51.986563 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-17a8090a-ad1a-40a0-90c6-38538fd4d6c9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:52.008914 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-17a8090a-ad1a-40a0-90c6-38538fd4d6c9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:52.011890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-17a8090a-ad1a-40a0-90c6-38538fd4d6c9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:52.017675 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-17a8090a-ad1a-40a0-90c6-38538fd4d6c9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:52.018869 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-17a8090a-ad1a-40a0-90c6-38538fd4d6c9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:52.582702 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-17a8090a-ad1a-40a0-90c6-38538fd4d6c9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:52.601260 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-17a8090a-ad1a-40a0-90c6-38538fd4d6c9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1310 microversion: 2.1 time: 0.634017 Jul 12 11:50:52.604965 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 249/514] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:51 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1310 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:52.610052 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d34da10c-30b6-40f2-bdb4-7a0c46bd3de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:52.623121 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d34da10c-30b6-40f2-bdb4-7a0c46bd3de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:52.632731 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d254c00e-f050-47a7-bf6a-a11280bfc44e tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1697312413", "block_migration": true, "disk_over_commit": false}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:52.638966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d34da10c-30b6-40f2-bdb4-7a0c46bd3de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:52.639427 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d34da10c-30b6-40f2-bdb4-7a0c46bd3de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:52.640260 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d34da10c-30b6-40f2-bdb4-7a0c46bd3de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:52.640997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d34da10c-30b6-40f2-bdb4-7a0c46bd3de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:52.644586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d254c00e-f050-47a7-bf6a-a11280bfc44e tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:52.671671 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d254c00e-f050-47a7-bf6a-a11280bfc44e tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:52.673900 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d254c00e-f050-47a7-bf6a-a11280bfc44e tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:52.679622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d254c00e-f050-47a7-bf6a-a11280bfc44e tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:52.686020 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d254c00e-f050-47a7-bf6a-a11280bfc44e tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:53.040811 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-d254c00e-f050-47a7-bf6a-a11280bfc44e tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lazy-loading 'flavor' on Instance uuid da438037-1861-4a92-8be3-267aa902bcfa {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:50:53.116308 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d254c00e-f050-47a7-bf6a-a11280bfc44e tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Going to try to live migrate instance to tempest-host-1697312413 {{(pid=125984) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 12 11:50:53.162437 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-d254c00e-f050-47a7-bf6a-a11280bfc44e tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] HTTP exception thrown: Compute host tempest-host-1697312413 could not be found. Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d254c00e-f050-47a7-bf6a-a11280bfc44e tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Request method failure captured: Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa/action HTTP/1.1 Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 107 Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_70XjGZJWDVYC33v2_JDmyS6BeAk4xMBGxvyHh1a70jp1rNqHfLwA0eBDox7gr-I95wz_ZEOXBZ7yRrtHtCTD4WX7SfYQhogtI0rAikX8XdpHF14ZDd-2HJdRqVQsUOx-1FOamnSRsNPWp_viWk3n5kc3MAh52AUafOGyHTx9MKY4 Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d593caa655dd49fab180a18f8018d20a Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-LiveMigrationNegativeTest-696013187 Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:50:53.166975 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:50:53.168341 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d593caa655dd49fab180a18f8018d20a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d593caa655dd49fab180a18f8018d20a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d593caa655dd49fab180a18f8018d20a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d593caa655dd49fab180a18f8018d20a", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:50:53.168341 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-LiveMigrationNegativeTest-696013187 Jul 12 11:50:53.168341 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d593caa655dd49fab180a18f8018d20a Jul 12 11:50:53.168341 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-696013187 Jul 12 11:50:53.168341 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-LiveMigrationNegativeTest-696013187-project-admin Jul 12 11:50:53.168341 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:50:53.168341 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:50:53.168341 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: b3d223e6a56c41bc90d0aca89601a6df Jul 12 11:50:53.168341 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-LiveMigrationNegativeTest-696013187-project-admin Jul 12 11:50:53.168341 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:50:53.168341 n-d-849104-4 devstack@n-api.service[125984]: {"os-migrateLive": {"host": "tempest-host-1697312413", "block_migration": true, "disk_over_commit": false}} Jul 12 11:50:53.168341 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: exception: Compute host tempest-host-1697312413 could not be found. Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'da438037-1861-4a92-8be3-267aa902bcfa', 'body': {'os-migrateLive': {'host': 'tempest-host-1697312413', 'block_migration': True, 'disk_over_commit': False}}} Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 11:50:53.169125 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1697312413 could not be found. Jul 12 11:50:53.170287 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1697312413 could not be found. Jul 12 11:50:53.171363 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:53.173342 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:50:53.173342 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:53.173342 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:50:53.173342 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:50:53.173342 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:50:53.173342 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:50:53.173342 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:50:53.173342 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1697312413 could not be found. Jul 12 11:50:53.173342 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:50:53.179195 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d254c00e-f050-47a7-bf6a-a11280bfc44e tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Returning 400 to user: Compute host tempest-host-1697312413 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:50:53.182626 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d254c00e-f050-47a7-bf6a-a11280bfc44e tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa/action" status: 400 len: 100 microversion: 2.1 time: 1.341301 Jul 12 11:50:53.189452 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 266/515] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Jul 12 11:50:51 2022] POST /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa/action => generated 100 bytes in 1349 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:50:53.199119 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e21d8f92-f011-40ee-8be0-626a4acf76ce tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:53.201010 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e21d8f92-f011-40ee-8be0-626a4acf76ce tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:53.210481 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e21d8f92-f011-40ee-8be0-626a4acf76ce tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:53.211393 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e21d8f92-f011-40ee-8be0-626a4acf76ce tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:53.212432 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e21d8f92-f011-40ee-8be0-626a4acf76ce tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:53.214233 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e21d8f92-f011-40ee-8be0-626a4acf76ce tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:53.415532 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e21d8f92-f011-40ee-8be0-626a4acf76ce tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:53.437697 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e21d8f92-f011-40ee-8be0-626a4acf76ce tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1270 microversion: 2.1 time: 0.245284 Jul 12 11:50:53.439166 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 267/516] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:53 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1270 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:53.463315 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9fbc47a7-39d7-443e-bae4-eb1760682b7d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:53.466122 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9fbc47a7-39d7-443e-bae4-eb1760682b7d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:53.483198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9fbc47a7-39d7-443e-bae4-eb1760682b7d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:53.485348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9fbc47a7-39d7-443e-bae4-eb1760682b7d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:53.486694 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9fbc47a7-39d7-443e-bae4-eb1760682b7d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:53.488568 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9fbc47a7-39d7-443e-bae4-eb1760682b7d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:53.762664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d34da10c-30b6-40f2-bdb4-7a0c46bd3de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:53.771364 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d34da10c-30b6-40f2-bdb4-7a0c46bd3de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1316 microversion: 2.1 time: 1.164921 Jul 12 11:50:53.775209 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 250/517] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:52 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1316 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:53.788545 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-826b6c35-7b6c-4816-9313-8f3834c4f597 req-c9edf8f7-0b6f-418d-83dd-5fce42f7ba22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df49a9f0-90aa-4bd7-91c8-1df741ab59a3", "name": "network-vif-plugged", "status": "completed", "tag": "88b8b92e-2020-4be2-b13b-31bb1eee241a"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:53.807401 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-826b6c35-7b6c-4816-9313-8f3834c4f597 req-c9edf8f7-0b6f-418d-83dd-5fce42f7ba22 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:53.808070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-826b6c35-7b6c-4816-9313-8f3834c4f597 req-c9edf8f7-0b6f-418d-83dd-5fce42f7ba22 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:53.830982 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-826b6c35-7b6c-4816-9313-8f3834c4f597 req-c9edf8f7-0b6f-418d-83dd-5fce42f7ba22 service nova] Creating event network-vif-plugged:88b8b92e-2020-4be2-b13b-31bb1eee241a for instance df49a9f0-90aa-4bd7-91c8-1df741ab59a3 on n-h1-849104-4 Jul 12 11:50:53.837118 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-826b6c35-7b6c-4816-9313-8f3834c4f597 req-c9edf8f7-0b6f-418d-83dd-5fce42f7ba22 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059934 Jul 12 11:50:53.838326 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 251/518] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:53.846089 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-16db1ab0-4854-4e81-a747-1e73173b95ce tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:53.846963 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-16db1ab0-4854-4e81-a747-1e73173b95ce tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:53.855549 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16db1ab0-4854-4e81-a747-1e73173b95ce tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:53.856246 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16db1ab0-4854-4e81-a747-1e73173b95ce tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:53.857295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16db1ab0-4854-4e81-a747-1e73173b95ce tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:53.858086 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16db1ab0-4854-4e81-a747-1e73173b95ce tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:53.878987 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9fbc47a7-39d7-443e-bae4-eb1760682b7d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:53.888443 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9fbc47a7-39d7-443e-bae4-eb1760682b7d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1468 microversion: 2.1 time: 0.447827 Jul 12 11:50:53.913535 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 268/519] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:53 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1468 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:54.333923 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d394cf69-6fc6-47a4-80ea-1bba98b8ba0d tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Action: 'create', calling method: .version_select at 0x7f5e0a672d30>, body: {"keypair": {"name": "tempest-keypair-1504145000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZST9A9AVZIM9kpU8NhHyw1rjM3R6Afww+rh4vQiRdqNCfTUjhVMnMwHw9D/d9QPNE1uOghjgdTf9vGX0kt5dFPaQjhFXQLsrIGHFuo7bUtFXvIly+naYGhK+gQXrBG7g=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:54.388002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-d394cf69-6fc6-47a4-80ea-1bba98b8ba0d tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Getting quotas for project e03a896ec60f4b1395cfdcfa359cda8a. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:54.397040 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-d394cf69-6fc6-47a4-80ea-1bba98b8ba0d tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Getting quotas for user 09a764804f394ecdb1203d45931776d3 and project e03a896ec60f4b1395cfdcfa359cda8a. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:54.437387 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d394cf69-6fc6-47a4-80ea-1bba98b8ba0d tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.522660 Jul 12 11:50:54.444745 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 269/520] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:50:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:54.452590 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1648925016", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:54.554858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] validate_networks() for None {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:50:54.570612 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-16db1ab0-4854-4e81-a747-1e73173b95ce tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:54.582647 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-16db1ab0-4854-4e81-a747-1e73173b95ce tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1310 microversion: 2.1 time: 0.742950 Jul 12 11:50:54.583237 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 252/521] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:53 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1310 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:54.596916 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-45d44efe-4593-4042-81b2-57634d0b41c1 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Calling method '.version_select at 0x7f5e0b100ee0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:54.616534 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-45d44efe-4593-4042-81b2-57634d0b41c1 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-1504145000" status: 200 len: 497 microversion: 2.1 time: 0.031039 Jul 12 11:50:54.620479 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 253/522] 10.222.0.50 () {58 vars in 1217 bytes} [Tue Jul 12 11:50:54 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1504145000 => generated 497 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:54.628946 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a94beea9-7c39-42f0-bf27-2fa9690b0da5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:54.629789 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a94beea9-7c39-42f0-bf27-2fa9690b0da5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:54.643194 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a94beea9-7c39-42f0-bf27-2fa9690b0da5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:54.644465 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a94beea9-7c39-42f0-bf27-2fa9690b0da5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:54.646169 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a94beea9-7c39-42f0-bf27-2fa9690b0da5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:54.646822 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a94beea9-7c39-42f0-bf27-2fa9690b0da5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:54.742389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a94beea9-7c39-42f0-bf27-2fa9690b0da5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:54.750657 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a94beea9-7c39-42f0-bf27-2fa9690b0da5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1270 microversion: 2.1 time: 0.127630 Jul 12 11:50:54.751780 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 254/523] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:54 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1270 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:54.758428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d962d3df-1042-4796-9832-757fe624caa8 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Calling method '.version_select at 0x7f5e0b100e50>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:54.780708 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d962d3df-1042-4796-9832-757fe624caa8 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504145000" status: 202 len: 0 microversion: 2.1 time: 0.027005 Jul 12 11:50:54.782546 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 255/524] 10.222.0.50 () {58 vars in 1220 bytes} [Tue Jul 12 11:50:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504145000 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:50:54.792783 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-656aafaa-492d-4b62-8261-415f471251b7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:54.793666 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-656aafaa-492d-4b62-8261-415f471251b7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:54.800075 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-656aafaa-492d-4b62-8261-415f471251b7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:54.800733 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-656aafaa-492d-4b62-8261-415f471251b7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:54.801678 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-656aafaa-492d-4b62-8261-415f471251b7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:54.802272 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-656aafaa-492d-4b62-8261-415f471251b7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:55.046325 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-656aafaa-492d-4b62-8261-415f471251b7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:55.059946 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-656aafaa-492d-4b62-8261-415f471251b7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1316 microversion: 2.1 time: 0.272736 Jul 12 11:50:55.065027 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 256/525] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:54 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:50:55.072677 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3752b022-35d7-41ea-985c-0d8b9ab60093 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Action: 'create', calling method: .version_select at 0x7f5e0b100a60>, body: {"keypair": {"name": "tempest-keypair-1742611205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjXIj9EossrQKSsfnkrGwkWejPZKS+QPPVAFBZHJIEMXi8oKXI35otZkJOqvHEVRSxyXvojeXR9qAGtofttb8QLUWqL/Uwxv0T1Dp5RINxpMpxpbOQ00/+GGJZh1Cf0bw=="}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:55.139972 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-3752b022-35d7-41ea-985c-0d8b9ab60093 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Getting quotas for project e03a896ec60f4b1395cfdcfa359cda8a. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:55.150730 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-3752b022-35d7-41ea-985c-0d8b9ab60093 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Getting quotas for user 09a764804f394ecdb1203d45931776d3 and project e03a896ec60f4b1395cfdcfa359cda8a. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:55.187238 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:50:55.188457 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:50:55.188661 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:50:55.189084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:50:55.190078 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:50:55.204595 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:55.205052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:55.205865 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:55.206376 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:55.208199 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3752b022-35d7-41ea-985c-0d8b9ab60093 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140951 Jul 12 11:50:55.209737 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 257/526] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:50:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:55.221246 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5f7dc81f-8263-429a-bb1b-ae532aff0f91 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Calling method '.version_select at 0x7f5e0b18cdc0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:55.261638 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5f7dc81f-8263-429a-bb1b-ae532aff0f91 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1742611205" status: 202 len: 0 microversion: 2.1 time: 0.042285 Jul 12 11:50:55.263828 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 258/527] 10.222.0.50 () {58 vars in 1220 bytes} [Tue Jul 12 11:50:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1742611205 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 11:50:55.276534 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Getting quotas for project 8fff158fbe4b47d6a0c50888c251e8e7. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:55.278114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-47b044dc-2315-4fd2-8bd4-d10f32796384 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Action: 'create', calling method: .version_select at 0x7f5e0b138d30>, body: {"keypair": {"name": "tempest-keypair-81852862", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:55.285632 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Getting quotas for user 7f4c711ca1f44a2ca6c08ee99931cdcc and project 8fff158fbe4b47d6a0c50888c251e8e7. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:55.309637 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:50:55.318352 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:50:55.324240 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-47b044dc-2315-4fd2-8bd4-d10f32796384 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Getting quotas for project e03a896ec60f4b1395cfdcfa359cda8a. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:55.330392 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-47b044dc-2315-4fd2-8bd4-d10f32796384 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Getting quotas for user 09a764804f394ecdb1203d45931776d3 and project e03a896ec60f4b1395cfdcfa359cda8a. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:55.366684 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-47b044dc-2315-4fd2-8bd4-d10f32796384 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.099050 Jul 12 11:50:55.374740 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 259/528] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:50:55 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:50:55.382504 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4f234f1a-7955-4110-933a-337608d9823b tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Calling method '.version_select at 0x7f5e0b138160>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:55.407869 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ac4605a2-8558-4935-b345-d127caed2939 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.960194 Jul 12 11:50:55.409395 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4f234f1a-7955-4110-933a-337608d9823b tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-81852862" status: 202 len: 0 microversion: 2.1 time: 0.032479 Jul 12 11:50:55.410390 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 270/529] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:50:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:50:55.415815 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 260/530] 10.222.0.50 () {58 vars in 1214 bytes} [Tue Jul 12 11:50:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-81852862 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:50:55.428270 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-743671a6-4571-45d4-bd29-9405a7213490 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:55.429157 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-743671a6-4571-45d4-bd29-9405a7213490 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:55.430884 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1261896427", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "284031101", "adminPass": "***", "networks": [{"uuid": "98e42d9e-f92f-4dc1-a841-97dff5f12b22"}], "security_groups": [{"name": "tempest-securitygroup--554754351"}], "key_name": "tempest-keypair-1689767150", "user_data": "}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:55.439980 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:50:55.613338 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] validate_networks() for [('98e42d9e-f92f-4dc1-a841-97dff5f12b22', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:50:55.634741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-743671a6-4571-45d4-bd29-9405a7213490 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:55.643617 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-743671a6-4571-45d4-bd29-9405a7213490 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1219 microversion: 2.1 time: 0.225591 Jul 12 11:50:55.657775 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 261/531] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:55 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1219 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:55.663619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e46f59eb-d036-4a04-93c3-121967ef7338 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Action: 'create', calling method: .version_select at 0x7f5e0b1d1d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1523884114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2B0R0Kj/2dGDh8yX140nmxudbl9KD4Qpi1Tx+jOPHxJKM04+utJJYvM4YiCGJYQ9OJ/0TwS3PhyWGq6cWzGc+EUG0rTZcjsBjNFh0MaF7t5+s1QYbvPzPI+5NVpMQdcg=="}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:55.702249 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-e46f59eb-d036-4a04-93c3-121967ef7338 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Getting quotas for project e03a896ec60f4b1395cfdcfa359cda8a. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:55.711486 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-e46f59eb-d036-4a04-93c3-121967ef7338 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Getting quotas for user 09a764804f394ecdb1203d45931776d3 and project e03a896ec60f4b1395cfdcfa359cda8a. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:55.771488 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e46f59eb-d036-4a04-93c3-121967ef7338 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.112262 Jul 12 11:50:55.779798 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 262/532] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:50:55 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:55.785542 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c482934b-c9ac-4022-a85f-3dcca07e05fb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:55.786792 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c482934b-c9ac-4022-a85f-3dcca07e05fb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:55.793761 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c482934b-c9ac-4022-a85f-3dcca07e05fb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:55.794420 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c482934b-c9ac-4022-a85f-3dcca07e05fb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:55.795347 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c482934b-c9ac-4022-a85f-3dcca07e05fb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:55.795964 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c482934b-c9ac-4022-a85f-3dcca07e05fb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:56.495435 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c482934b-c9ac-4022-a85f-3dcca07e05fb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:56.544916 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c482934b-c9ac-4022-a85f-3dcca07e05fb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1310 microversion: 2.1 time: 0.763595 Jul 12 11:50:56.545511 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 263/533] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:55 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1310 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:56.557007 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f97f3d76-9596-4205-9272-d335624d0938 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:56.557741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f97f3d76-9596-4205-9272-d335624d0938 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:56.578445 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f97f3d76-9596-4205-9272-d335624d0938 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:56.578906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f97f3d76-9596-4205-9272-d335624d0938 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:56.582023 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f97f3d76-9596-4205-9272-d335624d0938 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:56.583424 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f97f3d76-9596-4205-9272-d335624d0938 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:56.713171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:50:56.714545 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:50:56.715234 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:50:56.715937 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:50:56.716739 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:50:56.741693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:56.744862 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:56.748856 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:56.751068 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:56.780190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Getting quotas for project 1394824ad6fd4ef686fafb5fb3c0b4e1. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:56.787942 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Getting quotas for user 02fcbf37964b49dfb597a4a1e95a299c and project 1394824ad6fd4ef686fafb5fb3c0b4e1. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:56.801998 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:50:56.808569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:50:56.881073 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-951b2d46-867d-4200-a0cc-d5a71816c7fe tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.469121 Jul 12 11:50:56.886752 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 271/534] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:50:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:50:56.887737 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3c6b8bcf-fa89-4b5a-9958-c50d4cf9493d tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Action: 'create', calling method: .version_select at 0x7f5e0a505160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-516463389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXyEVu6x9b7W1v9d1DYiCj82iZ3f4Ztx7zaLwLAifXmjk4RMq6UkijIPrf0N1hrpG9KDeE+pw+3Ls37tJfw55SveoFEdE7b+TKF3/O787yDv7OdJvULjjvCw9Qij2zkYA=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:56.931116 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-3c6b8bcf-fa89-4b5a-9958-c50d4cf9493d tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Getting quotas for project e03a896ec60f4b1395cfdcfa359cda8a. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:56.945864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-3c6b8bcf-fa89-4b5a-9958-c50d4cf9493d tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Getting quotas for user 09a764804f394ecdb1203d45931776d3 and project e03a896ec60f4b1395cfdcfa359cda8a. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:56.978174 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3c6b8bcf-fa89-4b5a-9958-c50d4cf9493d tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.093876 Jul 12 11:50:56.986729 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 272/535] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:50:56 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:57.003397 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-6d85d393-59e8-460b-a853-a2c93eada2fe req-f4156980-000f-404e-a1c1-4086c4ab9a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3975f6-39e7-4b52-abe1-975c4215f167", "name": "network-vif-plugged", "status": "completed", "tag": "0722db67-d841-4498-a390-6a19339383b3"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:57.035851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-6d85d393-59e8-460b-a853-a2c93eada2fe req-f4156980-000f-404e-a1c1-4086c4ab9a16 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:57.037416 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-6d85d393-59e8-460b-a853-a2c93eada2fe req-f4156980-000f-404e-a1c1-4086c4ab9a16 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:57.064608 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-6d85d393-59e8-460b-a853-a2c93eada2fe req-f4156980-000f-404e-a1c1-4086c4ab9a16 service nova] Creating event network-vif-plugged:0722db67-d841-4498-a390-6a19339383b3 for instance ae3975f6-39e7-4b52-abe1-975c4215f167 on n-h2-849104-4 Jul 12 11:50:57.073916 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-6d85d393-59e8-460b-a853-a2c93eada2fe req-f4156980-000f-404e-a1c1-4086c4ab9a16 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085289 Jul 12 11:50:57.075542 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 273/536] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:57.084662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-211d02a3-2cfc-4a3f-bfe5-86c606fbee03 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:57.085696 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-211d02a3-2cfc-4a3f-bfe5-86c606fbee03 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:57.103323 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-211d02a3-2cfc-4a3f-bfe5-86c606fbee03 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:57.103774 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-211d02a3-2cfc-4a3f-bfe5-86c606fbee03 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:57.104607 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-211d02a3-2cfc-4a3f-bfe5-86c606fbee03 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:57.105044 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-211d02a3-2cfc-4a3f-bfe5-86c606fbee03 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:57.452225 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-211d02a3-2cfc-4a3f-bfe5-86c606fbee03 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:57.465683 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-211d02a3-2cfc-4a3f-bfe5-86c606fbee03 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1466 microversion: 2.1 time: 0.388485 Jul 12 11:50:57.467136 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 274/537] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:57 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1466 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:57.507453 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6ef7291e-3af4-496d-906b-61f541b5d190 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:57.510034 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6ef7291e-3af4-496d-906b-61f541b5d190 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:57.522236 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ef7291e-3af4-496d-906b-61f541b5d190 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:57.522748 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ef7291e-3af4-496d-906b-61f541b5d190 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:57.523551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ef7291e-3af4-496d-906b-61f541b5d190 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:57.528886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ef7291e-3af4-496d-906b-61f541b5d190 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:57.619020 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6ef7291e-3af4-496d-906b-61f541b5d190 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:57.629207 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6ef7291e-3af4-496d-906b-61f541b5d190 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1277 microversion: 2.1 time: 0.140605 Jul 12 11:50:57.630681 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 275/538] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:57 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1277 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:57.636621 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5e52422b-21aa-4f5a-b8ca-ca09432a7a8a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:57.637642 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5e52422b-21aa-4f5a-b8ca-ca09432a7a8a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:57.751598 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5e52422b-21aa-4f5a-b8ca-ca09432a7a8a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:57.764671 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5e52422b-21aa-4f5a-b8ca-ca09432a7a8a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1263 microversion: 2.1 time: 0.132563 Jul 12 11:50:57.777545 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 276/539] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:57 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1263 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:57.791478 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-323a4b51-213f-4ca1-9426-dd0227366687 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Action: 'create', calling method: .version_select at 0x7f5e0a641d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-58580297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMgFMseM2T9xspDcHZ1//ZehU1HNEkEllal6nIQg+RlmMbogPFTZvquD10URgkz5BexmRPXJWSJ7mk3bdMRi8nICr8RJlqRLx5YAXC9LGdsCIOVKzzRGKfhJIg5sENbFg=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:50:57.817603 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-323a4b51-213f-4ca1-9426-dd0227366687 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Getting quotas for project e03a896ec60f4b1395cfdcfa359cda8a. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:50:57.824506 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-323a4b51-213f-4ca1-9426-dd0227366687 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Getting quotas for user 09a764804f394ecdb1203d45931776d3 and project e03a896ec60f4b1395cfdcfa359cda8a. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:50:57.851024 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f97f3d76-9596-4205-9272-d335624d0938 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:57.879291 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f97f3d76-9596-4205-9272-d335624d0938 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1312 microversion: 2.1 time: 1.326661 Jul 12 11:50:57.884308 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 264/540] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:56 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1312 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:57.896391 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-323a4b51-213f-4ca1-9426-dd0227366687 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.117293 Jul 12 11:50:57.903247 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 277/541] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:50:57 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:57.909899 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4a500fc8-2818-499b-ba60-55db3cdb966f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:57.910943 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4a500fc8-2818-499b-ba60-55db3cdb966f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:57.928337 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4a500fc8-2818-499b-ba60-55db3cdb966f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:57.930105 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4a500fc8-2818-499b-ba60-55db3cdb966f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:57.931991 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4a500fc8-2818-499b-ba60-55db3cdb966f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:57.933023 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4a500fc8-2818-499b-ba60-55db3cdb966f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:58.231670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4a500fc8-2818-499b-ba60-55db3cdb966f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:58.241090 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4a500fc8-2818-499b-ba60-55db3cdb966f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1310 microversion: 2.1 time: 0.336631 Jul 12 11:50:58.252519 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 278/542] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:57 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1310 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:58.274567 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dad5d50b-9bab-48c0-b512-a85d3f07cadc tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Calling method '.version_select at 0x7f5e0a5341f0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:58.279993 n-d-849104-4 devstack@n-api.service[125984]: WARNING oslo_db.sqlalchemy.utils [None req-dad5d50b-9bab-48c0-b512-a85d3f07cadc tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 12 11:50:58.291493 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dad5d50b-9bab-48c0-b512-a85d3f07cadc tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.044693 Jul 12 11:50:58.292622 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 279/543] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:50:58 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:58.303769 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a2cb7c81-de34-4bb3-a098-193c9c51e1fc tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Calling method '.version_select at 0x7f5e0a52bee0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:58.343745 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a2cb7c81-de34-4bb3-a098-193c9c51e1fc tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-58580297" status: 202 len: 0 microversion: 2.1 time: 0.042382 Jul 12 11:50:58.349948 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 280/544] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:50:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-58580297 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:50:58.357038 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9306823e-80b7-4ac6-8e2d-9d1db515efca tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Calling method '.version_select at 0x7f5e0a5340d0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:58.381875 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9306823e-80b7-4ac6-8e2d-9d1db515efca tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-516463389" status: 202 len: 0 microversion: 2.1 time: 0.029550 Jul 12 11:50:58.383361 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 281/545] 10.222.0.50 () {58 vars in 1274 bytes} [Tue Jul 12 11:50:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-516463389 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:50:58.394165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8e96c4ab-3173-4d28-9bf6-bd77a7955026 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] Calling method '.version_select at 0x7f5e0a52bc10>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:58.417577 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-271f5a18-7699-4307-be83-281f24ea6686 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:58.418722 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-271f5a18-7699-4307-be83-281f24ea6686 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:58.427585 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-271f5a18-7699-4307-be83-281f24ea6686 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:58.428085 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-271f5a18-7699-4307-be83-281f24ea6686 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:58.428862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-271f5a18-7699-4307-be83-281f24ea6686 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:58.429720 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-271f5a18-7699-4307-be83-281f24ea6686 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:58.442988 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8e96c4ab-3173-4d28-9bf6-bd77a7955026 tempest-KeyPairsV2TestJSON-893893615 tempest-KeyPairsV2TestJSON-893893615-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1523884114" status: 202 len: 0 microversion: 2.1 time: 0.054200 Jul 12 11:50:58.444188 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 282/546] 10.222.0.50 () {58 vars in 1277 bytes} [Tue Jul 12 11:50:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1523884114 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:50:58.650627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dcc5c0a1-ab73-4cef-a770-8c059064810d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:58.651282 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dcc5c0a1-ab73-4cef-a770-8c059064810d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:58.669745 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcc5c0a1-ab73-4cef-a770-8c059064810d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:58.670378 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcc5c0a1-ab73-4cef-a770-8c059064810d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:58.671205 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcc5c0a1-ab73-4cef-a770-8c059064810d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:58.671648 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcc5c0a1-ab73-4cef-a770-8c059064810d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:58.819337 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dcc5c0a1-ab73-4cef-a770-8c059064810d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:58.835379 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dcc5c0a1-ab73-4cef-a770-8c059064810d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1277 microversion: 2.1 time: 0.191344 Jul 12 11:50:58.836773 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 283/547] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:58 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:58.846170 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a0330588-c5f8-40f1-a247-59e5ac2294b2 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:58.847226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a0330588-c5f8-40f1-a247-59e5ac2294b2 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:58.857247 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0330588-c5f8-40f1-a247-59e5ac2294b2 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:58.857828 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0330588-c5f8-40f1-a247-59e5ac2294b2 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:58.858657 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0330588-c5f8-40f1-a247-59e5ac2294b2 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:58.859129 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0330588-c5f8-40f1-a247-59e5ac2294b2 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:58.946173 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a0330588-c5f8-40f1-a247-59e5ac2294b2 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:58.955738 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a0330588-c5f8-40f1-a247-59e5ac2294b2 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1315 microversion: 2.1 time: 0.117575 Jul 12 11:50:58.967723 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 284/548] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:58 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1315 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:59.158353 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-79cacdba-b1f9-4aa1-bd48-c92312de0a5d tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:59.163216 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:59.163216 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:59.186748 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-79cacdba-b1f9-4aa1-bd48-c92312de0a5d tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:59.187494 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-79cacdba-b1f9-4aa1-bd48-c92312de0a5d tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:59.189607 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-79cacdba-b1f9-4aa1-bd48-c92312de0a5d tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:59.191180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-79cacdba-b1f9-4aa1-bd48-c92312de0a5d tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:59.224495 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-79cacdba-b1f9-4aa1-bd48-c92312de0a5d tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.266571 Jul 12 11:50:59.225152 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 285/549] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:50:58 2022] GET /compute/v2.1/os-services => generated 944 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:59.230699 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-193056c4-ee36-409f-8c9d-93e1b5813fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:59.231223 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-193056c4-ee36-409f-8c9d-93e1b5813fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:59.240225 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-193056c4-ee36-409f-8c9d-93e1b5813fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:59.241344 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-193056c4-ee36-409f-8c9d-93e1b5813fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:59.242160 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-193056c4-ee36-409f-8c9d-93e1b5813fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:59.243165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-193056c4-ee36-409f-8c9d-93e1b5813fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:59.564674 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-193056c4-ee36-409f-8c9d-93e1b5813fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:59.588774 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-193056c4-ee36-409f-8c9d-93e1b5813fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1312 microversion: 2.1 time: 0.361979 Jul 12 11:50:59.598736 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 286/550] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:59 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1312 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:59.604294 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-58c6b82c-bf5d-400b-b357-30f570b57332 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:59.606275 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:59.606275 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:59.609209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58c6b82c-bf5d-400b-b357-30f570b57332 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:59.609209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58c6b82c-bf5d-400b-b357-30f570b57332 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:59.619730 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58c6b82c-bf5d-400b-b357-30f570b57332 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:59.619730 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58c6b82c-bf5d-400b-b357-30f570b57332 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:59.667133 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-58c6b82c-bf5d-400b-b357-30f570b57332 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.070497 Jul 12 11:50:59.668709 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 287/551] 10.222.0.50 () {58 vars in 1169 bytes} [Tue Jul 12 11:50:59 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:50:59.676684 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-22081883-4555-4fbf-9eda-bba5ef235edf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:59.678190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-22081883-4555-4fbf-9eda-bba5ef235edf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:50:59.688713 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22081883-4555-4fbf-9eda-bba5ef235edf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:59.689418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22081883-4555-4fbf-9eda-bba5ef235edf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:59.690898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22081883-4555-4fbf-9eda-bba5ef235edf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:59.691796 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22081883-4555-4fbf-9eda-bba5ef235edf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:59.895182 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-22081883-4555-4fbf-9eda-bba5ef235edf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:50:59.905452 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-22081883-4555-4fbf-9eda-bba5ef235edf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1310 microversion: 2.1 time: 0.234782 Jul 12 11:50:59.906352 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 288/552] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:59 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1310 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:50:59.924138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-879b0473-6374-450c-aed7-a2cd8326eee4 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:50:59.925963 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:50:59.925963 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:50:59.928866 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-879b0473-6374-450c-aed7-a2cd8326eee4 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:59.929755 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-879b0473-6374-450c-aed7-a2cd8326eee4 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:59.931126 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-879b0473-6374-450c-aed7-a2cd8326eee4 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:50:59.932205 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-879b0473-6374-450c-aed7-a2cd8326eee4 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:50:59.997569 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-879b0473-6374-450c-aed7-a2cd8326eee4 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.083368 Jul 12 11:50:59.999598 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 289/553] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:50:59 2022] GET /compute/v2.1/os-services => generated 944 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:00.011420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ef2a5d79-fdfd-46f8-9f53-6ea17bb44249 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:00.014897 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ef2a5d79-fdfd-46f8-9f53-6ea17bb44249 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:00.027331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ef2a5d79-fdfd-46f8-9f53-6ea17bb44249 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:00.028413 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ef2a5d79-fdfd-46f8-9f53-6ea17bb44249 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:00.030630 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ef2a5d79-fdfd-46f8-9f53-6ea17bb44249 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:00.031641 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ef2a5d79-fdfd-46f8-9f53-6ea17bb44249 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:00.042300 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:00.123042 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-271f5a18-7699-4307-be83-281f24ea6686 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1617 microversion: 2.1 time: 2.236779 Jul 12 11:51:00.123890 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 265/554] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:57 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1617 bytes in 2239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:00.138582 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b1929c7a-0aea-45ee-a4d8-11c3f1122fb1 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:00.139996 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b1929c7a-0aea-45ee-a4d8-11c3f1122fb1 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:00.157251 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b1929c7a-0aea-45ee-a4d8-11c3f1122fb1 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:00.159329 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b1929c7a-0aea-45ee-a4d8-11c3f1122fb1 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:00.160271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b1929c7a-0aea-45ee-a4d8-11c3f1122fb1 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:00.164989 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b1929c7a-0aea-45ee-a4d8-11c3f1122fb1 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:00.169785 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ef2a5d79-fdfd-46f8-9f53-6ea17bb44249 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:00.199592 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ef2a5d79-fdfd-46f8-9f53-6ea17bb44249 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1277 microversion: 2.1 time: 0.192862 Jul 12 11:51:00.200986 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 290/555] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:50:59 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:00.207016 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-667f958e-889c-4ba4-86bb-d987b31b7169 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:00.211630 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:51:00.211630 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:51:00.211630 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-667f958e-889c-4ba4-86bb-d987b31b7169 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:00.211630 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-667f958e-889c-4ba4-86bb-d987b31b7169 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:00.211987 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-667f958e-889c-4ba4-86bb-d987b31b7169 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:00.212521 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-667f958e-889c-4ba4-86bb-d987b31b7169 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:00.244961 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-667f958e-889c-4ba4-86bb-d987b31b7169 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-849104-4&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.042757 Jul 12 11:51:00.245894 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 291/556] 10.222.0.50 () {58 vars in 1193 bytes} [Tue Jul 12 11:51:00 2022] GET /compute/v2.1/os-services?host=n-d-849104-4&binary=xxx => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:51:00.256219 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0608288d-c4a7-4804-971d-c1508f17682c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Action: 'create', calling method: .version_select at 0x7f5e0a5051f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1537644997", "policies": ["affinity"]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:00.283799 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-0608288d-c4a7-4804-971d-c1508f17682c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'server_groups'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:00.289904 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:00.291261 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-0608288d-c4a7-4804-971d-c1508f17682c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'server_groups'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:00.356726 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-0608288d-c4a7-4804-971d-c1508f17682c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'server_groups'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:00.362427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-0608288d-c4a7-4804-971d-c1508f17682c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'server_groups'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:00.376852 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0608288d-c4a7-4804-971d-c1508f17682c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.129800 Jul 12 11:51:00.377630 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 292/557] 10.222.0.50 () {60 vars in 1173 bytes} [Tue Jul 12 11:51:00 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:00.391589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7a552f33-3d94-4e9b-be6d-6e73960bede5 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:00.392885 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:51:00.392885 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:51:00.400663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7a552f33-3d94-4e9b-be6d-6e73960bede5 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:00.400663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7a552f33-3d94-4e9b-be6d-6e73960bede5 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:00.400663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7a552f33-3d94-4e9b-be6d-6e73960bede5 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:00.401274 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7a552f33-3d94-4e9b-be6d-6e73960bede5 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:00.426347 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7a552f33-3d94-4e9b-be6d-6e73960bede5 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.047843 Jul 12 11:51:00.427885 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 293/558] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:51:00 2022] GET /compute/v2.1/os-services => generated 944 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:00.439505 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bf1ed5f2-6c44-45da-8424-ab326d45e061 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:00.440838 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:51:00.440838 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:51:00.442045 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf1ed5f2-6c44-45da-8424-ab326d45e061 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:00.442489 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf1ed5f2-6c44-45da-8424-ab326d45e061 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:00.443399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf1ed5f2-6c44-45da-8424-ab326d45e061 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:00.444207 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf1ed5f2-6c44-45da-8424-ab326d45e061 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:00.489388 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bf1ed5f2-6c44-45da-8424-ab326d45e061 tempest-ServicesAdminNegativeTestJSON-1944578082 tempest-ServicesAdminNegativeTestJSON-1944578082-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.053787 Jul 12 11:51:00.490460 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 294/559] 10.222.0.50 () {58 vars in 1197 bytes} [Tue Jul 12 11:51:00 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:51:00.508572 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b1929c7a-0aea-45ee-a4d8-11c3f1122fb1 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:00.524419 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b1929c7a-0aea-45ee-a4d8-11c3f1122fb1 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1321 microversion: 2.1 time: 0.398155 Jul 12 11:51:00.526699 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 266/560] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:00 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:00.558786 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1240688904", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3643958b-855b-4467-9146-3988921502d5"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:00.628093 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] validate_networks() for None {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:51:00.821269 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a90a2f6a-f2cb-44e5-975c-45337a015cb6 tempest-ServicesAdminNegativeTestJSON-1207459652 tempest-ServicesAdminNegativeTestJSON-1207459652-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:00.822748 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:51:00.822748 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:51:00.824140 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a90a2f6a-f2cb-44e5-975c-45337a015cb6 tempest-ServicesAdminNegativeTestJSON-1207459652 tempest-ServicesAdminNegativeTestJSON-1207459652-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'df57e664dd7e450291a31ed66d040153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db561fc64554563a4f2ab98a9dec943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a90a2f6a-f2cb-44e5-975c-45337a015cb6 tempest-ServicesAdminNegativeTestJSON-1207459652 tempest-ServicesAdminNegativeTestJSON-1207459652-project] Request method failure captured: Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWAhTP9P06LeJnP21x8U7kirrQFdS7t_hq8wrh6kLkXK4rTWqVrtWvjGlBqsyklA7f1Yjd1gmjR06aWCJZ9BTxM6o3Y5BbC_pAH7Bpo3nqQTzKV0zHiSbJP-qYIgb8gU0qgwmiaASq1drdN2enTNCo8nZVBQfdN-IimYiT0rIpcWj1Q Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 5db561fc64554563a4f2ab98a9dec943 Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1207459652 Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:51:00.826664 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:51:00.829468 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5db561fc64554563a4f2ab98a9dec943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5db561fc64554563a4f2ab98a9dec943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5db561fc64554563a4f2ab98a9dec943"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5db561fc64554563a4f2ab98a9dec943", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:51:00.829468 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1207459652 Jul 12 11:51:00.829468 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 5db561fc64554563a4f2ab98a9dec943 Jul 12 11:51:00.829468 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1207459652 Jul 12 11:51:00.829468 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServicesAdminNegativeTestJSON-1207459652-project Jul 12 11:51:00.829468 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:51:00.829468 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:51:00.829468 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: df57e664dd7e450291a31ed66d040153 Jul 12 11:51:00.829468 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1207459652-project Jul 12 11:51:00.829468 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:51:00.829468 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 12 11:51:00.829468 n-d-849104-4 devstack@n-api.service[125984]: action_args: {} Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:51:00.830578 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 12 11:51:00.832464 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:00.835530 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a90a2f6a-f2cb-44e5-975c-45337a015cb6 tempest-ServicesAdminNegativeTestJSON-1207459652 tempest-ServicesAdminNegativeTestJSON-1207459652-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:51:00.836569 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a90a2f6a-f2cb-44e5-975c-45337a015cb6 tempest-ServicesAdminNegativeTestJSON-1207459652 tempest-ServicesAdminNegativeTestJSON-1207459652-project] 10.222.0.50 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.338178 Jul 12 11:51:00.841140 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 295/561] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:51:00 2022] GET /compute/v2.1/os-services => generated 112 bytes in 340 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 12 11:51:00.842900 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d1835dfa-6656-4f23-8185-90062f823c42 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:00.843626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d1835dfa-6656-4f23-8185-90062f823c42 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:00.857146 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d1835dfa-6656-4f23-8185-90062f823c42 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:00.857710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d1835dfa-6656-4f23-8185-90062f823c42 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:00.858917 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d1835dfa-6656-4f23-8185-90062f823c42 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:00.859670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d1835dfa-6656-4f23-8185-90062f823c42 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:01.039931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d1835dfa-6656-4f23-8185-90062f823c42 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:01.049142 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d1835dfa-6656-4f23-8185-90062f823c42 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1312 microversion: 2.1 time: 0.210321 Jul 12 11:51:01.058917 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 296/562] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:00 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1312 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:01.058917 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-db70ebb5-1386-4ef6-9fac-79c4db10179a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:01.058917 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-db70ebb5-1386-4ef6-9fac-79c4db10179a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:01.063446 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db70ebb5-1386-4ef6-9fac-79c4db10179a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:01.063991 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db70ebb5-1386-4ef6-9fac-79c4db10179a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:01.065048 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db70ebb5-1386-4ef6-9fac-79c4db10179a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:01.065679 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db70ebb5-1386-4ef6-9fac-79c4db10179a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:01.255196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-db70ebb5-1386-4ef6-9fac-79c4db10179a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:01.265829 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-db70ebb5-1386-4ef6-9fac-79c4db10179a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1493 microversion: 2.1 time: 0.214598 Jul 12 11:51:01.272237 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 297/563] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:01 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1493 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:01.575651 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c9e67ebf-95af-4997-aa23-b768eb759e5a tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Action: 'create', calling method: .version_select at 0x7f5e0a5343a0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQbdBF0lLh5bWD0ogVWyd2IXGdAvkOtWvRQnYvEI5w8JDQBZzjHInGCrf8RKSCQQJ4f1iYOqG12pRenDkD11Wa9CALRLuC5hISK/awnXl9gebNmIYuRjzhsin/G0Y0DXw=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:01.585507 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-c9e67ebf-95af-4997-aa23-b768eb759e5a tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c9e67ebf-95af-4997-aa23-b768eb759e5a tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Request method failure captured: Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 257 Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWAk18StiwoOlClNE7EMTAUo6o0qkzITEM4FGB6Y4GNVLxzDP7T6mdeHETMDdY8lE9OLzM4EhF1Q1yrZvL_cV_iy1ROGlMGN4WWiyaVDn4RPxwXV7z7xwOu1PnYFekmG8BIgBFtpbCilcKfCJ0XtsJpH2V17e0BcgSYOz6CldjVTZGE Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:51:01.589939 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:51:01.591299 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d6534875f06c45eea8557ea03f83c7e4", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:51:01.591299 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:01.591299 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:01.591299 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:01.591299 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:01.591299 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:51:01.591299 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:51:01.591299 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: b3b8e4ee46d84921ad6108b5b1efd112 Jul 12 11:51:01.591299 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:01.591299 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:51:01.591299 n-d-849104-4 devstack@n-api.service[125984]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQbdBF0lLh5bWD0ogVWyd2IXGdAvkOtWvRQnYvEI5w8JDQBZzjHInGCrf8RKSCQQJ4f1iYOqG12pRenDkD11Wa9CALRLuC5hISK/awnXl9gebNmIYuRjzhsin/G0Y0DXw=="}} Jul 12 11:51:01.591299 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQbdBF0lLh5bWD0ogVWyd2IXGdAvkOtWvRQnYvEI5w8JDQBZzjHInGCrf8RKSCQQJ4f1iYOqG12pRenDkD11Wa9CALRLuC5hISK/awnXl9gebNmIYuRjzhsin/G0Y0DXw=='}}} Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 12 11:51:01.592151 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 12 11:51:01.593925 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 12 11:51:01.595831 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 12 11:51:01.595831 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 12 11:51:01.595831 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:01.595831 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:01.595831 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:01.595831 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:01.595831 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:01.595831 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:01.595831 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:51:01.595831 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:51:01.595831 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 12 11:51:01.595831 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:01.595831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c9e67ebf-95af-4997-aa23-b768eb759e5a tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:51:01.595831 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c9e67ebf-95af-4997-aa23-b768eb759e5a tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.323177 Jul 12 11:51:01.603020 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 298/564] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:51:01 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 336 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:51:01.608566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-720dd9ff-fe2b-4d0d-a8e4-44e3bd0ba2be tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:01.609989 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-720dd9ff-fe2b-4d0d-a8e4-44e3bd0ba2be tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:01.619251 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-720dd9ff-fe2b-4d0d-a8e4-44e3bd0ba2be tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:01.620263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-720dd9ff-fe2b-4d0d-a8e4-44e3bd0ba2be tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:01.621269 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-720dd9ff-fe2b-4d0d-a8e4-44e3bd0ba2be tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:01.621925 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-720dd9ff-fe2b-4d0d-a8e4-44e3bd0ba2be tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:01.790447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-720dd9ff-fe2b-4d0d-a8e4-44e3bd0ba2be tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:01.800838 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-720dd9ff-fe2b-4d0d-a8e4-44e3bd0ba2be tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1277 microversion: 2.1 time: 0.196269 Jul 12 11:51:01.804991 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 299/565] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:01 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:02.044302 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7897156e-e966-41a9-8524-fb4ea7759117 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:02.045605 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7897156e-e966-41a9-8524-fb4ea7759117 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:02.056320 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7897156e-e966-41a9-8524-fb4ea7759117 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:02.056989 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7897156e-e966-41a9-8524-fb4ea7759117 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:02.058115 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7897156e-e966-41a9-8524-fb4ea7759117 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:02.058847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7897156e-e966-41a9-8524-fb4ea7759117 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:02.116963 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:51:02.118250 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:51:02.119077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:51:02.119723 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:51:02.120424 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:51:02.147324 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:02.157238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:02.157889 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:02.159001 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:02.159619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:02.195217 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:02.211079 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:02.248226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Going to run 2 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:51:02.257473 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 19c7d0ce-ac82-402c-b58a-e62d1f5eb767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:51:02.260910 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7897156e-e966-41a9-8524-fb4ea7759117 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1644 microversion: 2.1 time: 0.454601 Jul 12 11:51:02.262718 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 300/566] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:01 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1644 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:02.272269 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0e913cd5-5eb8-4671-a8fb-a1e0104dafd8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:02.273005 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0e913cd5-5eb8-4671-a8fb-a1e0104dafd8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:02.292758 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0e913cd5-5eb8-4671-a8fb-a1e0104dafd8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:02.293204 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0e913cd5-5eb8-4671-a8fb-a1e0104dafd8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:02.294182 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0e913cd5-5eb8-4671-a8fb-a1e0104dafd8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:02.294920 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0e913cd5-5eb8-4671-a8fb-a1e0104dafd8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:02.338212 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=125983) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 12 11:51:02.402041 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:02.410149 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:02.414746 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0e913cd5-5eb8-4671-a8fb-a1e0104dafd8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:02.427426 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0e913cd5-5eb8-4671-a8fb-a1e0104dafd8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1321 microversion: 2.1 time: 0.163009 Jul 12 11:51:02.427901 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 301/567] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:02 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:02.445972 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8dfbc6dc-178a-4b2b-997b-8f8b15ca02f7 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Action: 'create', calling method: .version_select at 0x7f5e0a534e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1569367485", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:02.490886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-8dfbc6dc-178a-4b2b-997b-8f8b15ca02f7 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Getting quotas for project d6534875f06c45eea8557ea03f83c7e4. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:02.491161 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:02.502567 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-8dfbc6dc-178a-4b2b-997b-8f8b15ca02f7 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Getting quotas for user b3b8e4ee46d84921ad6108b5b1efd112 and project d6534875f06c45eea8557ea03f83c7e4. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:02.504310 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:02.532997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=19c7d0ce-ac82-402c-b58a-e62d1f5eb767,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:51:02.533751 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-8dfbc6dc-178a-4b2b-997b-8f8b15ca02f7 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8dfbc6dc-178a-4b2b-997b-8f8b15ca02f7 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Request method failure captured: Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 2167 Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWAk18StiwoOlClNE7EMTAUo6o0qkzITEM4FGB6Y4GNVLxzDP7T6mdeHETMDdY8lE9OLzM4EhF1Q1yrZvL_cV_iy1ROGlMGN4WWiyaVDn4RPxwXV7z7xwOu1PnYFekmG8BIgBFtpbCilcKfCJ0XtsJpH2V17e0BcgSYOz6CldjVTZGE Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d6534875f06c45eea8557ea03f83c7e4", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: b3b8e4ee46d84921ad6108b5b1efd112 Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1569367485", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:51:02.543885 n-d-849104-4 devstack@n-api.service[125984]: exception: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1569367485', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:51:02.548866 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8dfbc6dc-178a-4b2b-997b-8f8b15ca02f7 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:51:02.555711 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8dfbc6dc-178a-4b2b-997b-8f8b15ca02f7 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.115981 Jul 12 11:51:02.559616 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 302/568] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Jul 12 11:51:02 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 12 11:51:02.568730 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-c770bf04-6a24-46f6-a962-f2baf12f4667 req-8bbb74ae-cdf4-4ab9-a26d-41c64871e666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad134105-4265-45f8-8844-8f1ddfbeea10", "tag": "85f8e57f-7584-4612-9d3a-a67d37236dcf"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:02.589566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-c770bf04-6a24-46f6-a962-f2baf12f4667 req-8bbb74ae-cdf4-4ab9-a26d-41c64871e666 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:02.590586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-c770bf04-6a24-46f6-a962-f2baf12f4667 req-8bbb74ae-cdf4-4ab9-a26d-41c64871e666 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:02.607806 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:02.616049 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:02.620855 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-c770bf04-6a24-46f6-a962-f2baf12f4667 req-8bbb74ae-cdf4-4ab9-a26d-41c64871e666 service nova] Creating event network-changed:85f8e57f-7584-4612-9d3a-a67d37236dcf for instance ad134105-4265-45f8-8844-8f1ddfbeea10 on n-h1-849104-4 Jul 12 11:51:02.631534 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-c770bf04-6a24-46f6-a962-f2baf12f4667 req-8bbb74ae-cdf4-4ab9-a26d-41c64871e666 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069814 Jul 12 11:51:02.633811 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 303/569] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:02.641668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-43346ce0-e512-495c-a4b3-c03fbdba10f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:02.642637 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-43346ce0-e512-495c-a4b3-c03fbdba10f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:02.652198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43346ce0-e512-495c-a4b3-c03fbdba10f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:02.652845 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43346ce0-e512-495c-a4b3-c03fbdba10f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:02.653847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43346ce0-e512-495c-a4b3-c03fbdba10f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:02.654658 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43346ce0-e512-495c-a4b3-c03fbdba10f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:02.680875 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:02.687168 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:02.735325 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fe09f39d-58e3-43ff-910b-df0caf324c82 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.182599 Jul 12 11:51:02.736104 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 267/570] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:51:00 2022] POST /compute/v2.1/servers => generated 32 bytes in 2184 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 12 11:51:02.741436 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ce1c74db-9931-4ea6-af16-febc3b0eddfe tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:02.743386 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ce1c74db-9931-4ea6-af16-febc3b0eddfe tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:02.752232 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce1c74db-9931-4ea6-af16-febc3b0eddfe tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:02.753033 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce1c74db-9931-4ea6-af16-febc3b0eddfe tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:02.754309 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce1c74db-9931-4ea6-af16-febc3b0eddfe tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:02.754997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce1c74db-9931-4ea6-af16-febc3b0eddfe tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:03.208349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-43346ce0-e512-495c-a4b3-c03fbdba10f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:03.218351 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-43346ce0-e512-495c-a4b3-c03fbdba10f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1312 microversion: 2.1 time: 0.582154 Jul 12 11:51:03.229004 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 304/571] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:02 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1312 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:03.235119 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a2fb8367-4d8a-4963-9887-a17ab8860d50 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Action: 'create', calling method: .version_select at 0x7f5e0a4e6820>, body: {"keypair": {"name": "tempest-keypair-463259686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYmZCmrAakY7CXx/Q+hMf2GVzACAVQQpt6ev/xKSxcOfZLCbyjo9sswlpLiGzNjiJzISID41PszF8xxCYJKtsZYV+SLqHT9IgJx3WcjHGoLTdRyjEvlYhSga8z546WJug=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:03.255085 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-a2fb8367-4d8a-4963-9887-a17ab8860d50 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Getting quotas for project d6534875f06c45eea8557ea03f83c7e4. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:03.264104 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-a2fb8367-4d8a-4963-9887-a17ab8860d50 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Getting quotas for user b3b8e4ee46d84921ad6108b5b1efd112 and project d6534875f06c45eea8557ea03f83c7e4. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:03.342325 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a2fb8367-4d8a-4963-9887-a17ab8860d50 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111044 Jul 12 11:51:03.351683 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 305/572] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:51:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:03.357865 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3c7c9a56-c2ac-4d38-b460-db7e1db934ea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:03.363129 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3c7c9a56-c2ac-4d38-b460-db7e1db934ea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:03.364760 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3c7c9a56-c2ac-4d38-b460-db7e1db934ea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Searching by: {'deleted': False, 'project_id': '810246cfc801446599831d243d3a48dd'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 11:51:03.388320 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c7c9a56-c2ac-4d38-b460-db7e1db934ea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:03.389060 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c7c9a56-c2ac-4d38-b460-db7e1db934ea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:03.390183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c7c9a56-c2ac-4d38-b460-db7e1db934ea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:03.391141 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c7c9a56-c2ac-4d38-b460-db7e1db934ea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:03.496331 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ce1c74db-9931-4ea6-af16-febc3b0eddfe tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1644 microversion: 2.1 time: 0.758511 Jul 12 11:51:03.496916 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 268/573] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:02 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1644 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:03.511334 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-458a9a78-1533-47fb-af7b-de44183850bd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:03.512275 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-458a9a78-1533-47fb-af7b-de44183850bd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:03.518851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-3c7c9a56-c2ac-4d38-b460-db7e1db934ea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 11:51:03.547448 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-458a9a78-1533-47fb-af7b-de44183850bd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:03.548063 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-458a9a78-1533-47fb-af7b-de44183850bd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:03.561722 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-458a9a78-1533-47fb-af7b-de44183850bd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:03.562541 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-458a9a78-1533-47fb-af7b-de44183850bd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:03.833776 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3c7c9a56-c2ac-4d38-b460-db7e1db934ea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.478752 Jul 12 11:51:03.834555 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 306/574] 10.222.0.50 () {58 vars in 1124 bytes} [Tue Jul 12 11:51:03 2022] GET /compute/v2.1/servers => generated 1003 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:03.855907 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-135cd994-4130-401c-9619-a4899c8f99f2 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Action: 'create', calling method: .version_select at 0x7f5e0a4caf70>, body: {"keypair": {"name": "tempest-keypair-463259686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAyBfImie77BxpX7LJ3H/As0kJwy9EFaX7JfPiD6aLRET4RlbOsSUiAvp9F43L7g43IUTcugTI7UTZ8RTp/O5tSMQUXZ9GdNO3ARf+hwZgdQS/rr6/mlrKoypIV/c7fcg=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:03.909209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-135cd994-4130-401c-9619-a4899c8f99f2 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Getting quotas for project d6534875f06c45eea8557ea03f83c7e4. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:03.930295 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-135cd994-4130-401c-9619-a4899c8f99f2 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Getting quotas for user b3b8e4ee46d84921ad6108b5b1efd112 and project d6534875f06c45eea8557ea03f83c7e4. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:04.010788 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-135cd994-4130-401c-9619-a4899c8f99f2 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] HTTP exception thrown: Key pair 'tempest-keypair-463259686' already exists. Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-135cd994-4130-401c-9619-a4899c8f99f2 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Request method failure captured: Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 272 Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWAk18StiwoOlClNE7EMTAUo6o0qkzITEM4FGB6Y4GNVLxzDP7T6mdeHETMDdY8lE9OLzM4EhF1Q1yrZvL_cV_iy1ROGlMGN4WWiyaVDn4RPxwXV7z7xwOu1PnYFekmG8BIgBFtpbCilcKfCJ0XtsJpH2V17e0BcgSYOz6CldjVTZGE Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d6534875f06c45eea8557ea03f83c7e4", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: b3b8e4ee46d84921ad6108b5b1efd112 Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: {"keypair": {"name": "tempest-keypair-463259686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAyBfImie77BxpX7LJ3H/As0kJwy9EFaX7JfPiD6aLRET4RlbOsSUiAvp9F43L7g43IUTcugTI7UTZ8RTp/O5tSMQUXZ9GdNO3ARf+hwZgdQS/rr6/mlrKoypIV/c7fcg=="}} Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: exception: Key pair 'tempest-keypair-463259686' already exists. Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-463259686', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAyBfImie77BxpX7LJ3H/As0kJwy9EFaX7JfPiD6aLRET4RlbOsSUiAvp9F43L7g43IUTcugTI7UTZ8RTp/O5tSMQUXZ9GdNO3ARf+hwZgdQS/rr6/mlrKoypIV/c7fcg=='}}} Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result.read() Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'b3b8e4ee46d84921ad6108b5b1efd112-tempest-keypair-463259686' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 12 11:51:04.016973 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi session.flush() Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result.read() Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 12 11:51:04.021410 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'b3b8e4ee46d84921ad6108b5b1efd112-tempest-keypair-463259686' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 12, 11, 51, 3, 995185), 'updated_at': None, 'name': 'tempest-keypair-463259686', 'user_id': 'b3b8e4ee46d84921ad6108b5b1efd112', 'fingerprint': '20:4f:b1:40:fc:a3:6b:b4:f3:d2:48:9a:d2:68:1d:63', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAyBfImie77BxpX7LJ3H/As0kJwy9EFaX7JfPiD6aLRET4RlbOsSUiAvp9F43L7g43IUTcugTI7UTZ8RTp/O5tSMQUXZ9GdNO3ARf+hwZgdQS/rr6/mlrKoypIV/c7fcg==', 'type': 'ssh'}] Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi keypair.create() Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._create() Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-463259686' already exists. Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 12 11:51:04.028360 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-463259686' already exists. Jul 12 11:51:04.037388 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:04.037388 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:04.037388 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:04.037388 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:04.037388 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:04.037388 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:04.037388 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:51:04.037388 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:51:04.037388 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-463259686' already exists. Jul 12 11:51:04.037388 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:04.037388 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-135cd994-4130-401c-9619-a4899c8f99f2 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Returning 409 to user: Key pair 'tempest-keypair-463259686' already exists. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:51:04.037388 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-135cd994-4130-401c-9619-a4899c8f99f2 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.183410 Jul 12 11:51:04.037388 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 307/575] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:51:03 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:51:04.042931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a1df7882-7109-40e5-a12b-9bd67d7dcd3c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:04.043761 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a1df7882-7109-40e5-a12b-9bd67d7dcd3c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:04.077079 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a1df7882-7109-40e5-a12b-9bd67d7dcd3c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:04.077547 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a1df7882-7109-40e5-a12b-9bd67d7dcd3c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:04.079232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a1df7882-7109-40e5-a12b-9bd67d7dcd3c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:04.079686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a1df7882-7109-40e5-a12b-9bd67d7dcd3c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:04.571458 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a1df7882-7109-40e5-a12b-9bd67d7dcd3c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:04.584636 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a1df7882-7109-40e5-a12b-9bd67d7dcd3c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1388 microversion: 2.1 time: 0.562902 Jul 12 11:51:04.585305 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 308/576] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:04 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1388 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:04.593884 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a5c7d2d2-530c-48d5-9957-15522bff3848 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:04.598121 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:51:04.598121 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:51:04.599539 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5c7d2d2-530c-48d5-9957-15522bff3848 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:04.600007 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5c7d2d2-530c-48d5-9957-15522bff3848 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:04.600862 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5c7d2d2-530c-48d5-9957-15522bff3848 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:04.604323 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5c7d2d2-530c-48d5-9957-15522bff3848 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:04.649102 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a5c7d2d2-530c-48d5-9957-15522bff3848 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.062542 Jul 12 11:51:04.657243 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 309/577] 10.222.0.50 () {58 vars in 1175 bytes} [Tue Jul 12 11:51:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:04.663256 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cc6ebf82-94eb-4ae5-a66a-e9357be43e88 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:04.663888 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cc6ebf82-94eb-4ae5-a66a-e9357be43e88 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:04.687137 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cc6ebf82-94eb-4ae5-a66a-e9357be43e88 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:04.688157 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cc6ebf82-94eb-4ae5-a66a-e9357be43e88 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:04.688971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cc6ebf82-94eb-4ae5-a66a-e9357be43e88 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:04.689402 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cc6ebf82-94eb-4ae5-a66a-e9357be43e88 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:04.785926 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-458a9a78-1533-47fb-af7b-de44183850bd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:04.802510 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-458a9a78-1533-47fb-af7b-de44183850bd tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1319 microversion: 2.1 time: 1.304402 Jul 12 11:51:04.806408 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 269/578] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:03 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1319 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:04.819403 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f03bce41-543d-4934-857f-595bb6645536 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Calling method '.version_select at 0x7f5e0b0da3a0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:04.861020 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f03bce41-543d-4934-857f-595bb6645536 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-463259686" status: 202 len: 0 microversion: 2.1 time: 0.053200 Jul 12 11:51:04.861849 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 270/579] 10.222.0.50 () {58 vars in 1217 bytes} [Tue Jul 12 11:51:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-463259686 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:51:04.866796 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b68e68d3-6fa8-4e94-a63a-a4705c6b3eae tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:04.871782 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b68e68d3-6fa8-4e94-a63a-a4705c6b3eae tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:04.884127 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b68e68d3-6fa8-4e94-a63a-a4705c6b3eae tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:04.884818 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b68e68d3-6fa8-4e94-a63a-a4705c6b3eae tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:04.887668 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b68e68d3-6fa8-4e94-a63a-a4705c6b3eae tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:04.889399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b68e68d3-6fa8-4e94-a63a-a4705c6b3eae tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:05.030195 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cc6ebf82-94eb-4ae5-a66a-e9357be43e88 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:05.043270 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cc6ebf82-94eb-4ae5-a66a-e9357be43e88 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e" status: 200 len: 1271 microversion: 2.1 time: 0.391679 Jul 12 11:51:05.044488 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 310/580] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:04 2022] GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e => generated 1271 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:05.057398 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-39da0042-0382-4ae7-ae68-bd0d412b3b8b tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-849104-4", "block_migration": true, "disk_over_commit": false}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:05.058765 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-39da0042-0382-4ae7-ae68-bd0d412b3b8b tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:05.084211 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39da0042-0382-4ae7-ae68-bd0d412b3b8b tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:05.084953 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39da0042-0382-4ae7-ae68-bd0d412b3b8b tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:05.086238 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39da0042-0382-4ae7-ae68-bd0d412b3b8b tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:05.086856 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39da0042-0382-4ae7-ae68-bd0d412b3b8b tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:05.146193 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-39da0042-0382-4ae7-ae68-bd0d412b3b8b tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lazy-loading 'flavor' on Instance uuid ae3975f6-39e7-4b52-abe1-975c4215f167 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:51:05.171461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-39da0042-0382-4ae7-ae68-bd0d412b3b8b tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Going to try to live migrate instance to n-h1-849104-4 {{(pid=125984) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 12 11:51:05.669736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b68e68d3-6fa8-4e94-a63a-a4705c6b3eae tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:05.698644 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b68e68d3-6fa8-4e94-a63a-a4705c6b3eae tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1312 microversion: 2.1 time: 0.835203 Jul 12 11:51:05.718239 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 271/581] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:04 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1312 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:05.737127 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-748cbb2f-871e-4241-a8db-7764f65fb204 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Action: 'create', calling method: .version_select at 0x7f5e0b15d790>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjzmOzNz/gY0i2C91BytRNhbLNd/jQvETILw7iqS1YACRT0YkTnK2S5mmBl/kZ56cVuv7zOvE2tpQQNZUd71FEe7r5W1EZYfT2QyJpotRpfaMS0xR6SKAzD9tNiKMzVLg=="}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-748cbb2f-871e-4241-a8db-7764f65fb204 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Request method failure captured: Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 247 Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWAk18StiwoOlClNE7EMTAUo6o0qkzITEM4FGB6Y4GNVLxzDP7T6mdeHETMDdY8lE9OLzM4EhF1Q1yrZvL_cV_iy1ROGlMGN4WWiyaVDn4RPxwXV7z7xwOu1PnYFekmG8BIgBFtpbCilcKfCJ0XtsJpH2V17e0BcgSYOz6CldjVTZGE Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d6534875f06c45eea8557ea03f83c7e4", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: b3b8e4ee46d84921ad6108b5b1efd112 Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjzmOzNz/gY0i2C91BytRNhbLNd/jQvETILw7iqS1YACRT0YkTnK2S5mmBl/kZ56cVuv7zOvE2tpQQNZUd71FEe7r5W1EZYfT2QyJpotRpfaMS0xR6SKAzD9tNiKMzVLg=="}} Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjzmOzNz/gY0i2C91BytRNhbLNd/jQvETILw7iqS1YACRT0YkTnK2S5mmBl/kZ56cVuv7zOvE2tpQQNZUd71FEe7r5W1EZYfT2QyJpotRpfaMS0xR6SKAzD9tNiKMzVLg=='}}} Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise error Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi '' Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 11:51:05.742006 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 12 11:51:05.755022 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:05.761918 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-748cbb2f-871e-4241-a8db-7764f65fb204 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:51:05.761918 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-748cbb2f-871e-4241-a8db-7764f65fb204 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.035156 Jul 12 11:51:05.769858 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 272/582] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:51:05 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:51:05.784482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-de69c9ab-b6bf-415f-970f-fb9c06cfaabb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:05.785947 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-de69c9ab-b6bf-415f-970f-fb9c06cfaabb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:05.804895 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-de69c9ab-b6bf-415f-970f-fb9c06cfaabb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:05.806068 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-de69c9ab-b6bf-415f-970f-fb9c06cfaabb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:05.809743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-de69c9ab-b6bf-415f-970f-fb9c06cfaabb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:05.811064 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-de69c9ab-b6bf-415f-970f-fb9c06cfaabb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:07.564065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-de69c9ab-b6bf-415f-970f-fb9c06cfaabb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:07.574697 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-de69c9ab-b6bf-415f-970f-fb9c06cfaabb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1388 microversion: 2.1 time: 1.802873 Jul 12 11:51:07.575557 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 273/583] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:05 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1388 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:07.584498 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4e1bead7-59b3-469a-9f2b-5272cec8f126 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Action: 'create', calling method: .version_select at 0x7f5e0b15d5e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-409956523", "public_key": " "}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:07.620856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-4e1bead7-59b3-469a-9f2b-5272cec8f126 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Getting quotas for project d6534875f06c45eea8557ea03f83c7e4. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:07.628690 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-4e1bead7-59b3-469a-9f2b-5272cec8f126 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Getting quotas for user b3b8e4ee46d84921ad6108b5b1efd112 and project d6534875f06c45eea8557ea03f83c7e4. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:07.679199 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-4e1bead7-59b3-469a-9f2b-5272cec8f126 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4e1bead7-59b3-469a-9f2b-5272cec8f126 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Request method failure captured: Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 94 Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWAk18StiwoOlClNE7EMTAUo6o0qkzITEM4FGB6Y4GNVLxzDP7T6mdeHETMDdY8lE9OLzM4EhF1Q1yrZvL_cV_iy1ROGlMGN4WWiyaVDn4RPxwXV7z7xwOu1PnYFekmG8BIgBFtpbCilcKfCJ0XtsJpH2V17e0BcgSYOz6CldjVTZGE Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d6534875f06c45eea8557ea03f83c7e4", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: b3b8e4ee46d84921ad6108b5b1efd112 Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-409956523", "public_key": " "}} Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: exception: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-409956523', 'public_key': ' '}}} Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:07.685704 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:07.692154 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4e1bead7-59b3-469a-9f2b-5272cec8f126 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:51:07.696679 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4e1bead7-59b3-469a-9f2b-5272cec8f126 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.118946 Jul 12 11:51:07.698322 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 274/584] 10.222.0.50 () {60 vars in 1157 bytes} [Tue Jul 12 11:51:07 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 12 11:51:07.709532 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2410c244-0afa-4637-9ba7-1172373e3bfe tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:07.710504 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2410c244-0afa-4637-9ba7-1172373e3bfe tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:07.738009 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2410c244-0afa-4637-9ba7-1172373e3bfe tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:07.742380 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2410c244-0afa-4637-9ba7-1172373e3bfe tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:07.745091 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2410c244-0afa-4637-9ba7-1172373e3bfe tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:07.747451 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2410c244-0afa-4637-9ba7-1172373e3bfe tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:07.810272 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:08.560307 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2410c244-0afa-4637-9ba7-1172373e3bfe tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:08.571381 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2410c244-0afa-4637-9ba7-1172373e3bfe tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1319 microversion: 2.1 time: 0.867226 Jul 12 11:51:08.572200 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 275/585] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:07 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1319 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:08.588498 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-71db4349-aa04-434d-99ea-7c7107cbb2dd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:08.594026 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-71db4349-aa04-434d-99ea-7c7107cbb2dd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:08.613802 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-71db4349-aa04-434d-99ea-7c7107cbb2dd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:08.614353 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-71db4349-aa04-434d-99ea-7c7107cbb2dd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:08.615250 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-71db4349-aa04-434d-99ea-7c7107cbb2dd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:08.615763 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-71db4349-aa04-434d-99ea-7c7107cbb2dd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:09.038920 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-39da0042-0382-4ae7-ae68-bd0d412b3b8b tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167/action" status: 202 len: 0 microversion: 2.1 time: 3.991603 Jul 12 11:51:09.040851 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 311/586] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:51:05 2022] POST /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167/action => generated 0 bytes in 3996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:51:09.052470 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2dca2e72-387b-4b02-8026-f3728a3699ca tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:09.053701 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2dca2e72-387b-4b02-8026-f3728a3699ca tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:09.074186 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2dca2e72-387b-4b02-8026-f3728a3699ca tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:09.092318 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2dca2e72-387b-4b02-8026-f3728a3699ca tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:09.094656 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2dca2e72-387b-4b02-8026-f3728a3699ca tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:09.096930 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2dca2e72-387b-4b02-8026-f3728a3699ca tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:09.202292 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-71db4349-aa04-434d-99ea-7c7107cbb2dd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:09.211419 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-71db4349-aa04-434d-99ea-7c7107cbb2dd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e" status: 200 len: 1277 microversion: 2.1 time: 0.628178 Jul 12 11:51:09.215626 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 276/587] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:08 2022] GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e => generated 1277 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:09.223287 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-a7ac2494-5554-4c72-859a-97c7f9c681e7 req-7646c8cb-32ac-4057-9f1c-670e1a2ca086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a873a920-f2b5-4503-97e5-0ddaae09abc6", "tag": "49099d37-8d54-47cd-a861-028d9ec73033"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:09.245428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-a7ac2494-5554-4c72-859a-97c7f9c681e7 req-7646c8cb-32ac-4057-9f1c-670e1a2ca086 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:09.246429 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-a7ac2494-5554-4c72-859a-97c7f9c681e7 req-7646c8cb-32ac-4057-9f1c-670e1a2ca086 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:09.282278 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-a7ac2494-5554-4c72-859a-97c7f9c681e7 req-7646c8cb-32ac-4057-9f1c-670e1a2ca086 service nova] Creating event network-changed:49099d37-8d54-47cd-a861-028d9ec73033 for instance a873a920-f2b5-4503-97e5-0ddaae09abc6 on n-h1-849104-4 Jul 12 11:51:09.287884 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-a7ac2494-5554-4c72-859a-97c7f9c681e7 req-7646c8cb-32ac-4057-9f1c-670e1a2ca086 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070516 Jul 12 11:51:09.288830 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 277/588] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:09.679977 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2dca2e72-387b-4b02-8026-f3728a3699ca tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:09.705544 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2dca2e72-387b-4b02-8026-f3728a3699ca tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1312 microversion: 2.1 time: 0.663242 Jul 12 11:51:09.710811 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 312/589] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:09 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1312 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:09.725214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-63c254ec-8654-486a-859b-c60a6e6ba361 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Action: 'create', calling method: .version_select at 0x7f5e0a4a6dc0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFNkgJ7VlJrfj0XeWsVUwww8NhqUsnwfhXTt87J8VsqRVE/VHxGnfzVVZ3bA+yymI01tpsdbUuu0SvQ6FejXSgYMDyQYWE0DuRhUqLhIPCPGQ+RXadmIgNWcDV9qYK8HA=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-63c254ec-8654-486a-859b-c60a6e6ba361 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Request method failure captured: Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 507 Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWAk18StiwoOlClNE7EMTAUo6o0qkzITEM4FGB6Y4GNVLxzDP7T6mdeHETMDdY8lE9OLzM4EhF1Q1yrZvL_cV_iy1ROGlMGN4WWiyaVDn4RPxwXV7z7xwOu1PnYFekmG8BIgBFtpbCilcKfCJ0XtsJpH2V17e0BcgSYOz6CldjVTZGE Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d6534875f06c45eea8557ea03f83c7e4", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: b3b8e4ee46d84921ad6108b5b1efd112 Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFNkgJ7VlJrfj0XeWsVUwww8NhqUsnwfhXTt87J8VsqRVE/VHxGnfzVVZ3bA+yymI01tpsdbUuu0SvQ6FejXSgYMDyQYWE0DuRhUqLhIPCPGQ+RXadmIgNWcDV9qYK8HA=="}} Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFNkgJ7VlJrfj0XeWsVUwww8NhqUsnwfhXTt87J8VsqRVE/VHxGnfzVVZ3bA+yymI01tpsdbUuu0SvQ6FejXSgYMDyQYWE0DuRhUqLhIPCPGQ+RXadmIgNWcDV9qYK8HA=='}}} Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise error Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 12 11:51:09.740938 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 12 11:51:09.744377 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:09.751890 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-63c254ec-8654-486a-859b-c60a6e6ba361 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:51:09.753187 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-63c254ec-8654-486a-859b-c60a6e6ba361 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.035181 Jul 12 11:51:09.755147 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 313/590] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:51:09 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:51:09.772229 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-801c052e-d0f8-4963-8400-a43bfa45c94b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:09.774886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-801c052e-d0f8-4963-8400-a43bfa45c94b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:09.793639 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-801c052e-d0f8-4963-8400-a43bfa45c94b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:09.795854 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-801c052e-d0f8-4963-8400-a43bfa45c94b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:09.800719 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-801c052e-d0f8-4963-8400-a43bfa45c94b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:09.802839 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-801c052e-d0f8-4963-8400-a43bfa45c94b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:09.870208 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1391894858", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:10.034052 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] validate_networks() for None {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:51:10.155186 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-801c052e-d0f8-4963-8400-a43bfa45c94b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:10.163586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:10.174072 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-801c052e-d0f8-4963-8400-a43bfa45c94b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1388 microversion: 2.1 time: 0.417475 Jul 12 11:51:10.175444 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 314/591] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:09 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1388 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:10.183695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a5ced0fc-4992-40dd-82e2-0f599a724708 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:10.184556 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a5ced0fc-4992-40dd-82e2-0f599a724708 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:10.206077 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5ced0fc-4992-40dd-82e2-0f599a724708 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:10.209137 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5ced0fc-4992-40dd-82e2-0f599a724708 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:10.210458 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5ced0fc-4992-40dd-82e2-0f599a724708 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:10.212678 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5ced0fc-4992-40dd-82e2-0f599a724708 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:10.542718 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a5ced0fc-4992-40dd-82e2-0f599a724708 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:10.552741 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a5ced0fc-4992-40dd-82e2-0f599a724708 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1503 microversion: 2.1 time: 0.374617 Jul 12 11:51:10.553403 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 315/592] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:10 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1503 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:10.559560 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9932cdeb-f234-4444-8b1a-300fbf13aff5 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:10.560220 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9932cdeb-f234-4444-8b1a-300fbf13aff5 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:10.567688 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9932cdeb-f234-4444-8b1a-300fbf13aff5 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:10.568406 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9932cdeb-f234-4444-8b1a-300fbf13aff5 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:10.569373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9932cdeb-f234-4444-8b1a-300fbf13aff5 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:10.569979 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9932cdeb-f234-4444-8b1a-300fbf13aff5 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:10.756196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9932cdeb-f234-4444-8b1a-300fbf13aff5 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:10.765016 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9932cdeb-f234-4444-8b1a-300fbf13aff5 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1319 microversion: 2.1 time: 0.210547 Jul 12 11:51:10.776569 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 316/593] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:10 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:10.781887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-a94a9cd4-905c-4f85-b032-86f444bd6694 req-3e114ca3-38bf-4466-91ee-9cb061d52145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad134105-4265-45f8-8844-8f1ddfbeea10", "name": "network-vif-plugged", "status": "completed", "tag": "85f8e57f-7584-4612-9d3a-a67d37236dcf"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:10.789640 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:10.794861 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-a94a9cd4-905c-4f85-b032-86f444bd6694 req-3e114ca3-38bf-4466-91ee-9cb061d52145 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:10.795541 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-a94a9cd4-905c-4f85-b032-86f444bd6694 req-3e114ca3-38bf-4466-91ee-9cb061d52145 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:10.811836 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-a94a9cd4-905c-4f85-b032-86f444bd6694 req-3e114ca3-38bf-4466-91ee-9cb061d52145 service nova] Creating event network-vif-plugged:85f8e57f-7584-4612-9d3a-a67d37236dcf for instance ad134105-4265-45f8-8844-8f1ddfbeea10 on n-h1-849104-4 Jul 12 11:51:10.818465 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-a94a9cd4-905c-4f85-b032-86f444bd6694 req-3e114ca3-38bf-4466-91ee-9cb061d52145 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040355 Jul 12 11:51:10.825020 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:51:10.825518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:51:10.826533 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:51:10.827585 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:51:10.827585 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:51:10.830647 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 317/594] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:10.844544 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d0d1be89-e9cf-4ba3-91ee-88e42d4c110b tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Action: 'create', calling method: .version_select at 0x7f5e0a4a6af0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-32171223", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:10.848369 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:10.848829 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:10.849652 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:10.850103 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:10.868660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:10.873665 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-d0d1be89-e9cf-4ba3-91ee-88e42d4c110b tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Getting quotas for project d6534875f06c45eea8557ea03f83c7e4. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:10.883971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-d0d1be89-e9cf-4ba3-91ee-88e42d4c110b tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Getting quotas for user b3b8e4ee46d84921ad6108b5b1efd112 and project d6534875f06c45eea8557ea03f83c7e4. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:10.889313 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Getting quotas for project 05d6bb5e5dc44aaa9571c7f9c8de0c4b. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:10.898399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Getting quotas for user 3ff397e55cd0463ca550882a0907fa3f and project 05d6bb5e5dc44aaa9571c7f9c8de0c4b. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:10.943795 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:51:10.957070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:51:10.987355 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-d0d1be89-e9cf-4ba3-91ee-88e42d4c110b tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d0d1be89-e9cf-4ba3-91ee-88e42d4c110b tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Request method failure captured: Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 116 Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWAk18StiwoOlClNE7EMTAUo6o0qkzITEM4FGB6Y4GNVLxzDP7T6mdeHETMDdY8lE9OLzM4EhF1Q1yrZvL_cV_iy1ROGlMGN4WWiyaVDn4RPxwXV7z7xwOu1PnYFekmG8BIgBFtpbCilcKfCJ0XtsJpH2V17e0BcgSYOz6CldjVTZGE Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d6534875f06c45eea8557ea03f83c7e4", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: b3b8e4ee46d84921ad6108b5b1efd112 Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-32171223", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: exception: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-32171223', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 12 11:51:11.001832 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 12 11:51:11.006397 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:11.026004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d0d1be89-e9cf-4ba3-91ee-88e42d4c110b tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:51:11.027098 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d0d1be89-e9cf-4ba3-91ee-88e42d4c110b tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.193039 Jul 12 11:51:11.027687 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 318/595] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:51:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 12 11:51:11.043009 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2078e815-0006-41d3-a61f-8fe812493f21 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:11.045291 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2078e815-0006-41d3-a61f-8fe812493f21 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:11.067311 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2078e815-0006-41d3-a61f-8fe812493f21 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:11.067755 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2078e815-0006-41d3-a61f-8fe812493f21 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:11.080263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2078e815-0006-41d3-a61f-8fe812493f21 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:11.087091 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2078e815-0006-41d3-a61f-8fe812493f21 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:11.096486 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-587515d0-ee42-4b84-994d-b1e792a7ba62 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.802043 Jul 12 11:51:11.101122 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 278/596] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:51:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:51:11.112775 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-709ddda2-1a3d-4856-9ef0-bae8234caba7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:11.113975 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-709ddda2-1a3d-4856-9ef0-bae8234caba7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:11.128472 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-709ddda2-1a3d-4856-9ef0-bae8234caba7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:11.129462 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-709ddda2-1a3d-4856-9ef0-bae8234caba7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:11.130747 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-709ddda2-1a3d-4856-9ef0-bae8234caba7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:11.133769 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-709ddda2-1a3d-4856-9ef0-bae8234caba7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:11.974491 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2078e815-0006-41d3-a61f-8fe812493f21 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:11.985425 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2078e815-0006-41d3-a61f-8fe812493f21 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e" status: 200 len: 1319 microversion: 2.1 time: 0.951814 Jul 12 11:51:11.986848 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 319/597] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:11 2022] GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e => generated 1319 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:12.013037 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0e5e305c-1074-4aea-87c8-7b951a922984 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Calling method '.version_select at 0x7f5e0a3205e0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:12.035885 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-0e5e305c-1074-4aea-87c8-7b951a922984 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1617770415 not found for user b3b8e4ee46d84921ad6108b5b1efd112 Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0e5e305c-1074-4aea-87c8-7b951a922984 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Request method failure captured: Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1617770415 HTTP/1.1 Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWAk18StiwoOlClNE7EMTAUo6o0qkzITEM4FGB6Y4GNVLxzDP7T6mdeHETMDdY8lE9OLzM4EhF1Q1yrZvL_cV_iy1ROGlMGN4WWiyaVDn4RPxwXV7z7xwOu1PnYFekmG8BIgBFtpbCilcKfCJ0XtsJpH2V17e0BcgSYOz6CldjVTZGE Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d6534875f06c45eea8557ea03f83c7e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d6534875f06c45eea8557ea03f83c7e4", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d6534875f06c45eea8557ea03f83c7e4 Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-496508540 Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: b3b8e4ee46d84921ad6108b5b1efd112 Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-KeyPairsNegativeTestJSON-496508540-project Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: exception: Keypair tempest-keypair-non-existent-1617770415 not found for user b3b8e4ee46d84921ad6108b5b1efd112 Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'tempest-keypair-non-existent-1617770415'} Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1617770415 not found for user b3b8e4ee46d84921ad6108b5b1efd112 Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:12.038813 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1617770415 not found for user b3b8e4ee46d84921ad6108b5b1efd112 Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1617770415 not found for user b3b8e4ee46d84921ad6108b5b1efd112 Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0e5e305c-1074-4aea-87c8-7b951a922984 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1617770415 not found for user b3b8e4ee46d84921ad6108b5b1efd112 {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:51:12.043406 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0e5e305c-1074-4aea-87c8-7b951a922984 tempest-KeyPairsNegativeTestJSON-496508540 tempest-KeyPairsNegativeTestJSON-496508540-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1617770415" status: 404 len: 145 microversion: 2.1 time: 0.047805 Jul 12 11:51:12.048466 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 320/598] 10.222.0.50 () {58 vars in 1259 bytes} [Tue Jul 12 11:51:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1617770415 => generated 145 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:51:12.067935 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-86c52be3-5a97-43ed-8a9e-cba7a4958f67 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:12.069601 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-86c52be3-5a97-43ed-8a9e-cba7a4958f67 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:12.223226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-86c52be3-5a97-43ed-8a9e-cba7a4958f67 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:12.235292 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-86c52be3-5a97-43ed-8a9e-cba7a4958f67 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1214 microversion: 2.1 time: 0.183123 Jul 12 11:51:12.236239 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 321/599] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:12 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:12.244662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9902259f-74b4-47a9-9cb2-54bcdd4026cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:12.247803 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9902259f-74b4-47a9-9cb2-54bcdd4026cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:12.282433 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9902259f-74b4-47a9-9cb2-54bcdd4026cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:12.284308 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9902259f-74b4-47a9-9cb2-54bcdd4026cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:12.285399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9902259f-74b4-47a9-9cb2-54bcdd4026cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:12.285999 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9902259f-74b4-47a9-9cb2-54bcdd4026cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:12.549177 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-709ddda2-1a3d-4856-9ef0-bae8234caba7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:12.577034 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-709ddda2-1a3d-4856-9ef0-bae8234caba7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1312 microversion: 2.1 time: 1.471044 Jul 12 11:51:12.578425 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 279/600] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:11 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1312 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:12.597171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-9e74e31a-c0e5-493f-a2e9-e6d24cd84b30 req-9bb003d8-bae1-431c-9753-6b1eb14e79b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c809d104-cbc0-4f60-bd08-d9b669685f5e", "tag": "2218e552-6bd9-4914-b419-9c29009d158d"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:12.613072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-9e74e31a-c0e5-493f-a2e9-e6d24cd84b30 req-9bb003d8-bae1-431c-9753-6b1eb14e79b4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:12.615188 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-9e74e31a-c0e5-493f-a2e9-e6d24cd84b30 req-9bb003d8-bae1-431c-9753-6b1eb14e79b4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:12.662899 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-9e74e31a-c0e5-493f-a2e9-e6d24cd84b30 req-9bb003d8-bae1-431c-9753-6b1eb14e79b4 service nova] Creating event network-changed:2218e552-6bd9-4914-b419-9c29009d158d for instance c809d104-cbc0-4f60-bd08-d9b669685f5e on n-h2-849104-4 Jul 12 11:51:12.669578 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-9e74e31a-c0e5-493f-a2e9-e6d24cd84b30 req-9bb003d8-bae1-431c-9753-6b1eb14e79b4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087264 Jul 12 11:51:12.670191 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 280/601] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:12.676047 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-657047b9-9cf8-4652-934f-b10f4cc17c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:12.677011 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-657047b9-9cf8-4652-934f-b10f4cc17c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:12.691599 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-657047b9-9cf8-4652-934f-b10f4cc17c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:12.692145 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9902259f-74b4-47a9-9cb2-54bcdd4026cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:12.693061 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-657047b9-9cf8-4652-934f-b10f4cc17c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:12.694718 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-657047b9-9cf8-4652-934f-b10f4cc17c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:12.696181 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-657047b9-9cf8-4652-934f-b10f4cc17c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:12.705119 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9902259f-74b4-47a9-9cb2-54bcdd4026cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1388 microversion: 2.1 time: 0.466645 Jul 12 11:51:12.706587 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 322/602] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:12 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1388 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:12.717267 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-083c767e-c397-474e-8de8-0b6d71d230c8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:12.726980 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-083c767e-c397-474e-8de8-0b6d71d230c8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:12.739227 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-083c767e-c397-474e-8de8-0b6d71d230c8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:12.739976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-083c767e-c397-474e-8de8-0b6d71d230c8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:12.740958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-083c767e-c397-474e-8de8-0b6d71d230c8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:12.742686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-083c767e-c397-474e-8de8-0b6d71d230c8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:13.060260 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-083c767e-c397-474e-8de8-0b6d71d230c8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:13.075476 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-083c767e-c397-474e-8de8-0b6d71d230c8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1319 microversion: 2.1 time: 0.366639 Jul 12 11:51:13.090521 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 323/603] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:12 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1319 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:13.097957 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8a996c98-7a96-4c44-a1b3-fa64f7efa9bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:13.099107 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8a996c98-7a96-4c44-a1b3-fa64f7efa9bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:13.106573 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a996c98-7a96-4c44-a1b3-fa64f7efa9bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:13.107348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a996c98-7a96-4c44-a1b3-fa64f7efa9bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:13.109763 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a996c98-7a96-4c44-a1b3-fa64f7efa9bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:13.110386 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a996c98-7a96-4c44-a1b3-fa64f7efa9bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:13.477828 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8a996c98-7a96-4c44-a1b3-fa64f7efa9bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:13.489095 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8a996c98-7a96-4c44-a1b3-fa64f7efa9bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e" status: 200 len: 1319 microversion: 2.1 time: 0.396631 Jul 12 11:51:13.489692 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 324/604] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:13 2022] GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:13.500858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b6f6842b-f402-4a56-ae2c-7cb905b614fe tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:13.501566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b6f6842b-f402-4a56-ae2c-7cb905b614fe tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:13.508414 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b6f6842b-f402-4a56-ae2c-7cb905b614fe tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:13.508869 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b6f6842b-f402-4a56-ae2c-7cb905b614fe tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:13.509643 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b6f6842b-f402-4a56-ae2c-7cb905b614fe tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:13.510074 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b6f6842b-f402-4a56-ae2c-7cb905b614fe tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:13.549391 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-657047b9-9cf8-4652-934f-b10f4cc17c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:13.583196 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-657047b9-9cf8-4652-934f-b10f4cc17c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1503 microversion: 2.1 time: 0.910964 Jul 12 11:51:13.587406 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 281/605] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:12 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1503 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:13.611119 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-a73efd60-120d-4350-a810-78368294bbe9 req-bb38252f-82f5-447f-a1e5-bdf2382afeea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3975f6-39e7-4b52-abe1-975c4215f167", "name": "network-vif-unplugged", "status": "completed", "tag": "0722db67-d841-4498-a390-6a19339383b3"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:13.655896 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-a73efd60-120d-4350-a810-78368294bbe9 req-bb38252f-82f5-447f-a1e5-bdf2382afeea service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:13.658006 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-a73efd60-120d-4350-a810-78368294bbe9 req-bb38252f-82f5-447f-a1e5-bdf2382afeea service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:13.678142 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-a73efd60-120d-4350-a810-78368294bbe9 req-bb38252f-82f5-447f-a1e5-bdf2382afeea service nova] Creating event network-vif-unplugged:0722db67-d841-4498-a390-6a19339383b3 for instance ae3975f6-39e7-4b52-abe1-975c4215f167 on n-h2-849104-4 Jul 12 11:51:13.692448 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-a73efd60-120d-4350-a810-78368294bbe9 req-bb38252f-82f5-447f-a1e5-bdf2382afeea service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099757 Jul 12 11:51:13.698420 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 282/606] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:13.711736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-238b75ed-f0bd-4fe6-a913-a0e7aa2e5d4f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:13.713916 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-238b75ed-f0bd-4fe6-a913-a0e7aa2e5d4f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:13.731978 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-238b75ed-f0bd-4fe6-a913-a0e7aa2e5d4f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:13.732847 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-238b75ed-f0bd-4fe6-a913-a0e7aa2e5d4f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:13.734921 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-238b75ed-f0bd-4fe6-a913-a0e7aa2e5d4f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:13.736542 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-238b75ed-f0bd-4fe6-a913-a0e7aa2e5d4f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:13.764985 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b6f6842b-f402-4a56-ae2c-7cb905b614fe tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:13.778265 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b6f6842b-f402-4a56-ae2c-7cb905b614fe tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1210 microversion: 2.1 time: 0.287461 Jul 12 11:51:13.782424 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 325/607] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:13 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1210 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:13.793668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c1721bd7-6b7b-45c9-b3f1-5054e87049ca tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:13.799907 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c1721bd7-6b7b-45c9-b3f1-5054e87049ca tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:13.811422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c1721bd7-6b7b-45c9-b3f1-5054e87049ca tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:13.815470 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c1721bd7-6b7b-45c9-b3f1-5054e87049ca tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:13.816495 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c1721bd7-6b7b-45c9-b3f1-5054e87049ca tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:13.817080 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c1721bd7-6b7b-45c9-b3f1-5054e87049ca tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:14.107751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c1721bd7-6b7b-45c9-b3f1-5054e87049ca tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:14.120552 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c1721bd7-6b7b-45c9-b3f1-5054e87049ca tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1388 microversion: 2.1 time: 0.336678 Jul 12 11:51:14.126186 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 326/608] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:13 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1388 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:14.136084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c543852b-d024-4951-ac2a-1507ff27f92d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:14.137896 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c543852b-d024-4951-ac2a-1507ff27f92d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:14.164685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c543852b-d024-4951-ac2a-1507ff27f92d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:14.165459 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c543852b-d024-4951-ac2a-1507ff27f92d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:14.166525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c543852b-d024-4951-ac2a-1507ff27f92d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:14.172840 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c543852b-d024-4951-ac2a-1507ff27f92d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:14.616553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=22 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:14.647762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c543852b-d024-4951-ac2a-1507ff27f92d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:14.662731 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c543852b-d024-4951-ac2a-1507ff27f92d tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1319 microversion: 2.1 time: 0.534981 Jul 12 11:51:14.663520 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 327/609] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:14 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1319 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:14.668784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d7923e4e-798a-4c1f-ab2a-c4e68b1e2c3c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:14.669777 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d7923e4e-798a-4c1f-ab2a-c4e68b1e2c3c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:14.698811 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d7923e4e-798a-4c1f-ab2a-c4e68b1e2c3c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:14.699646 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d7923e4e-798a-4c1f-ab2a-c4e68b1e2c3c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:14.701914 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d7923e4e-798a-4c1f-ab2a-c4e68b1e2c3c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:14.703698 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d7923e4e-798a-4c1f-ab2a-c4e68b1e2c3c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:14.962250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d7923e4e-798a-4c1f-ab2a-c4e68b1e2c3c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:14.975066 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d7923e4e-798a-4c1f-ab2a-c4e68b1e2c3c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e" status: 200 len: 1319 microversion: 2.1 time: 0.310202 Jul 12 11:51:14.976209 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 328/610] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:14 2022] GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:14.982786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-65bcec8e-4576-4bbb-a7b0-897465b9b9e2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:14.983733 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-65bcec8e-4576-4bbb-a7b0-897465b9b9e2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:14.991289 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65bcec8e-4576-4bbb-a7b0-897465b9b9e2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:14.992023 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65bcec8e-4576-4bbb-a7b0-897465b9b9e2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:14.993312 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65bcec8e-4576-4bbb-a7b0-897465b9b9e2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:14.993922 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65bcec8e-4576-4bbb-a7b0-897465b9b9e2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:15.103728 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-238b75ed-f0bd-4fe6-a913-a0e7aa2e5d4f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:15.130829 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-238b75ed-f0bd-4fe6-a913-a0e7aa2e5d4f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1462 microversion: 2.1 time: 1.428598 Jul 12 11:51:15.132819 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 283/611] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:13 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1462 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:15.156743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5bd9f960-0f4f-4bd8-9b9a-adc47216ed65 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:15.158001 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5bd9f960-0f4f-4bd8-9b9a-adc47216ed65 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:15.190166 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5bd9f960-0f4f-4bd8-9b9a-adc47216ed65 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:15.190994 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5bd9f960-0f4f-4bd8-9b9a-adc47216ed65 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:15.192431 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5bd9f960-0f4f-4bd8-9b9a-adc47216ed65 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:15.193211 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5bd9f960-0f4f-4bd8-9b9a-adc47216ed65 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:15.652763 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5bd9f960-0f4f-4bd8-9b9a-adc47216ed65 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:15.667668 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5bd9f960-0f4f-4bd8-9b9a-adc47216ed65 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1274 microversion: 2.1 time: 0.532844 Jul 12 11:51:15.671366 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 284/612] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:15 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1274 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:15.683096 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ebaa2ca0-9fbc-4929-ac9a-48eaeb4af605 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:15.685639 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ebaa2ca0-9fbc-4929-ac9a-48eaeb4af605 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:15.699844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-65bcec8e-4576-4bbb-a7b0-897465b9b9e2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:15.705380 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ebaa2ca0-9fbc-4929-ac9a-48eaeb4af605 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:15.705963 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ebaa2ca0-9fbc-4929-ac9a-48eaeb4af605 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:15.706904 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ebaa2ca0-9fbc-4929-ac9a-48eaeb4af605 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:15.707398 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ebaa2ca0-9fbc-4929-ac9a-48eaeb4af605 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:15.725148 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-65bcec8e-4576-4bbb-a7b0-897465b9b9e2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1503 microversion: 2.1 time: 0.744169 Jul 12 11:51:15.729929 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 329/613] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:14 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1503 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:15.743965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-43eae881-9747-49fd-bdd7-7eac5cede5d0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:15.745784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-43eae881-9747-49fd-bdd7-7eac5cede5d0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:15.764874 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43eae881-9747-49fd-bdd7-7eac5cede5d0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:15.766266 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43eae881-9747-49fd-bdd7-7eac5cede5d0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:15.767267 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43eae881-9747-49fd-bdd7-7eac5cede5d0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:15.770002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43eae881-9747-49fd-bdd7-7eac5cede5d0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:16.008364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-43eae881-9747-49fd-bdd7-7eac5cede5d0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:16.022153 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-43eae881-9747-49fd-bdd7-7eac5cede5d0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Old instance type m1.heat2, new instance type m1.heat {{(pid=125984) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 12 11:51:16.033253 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-43eae881-9747-49fd-bdd7-7eac5cede5d0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:51:16.034526 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-43eae881-9747-49fd-bdd7-7eac5cede5d0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:51:16.035618 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-43eae881-9747-49fd-bdd7-7eac5cede5d0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:51:16.036752 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-43eae881-9747-49fd-bdd7-7eac5cede5d0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:51:16.038295 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-43eae881-9747-49fd-bdd7-7eac5cede5d0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:51:16.601582 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-43eae881-9747-49fd-bdd7-7eac5cede5d0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "POST /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10/action" status: 202 len: 0 microversion: 2.1 time: 0.869201 Jul 12 11:51:16.607633 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 330/614] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:51:15 2022] POST /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10/action => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:51:16.613179 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-05106c1a-4c5d-4698-99b3-f2cb40c31261 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:16.613796 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-05106c1a-4c5d-4698-99b3-f2cb40c31261 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:16.631278 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05106c1a-4c5d-4698-99b3-f2cb40c31261 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:16.632104 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05106c1a-4c5d-4698-99b3-f2cb40c31261 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:16.633538 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05106c1a-4c5d-4698-99b3-f2cb40c31261 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:16.634279 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05106c1a-4c5d-4698-99b3-f2cb40c31261 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:17.125703 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ebaa2ca0-9fbc-4929-ac9a-48eaeb4af605 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:17.145834 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ebaa2ca0-9fbc-4929-ac9a-48eaeb4af605 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1388 microversion: 2.1 time: 1.471426 Jul 12 11:51:17.173761 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 285/615] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:15 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1388 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:17.188337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-b135d00f-9ed0-4746-b8d1-e62b289baab2 req-65cffb86-d13a-4ecf-9e19-239ac1978444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3975f6-39e7-4b52-abe1-975c4215f167", "tag": "0722db67-d841-4498-a390-6a19339383b3"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:17.205925 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-b135d00f-9ed0-4746-b8d1-e62b289baab2 req-65cffb86-d13a-4ecf-9e19-239ac1978444 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:17.207282 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-b135d00f-9ed0-4746-b8d1-e62b289baab2 req-65cffb86-d13a-4ecf-9e19-239ac1978444 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:17.252843 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-b135d00f-9ed0-4746-b8d1-e62b289baab2 req-65cffb86-d13a-4ecf-9e19-239ac1978444 service nova] Creating event network-changed:0722db67-d841-4498-a390-6a19339383b3 for instance ae3975f6-39e7-4b52-abe1-975c4215f167 on n-h2-849104-4 Jul 12 11:51:17.271272 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-b135d00f-9ed0-4746-b8d1-e62b289baab2 req-65cffb86-d13a-4ecf-9e19-239ac1978444 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086801 Jul 12 11:51:17.272714 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 286/616] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:17.612926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-05106c1a-4c5d-4698-99b3-f2cb40c31261 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:17.628854 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-05106c1a-4c5d-4698-99b3-f2cb40c31261 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1319 microversion: 2.1 time: 1.019979 Jul 12 11:51:17.629675 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 331/617] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:16 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1319 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:17.640593 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ec0d705a-5cb2-4ad8-a1f4-dbd9faed8fe0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:17.641208 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ec0d705a-5cb2-4ad8-a1f4-dbd9faed8fe0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:17.693938 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ec0d705a-5cb2-4ad8-a1f4-dbd9faed8fe0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:17.694786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ec0d705a-5cb2-4ad8-a1f4-dbd9faed8fe0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:17.700205 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ec0d705a-5cb2-4ad8-a1f4-dbd9faed8fe0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:17.703400 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ec0d705a-5cb2-4ad8-a1f4-dbd9faed8fe0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:17.703593 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cbd330c4-fcc1-4f61-ad25-d9cffa482dc6 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Action: 'create', calling method: .version_select at 0x7f5e0b0da1f0>, body: {"keypair": {"name": "tempest-keypair-115858363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFLsThlydQ5qKvMzzCXLJwp19rJKcv4hMpDrN3yNQuzcmRJfKx0sOfR8IQz2pcQodLvwc4hi3f6ulz18fyyH+pxMXfavtcfdaeDc0Tnu/2/HbIpxLs4Gnn2DkJ6wHQMsA=="}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:17.738118 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=53 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:17.746967 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-cbd330c4-fcc1-4f61-ad25-d9cffa482dc6 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:17.775925 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-cbd330c4-fcc1-4f61-ad25-d9cffa482dc6 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for user 243d9e8e904d45a1b8c2c125a1ddbd16 and project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:17.842581 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cbd330c4-fcc1-4f61-ad25-d9cffa482dc6 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.567803 Jul 12 11:51:17.844893 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 287/618] 10.222.0.50 () {62 vars in 1198 bytes} [Tue Jul 12 11:51:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 571 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 12 11:51:17.855192 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bbd520c1-8275-4843-a21f-f8b19066b09b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:17.856567 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-bbd520c1-8275-4843-a21f-f8b19066b09b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:17.866529 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bbd520c1-8275-4843-a21f-f8b19066b09b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:17.867656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bbd520c1-8275-4843-a21f-f8b19066b09b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:17.869318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bbd520c1-8275-4843-a21f-f8b19066b09b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:17.870043 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bbd520c1-8275-4843-a21f-f8b19066b09b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:18.713808 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ec0d705a-5cb2-4ad8-a1f4-dbd9faed8fe0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:18.734393 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ec0d705a-5cb2-4ad8-a1f4-dbd9faed8fe0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e" status: 200 len: 1319 microversion: 2.1 time: 1.100471 Jul 12 11:51:18.736563 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 332/619] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:17 2022] GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e => generated 1319 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:18.747080 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cb490d34-077e-4770-ac6f-1b2558a7e426 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:18.748676 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cb490d34-077e-4770-ac6f-1b2558a7e426 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:18.762659 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb490d34-077e-4770-ac6f-1b2558a7e426 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:18.763382 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb490d34-077e-4770-ac6f-1b2558a7e426 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:18.765284 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb490d34-077e-4770-ac6f-1b2558a7e426 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:18.766406 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb490d34-077e-4770-ac6f-1b2558a7e426 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:19.091414 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bbd520c1-8275-4843-a21f-f8b19066b09b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:19.102458 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bbd520c1-8275-4843-a21f-f8b19066b09b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1471 microversion: 2.1 time: 1.255719 Jul 12 11:51:19.119443 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 288/620] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:17 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1471 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:19.124861 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b0e1664f-11f6-464c-98f9-06890519cca7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:19.137156 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b0e1664f-11f6-464c-98f9-06890519cca7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:19.150033 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b0e1664f-11f6-464c-98f9-06890519cca7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:19.150491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b0e1664f-11f6-464c-98f9-06890519cca7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:19.151282 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b0e1664f-11f6-464c-98f9-06890519cca7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:19.151732 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b0e1664f-11f6-464c-98f9-06890519cca7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:19.644390 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cb490d34-077e-4770-ac6f-1b2558a7e426 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:19.648782 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:19.661315 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b0e1664f-11f6-464c-98f9-06890519cca7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:19.665257 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cb490d34-077e-4770-ac6f-1b2558a7e426 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1314 microversion: 2.1 time: 0.922412 Jul 12 11:51:19.666323 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 333/621] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:18 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1314 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:19.680313 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b0e1664f-11f6-464c-98f9-06890519cca7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1503 microversion: 2.1 time: 0.559484 Jul 12 11:51:19.681238 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 289/622] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:19 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1503 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:19.701241 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-85f3bb83-26b6-4f8a-9e75-58f61bd5e85c tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Calling method '.version_select at 0x7f5e0b0da3a0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:19.708763 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-b21fcf89-d4ea-4312-942f-ceae49c7e225 req-6ee04764-379e-422a-b7f8-3c02bdb64db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a873a920-f2b5-4503-97e5-0ddaae09abc6", "name": "network-vif-plugged", "status": "completed", "tag": "49099d37-8d54-47cd-a861-028d9ec73033"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:19.715434 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-85f3bb83-26b6-4f8a-9e75-58f61bd5e85c tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-115858363" status: 200 len: 512 microversion: 2.2 time: 0.033038 Jul 12 11:51:19.716021 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 290/623] 10.222.0.50 () {60 vars in 1254 bytes} [Tue Jul 12 11:51:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-115858363 => generated 512 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:19.730896 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-833c822e-df9f-4838-a4c3-9763bc4a077f req-5d1e539b-3ff8-4ede-a192-810082a9e1fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6f463a-4dd8-4d96-9092-f41f16f1e13e", "tag": "a41f8d53-2f24-43d5-b2b8-7a611037f182"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:19.732170 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b21fcf89-d4ea-4312-942f-ceae49c7e225 req-6ee04764-379e-422a-b7f8-3c02bdb64db8 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:19.732623 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b21fcf89-d4ea-4312-942f-ceae49c7e225 req-6ee04764-379e-422a-b7f8-3c02bdb64db8 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:19.754100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-833c822e-df9f-4838-a4c3-9763bc4a077f req-5d1e539b-3ff8-4ede-a192-810082a9e1fe service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:19.754538 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-833c822e-df9f-4838-a4c3-9763bc4a077f req-5d1e539b-3ff8-4ede-a192-810082a9e1fe service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:19.778894 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-833c822e-df9f-4838-a4c3-9763bc4a077f req-5d1e539b-3ff8-4ede-a192-810082a9e1fe service nova] Creating event network-changed:a41f8d53-2f24-43d5-b2b8-7a611037f182 for instance ab6f463a-4dd8-4d96-9092-f41f16f1e13e on n-h1-849104-4 Jul 12 11:51:19.779109 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-b21fcf89-d4ea-4312-942f-ceae49c7e225 req-6ee04764-379e-422a-b7f8-3c02bdb64db8 service nova] Creating event network-vif-plugged:49099d37-8d54-47cd-a861-028d9ec73033 for instance a873a920-f2b5-4503-97e5-0ddaae09abc6 on n-h1-849104-4 Jul 12 11:51:19.789236 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-b21fcf89-d4ea-4312-942f-ceae49c7e225 req-6ee04764-379e-422a-b7f8-3c02bdb64db8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105106 Jul 12 11:51:19.791654 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-833c822e-df9f-4838-a4c3-9763bc4a077f req-5d1e539b-3ff8-4ede-a192-810082a9e1fe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074111 Jul 12 11:51:19.792452 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 334/624] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:19.792783 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 291/625] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:19.806816 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b4fd5cec-d98f-4ec1-be4f-9da831a4c413 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:19.807593 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-979056d8-f90e-4839-9a8b-5c389d4effd9 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:19.808786 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-979056d8-f90e-4839-9a8b-5c389d4effd9 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:19.813328 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b4fd5cec-d98f-4ec1-be4f-9da831a4c413 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:19.831240 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-979056d8-f90e-4839-9a8b-5c389d4effd9 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:19.831576 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b4fd5cec-d98f-4ec1-be4f-9da831a4c413 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:19.831842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-979056d8-f90e-4839-9a8b-5c389d4effd9 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:19.832920 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-979056d8-f90e-4839-9a8b-5c389d4effd9 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:19.833384 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b4fd5cec-d98f-4ec1-be4f-9da831a4c413 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:19.833811 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-979056d8-f90e-4839-9a8b-5c389d4effd9 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:19.834508 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b4fd5cec-d98f-4ec1-be4f-9da831a4c413 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:19.836985 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b4fd5cec-d98f-4ec1-be4f-9da831a4c413 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:20.398364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b4fd5cec-d98f-4ec1-be4f-9da831a4c413 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:20.414069 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b4fd5cec-d98f-4ec1-be4f-9da831a4c413 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1388 microversion: 2.1 time: 0.619183 Jul 12 11:51:20.416319 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 335/626] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:19 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1388 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:20.425430 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3c4d6eb1-95ca-42b3-8dc3-92539bd8b31f tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Calling method '.version_select at 0x7f5e0a6bbf70>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:20.458706 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3c4d6eb1-95ca-42b3-8dc3-92539bd8b31f tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-115858363" status: 204 len: 0 microversion: 2.2 time: 0.040373 Jul 12 11:51:20.469564 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 336/627] 10.222.0.50 () {60 vars in 1257 bytes} [Tue Jul 12 11:51:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-115858363 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:51:20.469564 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-51bd7d91-e020-485f-8626-3fc81b6b7ffb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:20.469564 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-51bd7d91-e020-485f-8626-3fc81b6b7ffb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:20.476403 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-979056d8-f90e-4839-9a8b-5c389d4effd9 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:20.477605 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51bd7d91-e020-485f-8626-3fc81b6b7ffb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:20.478067 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51bd7d91-e020-485f-8626-3fc81b6b7ffb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:20.479030 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51bd7d91-e020-485f-8626-3fc81b6b7ffb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:20.479476 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51bd7d91-e020-485f-8626-3fc81b6b7ffb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:20.493095 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-979056d8-f90e-4839-9a8b-5c389d4effd9 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1319 microversion: 2.1 time: 0.698267 Jul 12 11:51:20.494617 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 292/628] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:19 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1319 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:20.505100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e9060771-578d-41a3-abf5-41bab9d6459c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:20.506765 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e9060771-578d-41a3-abf5-41bab9d6459c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:20.518156 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9060771-578d-41a3-abf5-41bab9d6459c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:20.519421 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9060771-578d-41a3-abf5-41bab9d6459c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:20.521251 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9060771-578d-41a3-abf5-41bab9d6459c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:20.522007 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9060771-578d-41a3-abf5-41bab9d6459c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:20.748794 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e9060771-578d-41a3-abf5-41bab9d6459c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:20.759691 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e9060771-578d-41a3-abf5-41bab9d6459c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1471 microversion: 2.1 time: 0.263560 Jul 12 11:51:20.772065 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 293/629] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:20 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1471 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:20.772065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-23844d2b-b996-44c8-b678-238b711de207 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Action: 'create', calling method: .version_select at 0x7f5e0b15d1f0>, body: {"keypair": {"name": "tempest-keypair-504242731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODuNH5zuBSM9aHVREjaZ5W6sicszXPbDSS2atwRb6C3ahzU+6HrXp+T3edHv01shHG/RK2zTXP4BLwvrNSg8W2YAdQMiGQleHsZOc7UljqHKfRnTX7HCz/hNA6MjTLwOg=="}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:20.801704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-23844d2b-b996-44c8-b678-238b711de207 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:20.814842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-23844d2b-b996-44c8-b678-238b711de207 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for user 243d9e8e904d45a1b8c2c125a1ddbd16 and project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:20.854343 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-23844d2b-b996-44c8-b678-238b711de207 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.091084 Jul 12 11:51:20.855739 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 294/630] 10.222.0.50 () {62 vars in 1198 bytes} [Tue Jul 12 11:51:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 12 11:51:20.865569 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-77ff4be6-e254-42b3-8997-82ce22a2897b tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:20.866771 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-77ff4be6-e254-42b3-8997-82ce22a2897b tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:20.875927 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=4 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:20.878948 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77ff4be6-e254-42b3-8997-82ce22a2897b tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:20.879920 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77ff4be6-e254-42b3-8997-82ce22a2897b tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:20.881677 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77ff4be6-e254-42b3-8997-82ce22a2897b tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:20.882829 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77ff4be6-e254-42b3-8997-82ce22a2897b tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:21.123722 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-51bd7d91-e020-485f-8626-3fc81b6b7ffb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:21.138660 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-51bd7d91-e020-485f-8626-3fc81b6b7ffb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e" status: 200 len: 1319 microversion: 2.1 time: 0.676293 Jul 12 11:51:21.147835 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 337/631] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:20 2022] GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e => generated 1319 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:21.156301 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5ea74d6c-0681-4781-98ce-13afbc063a13 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:21.157380 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5ea74d6c-0681-4781-98ce-13afbc063a13 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:21.169090 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5ea74d6c-0681-4781-98ce-13afbc063a13 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:21.170186 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5ea74d6c-0681-4781-98ce-13afbc063a13 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:21.171919 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5ea74d6c-0681-4781-98ce-13afbc063a13 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:21.172601 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5ea74d6c-0681-4781-98ce-13afbc063a13 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:21.236808 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-77ff4be6-e254-42b3-8997-82ce22a2897b tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:21.249022 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-77ff4be6-e254-42b3-8997-82ce22a2897b tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1314 microversion: 2.1 time: 0.391200 Jul 12 11:51:21.250324 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 295/632] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:20 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:21.255574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e292cba4-0e4d-4cc8-8ad3-226609d76d69 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Calling method '.version_select at 0x7f5e0b1008b0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:21.283729 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e292cba4-0e4d-4cc8-8ad3-226609d76d69 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-504242731" status: 204 len: 0 microversion: 2.2 time: 0.031271 Jul 12 11:51:21.284778 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 296/633] 10.222.0.50 () {60 vars in 1257 bytes} [Tue Jul 12 11:51:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-504242731 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:51:21.295561 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7d210e1d-6753-4250-b072-161290bd3ad6 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Action: 'create', calling method: .version_select at 0x7f5e0b0b23a0>, body: {"keypair": {"name": "tempest-keypair-339971174", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:21.316679 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-7d210e1d-6753-4250-b072-161290bd3ad6 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:21.324271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-7d210e1d-6753-4250-b072-161290bd3ad6 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for user 243d9e8e904d45a1b8c2c125a1ddbd16 and project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:21.372104 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7d210e1d-6753-4250-b072-161290bd3ad6 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.081095 Jul 12 11:51:21.381748 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 297/634] 10.222.0.50 () {62 vars in 1198 bytes} [Tue Jul 12 11:51:21 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 12 11:51:21.389104 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4002dfd6-0e20-49db-91f4-14e72663109b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Calling method '.version_select at 0x7f5e0b15d1f0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:21.419085 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4002dfd6-0e20-49db-91f4-14e72663109b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-339971174" status: 204 len: 0 microversion: 2.2 time: 0.034838 Jul 12 11:51:21.420814 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 298/635] 10.222.0.50 () {60 vars in 1257 bytes} [Tue Jul 12 11:51:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-339971174 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 11:51:21.439418 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7206f3dd-78a5-49cd-988c-798669cce693 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Action: 'create', calling method: .version_select at 0x7f5e0b0b2af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-256869421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAlgpO2enMCSqgC7oVig1mRPcJCHgHghl53cNLQ/BDRDL1tx/6NTR4NzLfk67sD0ECCyYe7G7rVcNCRg4bmc6eJKoDcHAqYUzenIInM25TqnDSt0q7uOTKpIlHxJfBK4w=="}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:21.482354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-7206f3dd-78a5-49cd-988c-798669cce693 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:21.493689 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-7206f3dd-78a5-49cd-988c-798669cce693 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for user 243d9e8e904d45a1b8c2c125a1ddbd16 and project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:21.540010 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7206f3dd-78a5-49cd-988c-798669cce693 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.107469 Jul 12 11:51:21.541169 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 299/636] 10.222.0.50 () {62 vars in 1198 bytes} [Tue Jul 12 11:51:21 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 12 11:51:21.550931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ce2c0235-2463-4f7c-9f96-6c974bff20be tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:21.551859 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ce2c0235-2463-4f7c-9f96-6c974bff20be tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:21.567459 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5ea74d6c-0681-4781-98ce-13afbc063a13 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:21.569425 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce2c0235-2463-4f7c-9f96-6c974bff20be tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:21.570380 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce2c0235-2463-4f7c-9f96-6c974bff20be tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:21.571255 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce2c0235-2463-4f7c-9f96-6c974bff20be tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:21.572070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce2c0235-2463-4f7c-9f96-6c974bff20be tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:21.582502 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5ea74d6c-0681-4781-98ce-13afbc063a13 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1503 microversion: 2.1 time: 0.439157 Jul 12 11:51:21.584785 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 338/637] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:21 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1503 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:21.590147 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-def5168a-9377-4026-a4d2-9839bd627b25 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:21.591096 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-def5168a-9377-4026-a4d2-9839bd627b25 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:21.604791 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-def5168a-9377-4026-a4d2-9839bd627b25 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:21.606551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-def5168a-9377-4026-a4d2-9839bd627b25 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:21.608343 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-def5168a-9377-4026-a4d2-9839bd627b25 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:21.609381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-def5168a-9377-4026-a4d2-9839bd627b25 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:21.904701 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-def5168a-9377-4026-a4d2-9839bd627b25 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:21.918461 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-def5168a-9377-4026-a4d2-9839bd627b25 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1319 microversion: 2.1 time: 0.332326 Jul 12 11:51:21.926004 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 339/638] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:21 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:21.931528 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-254229bf-a73f-4ec8-9c5c-09057250ef5d tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Action: 'create', calling method: .version_select at 0x7f5e0af8c160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1511158400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX5h7e226dY6wJ8KBy2aKt2NvwtZHs5IIImsk+3FCDPBB+4j+RY5fGxn0HfwvkUhKuYX4mV9tuHNFGFCO20fybCk8yizyirk8vWrlvn0e5Mv5sUAdutpeikDHu4i07ISA=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:21.959833 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=59 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:21.961335 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-254229bf-a73f-4ec8-9c5c-09057250ef5d tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:21.969293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-254229bf-a73f-4ec8-9c5c-09057250ef5d tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for user 243d9e8e904d45a1b8c2c125a1ddbd16 and project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:22.031259 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-254229bf-a73f-4ec8-9c5c-09057250ef5d tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.103528 Jul 12 11:51:22.032298 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 340/639] 10.222.0.50 () {62 vars in 1198 bytes} [Tue Jul 12 11:51:21 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 12 11:51:22.056496 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1c84e150-0e38-40ab-ae88-5d152417ac37 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:22.057121 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1c84e150-0e38-40ab-ae88-5d152417ac37 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:22.078961 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c84e150-0e38-40ab-ae88-5d152417ac37 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:22.079749 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c84e150-0e38-40ab-ae88-5d152417ac37 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:22.081246 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c84e150-0e38-40ab-ae88-5d152417ac37 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:22.083946 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c84e150-0e38-40ab-ae88-5d152417ac37 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:22.440297 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1c84e150-0e38-40ab-ae88-5d152417ac37 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:22.448977 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1c84e150-0e38-40ab-ae88-5d152417ac37 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1471 microversion: 2.1 time: 0.404884 Jul 12 11:51:22.460817 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 341/640] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:22 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1471 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:22.477226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-cbad303b-1aeb-476a-836d-98c3c3d5f7c4 req-167fb3db-ff69-40a5-a4b7-74e86e54ad05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c809d104-cbc0-4f60-bd08-d9b669685f5e", "name": "network-vif-plugged", "status": "completed", "tag": "2218e552-6bd9-4914-b419-9c29009d158d"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:22.487061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-cbad303b-1aeb-476a-836d-98c3c3d5f7c4 req-167fb3db-ff69-40a5-a4b7-74e86e54ad05 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:22.487526 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-cbad303b-1aeb-476a-836d-98c3c3d5f7c4 req-167fb3db-ff69-40a5-a4b7-74e86e54ad05 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:22.502768 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-cbad303b-1aeb-476a-836d-98c3c3d5f7c4 req-167fb3db-ff69-40a5-a4b7-74e86e54ad05 service nova] Creating event network-vif-plugged:2218e552-6bd9-4914-b419-9c29009d158d for instance c809d104-cbc0-4f60-bd08-d9b669685f5e on n-h2-849104-4 Jul 12 11:51:22.509480 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-cbad303b-1aeb-476a-836d-98c3c3d5f7c4 req-167fb3db-ff69-40a5-a4b7-74e86e54ad05 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045248 Jul 12 11:51:22.510589 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 342/641] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:22.518038 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-e5d8b76e-7b8c-4fa6-9fa9-77e3f6088eb3 req-42645aa7-09a3-466d-a917-05fc4605d664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bf4618e-3af1-46a8-9712-60af0f29a71f", "tag": "089bf9c8-9bfa-48c0-bf88-af44a67566bb"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:22.543473 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-e5d8b76e-7b8c-4fa6-9fa9-77e3f6088eb3 req-42645aa7-09a3-466d-a917-05fc4605d664 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:22.544385 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-e5d8b76e-7b8c-4fa6-9fa9-77e3f6088eb3 req-42645aa7-09a3-466d-a917-05fc4605d664 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:22.568835 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-e5d8b76e-7b8c-4fa6-9fa9-77e3f6088eb3 req-42645aa7-09a3-466d-a917-05fc4605d664 service nova] Creating event network-changed:089bf9c8-9bfa-48c0-bf88-af44a67566bb for instance 4bf4618e-3af1-46a8-9712-60af0f29a71f on n-h2-849104-4 Jul 12 11:51:22.587053 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-e5d8b76e-7b8c-4fa6-9fa9-77e3f6088eb3 req-42645aa7-09a3-466d-a917-05fc4605d664 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074831 Jul 12 11:51:22.588531 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 343/642] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:22.596479 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fd09ba25-3f5a-4ab9-a76f-541df6d6eb1b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Action: 'create', calling method: .version_select at 0x7f5e0a6a3550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-175185678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfOE05ivueGUdOuT1ezf7hZN4QmBOwKR6qz3XHfWlQ9E62AkAlYlW9QKYCRieSqK11sSr7cYVxRoU+JQrwntNlZDeZbKOCfeZyUHkFzsWsUbV/Tr65Z5oQ6f8UwKO7LMA=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:22.633952 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-fd09ba25-3f5a-4ab9-a76f-541df6d6eb1b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:22.640413 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-fd09ba25-3f5a-4ab9-a76f-541df6d6eb1b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for user 243d9e8e904d45a1b8c2c125a1ddbd16 and project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:22.672299 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fd09ba25-3f5a-4ab9-a76f-541df6d6eb1b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.080230 Jul 12 11:51:22.673270 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 344/643] 10.222.0.50 () {62 vars in 1198 bytes} [Tue Jul 12 11:51:22 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 12 11:51:22.681537 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-993a26f0-e5c9-47bc-b24f-309c604b33a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:22.682321 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-993a26f0-e5c9-47bc-b24f-309c604b33a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:22.700608 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-993a26f0-e5c9-47bc-b24f-309c604b33a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:22.701097 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-993a26f0-e5c9-47bc-b24f-309c604b33a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:22.702504 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-993a26f0-e5c9-47bc-b24f-309c604b33a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:22.702970 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-993a26f0-e5c9-47bc-b24f-309c604b33a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:22.917121 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ce2c0235-2463-4f7c-9f96-6c974bff20be tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:22.937570 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ce2c0235-2463-4f7c-9f96-6c974bff20be tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1388 microversion: 2.1 time: 1.389501 Jul 12 11:51:22.941637 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 300/644] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:21 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1388 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:22.955383 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-9edfcfa5-390c-4d4e-86c5-8cb5fc9b8c16 req-f0d1c87c-1204-471f-9e18-72b63ea12af6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c7d0ce-ac82-402c-b58a-e62d1f5eb767", "tag": "07eed80d-641f-4b46-953e-3bb05cb86283"}, {"server_uuid": "ae3975f6-39e7-4b52-abe1-975c4215f167", "name": "network-vif-unplugged", "status": "completed", "tag": "0722db67-d841-4498-a390-6a19339383b3"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:22.971129 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:22.990575 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-993a26f0-e5c9-47bc-b24f-309c604b33a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:23.002923 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-9edfcfa5-390c-4d4e-86c5-8cb5fc9b8c16 req-f0d1c87c-1204-471f-9e18-72b63ea12af6 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:23.006486 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-9edfcfa5-390c-4d4e-86c5-8cb5fc9b8c16 req-f0d1c87c-1204-471f-9e18-72b63ea12af6 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:23.008147 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-993a26f0-e5c9-47bc-b24f-309c604b33a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e" status: 200 len: 1319 microversion: 2.1 time: 0.333465 Jul 12 11:51:23.010876 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 345/645] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:22 2022] GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:23.024891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-891bfa94-e69a-4277-86fc-960405512e2e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:23.025777 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-891bfa94-e69a-4277-86fc-960405512e2e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:23.048360 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-891bfa94-e69a-4277-86fc-960405512e2e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:23.050188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-891bfa94-e69a-4277-86fc-960405512e2e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:23.054689 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-9edfcfa5-390c-4d4e-86c5-8cb5fc9b8c16 req-f0d1c87c-1204-471f-9e18-72b63ea12af6 service nova] Creating event network-changed:07eed80d-641f-4b46-953e-3bb05cb86283 for instance 19c7d0ce-ac82-402c-b58a-e62d1f5eb767 on n-h1-849104-4 Jul 12 11:51:23.055203 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-9edfcfa5-390c-4d4e-86c5-8cb5fc9b8c16 req-f0d1c87c-1204-471f-9e18-72b63ea12af6 service nova] Creating event network-vif-unplugged:0722db67-d841-4498-a390-6a19339383b3 for instance ae3975f6-39e7-4b52-abe1-975c4215f167 on n-h2-849104-4 Jul 12 11:51:23.056338 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-891bfa94-e69a-4277-86fc-960405512e2e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:23.057090 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-891bfa94-e69a-4277-86fc-960405512e2e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:23.074058 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-9edfcfa5-390c-4d4e-86c5-8cb5fc9b8c16 req-f0d1c87c-1204-471f-9e18-72b63ea12af6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.127580 Jul 12 11:51:23.076479 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 301/646] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:23.083193 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-99c0adf7-e325-42dc-b62f-14b1e80825dd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:23.093761 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-99c0adf7-e325-42dc-b62f-14b1e80825dd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:23.108089 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99c0adf7-e325-42dc-b62f-14b1e80825dd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:23.108089 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99c0adf7-e325-42dc-b62f-14b1e80825dd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:23.118973 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99c0adf7-e325-42dc-b62f-14b1e80825dd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:23.119613 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99c0adf7-e325-42dc-b62f-14b1e80825dd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:23.378153 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-891bfa94-e69a-4277-86fc-960405512e2e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:23.397418 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-891bfa94-e69a-4277-86fc-960405512e2e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1314 microversion: 2.1 time: 0.384256 Jul 12 11:51:23.398935 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 346/647] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:23 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:23.412543 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6a16c6e5-9385-45e0-85a9-e69a5a98e5ac tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Calling method '.version_select at 0x7f5e0a534280>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:23.419278 n-d-849104-4 devstack@n-api.service[125984]: WARNING oslo_db.sqlalchemy.utils [None req-6a16c6e5-9385-45e0-85a9-e69a5a98e5ac tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 12 11:51:23.430463 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6a16c6e5-9385-45e0-85a9-e69a5a98e5ac tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.029088 Jul 12 11:51:23.431386 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 347/648] 10.222.0.50 () {60 vars in 1176 bytes} [Tue Jul 12 11:51:23 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:23.440141 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3ffc7848-e015-4bb7-8fb5-c18cce6ed600 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:23.441843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3ffc7848-e015-4bb7-8fb5-c18cce6ed600 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:23.456481 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3ffc7848-e015-4bb7-8fb5-c18cce6ed600 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:23.457333 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3ffc7848-e015-4bb7-8fb5-c18cce6ed600 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:23.459962 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3ffc7848-e015-4bb7-8fb5-c18cce6ed600 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:23.460674 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3ffc7848-e015-4bb7-8fb5-c18cce6ed600 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:23.734326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-99c0adf7-e325-42dc-b62f-14b1e80825dd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:23.750776 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-99c0adf7-e325-42dc-b62f-14b1e80825dd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1503 microversion: 2.1 time: 0.672897 Jul 12 11:51:23.751822 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 302/649] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:23 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1503 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:23.759012 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a5b86b38-90d3-413a-a94e-32a2f58e81a0 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Calling method '.version_select at 0x7f5e0b0b2700>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:23.798182 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a5b86b38-90d3-413a-a94e-32a2f58e81a0 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-175185678" status: 204 len: 0 microversion: 2.2 time: 0.044839 Jul 12 11:51:23.800322 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 303/650] 10.222.0.50 () {60 vars in 1317 bytes} [Tue Jul 12 11:51:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-175185678 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:51:23.812548 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a44d6394-474d-4e93-a0fa-65a25f6447f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:23.814774 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a44d6394-474d-4e93-a0fa-65a25f6447f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:23.825603 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a44d6394-474d-4e93-a0fa-65a25f6447f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:23.826460 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a44d6394-474d-4e93-a0fa-65a25f6447f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:23.828431 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a44d6394-474d-4e93-a0fa-65a25f6447f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:23.829245 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a44d6394-474d-4e93-a0fa-65a25f6447f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:23.854168 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3ffc7848-e015-4bb7-8fb5-c18cce6ed600 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:23.866727 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3ffc7848-e015-4bb7-8fb5-c18cce6ed600 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1469 microversion: 2.1 time: 0.433803 Jul 12 11:51:23.867543 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:23.870626 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 348/651] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:23 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1469 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:23.882717 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-71c6fe20-c7cf-4a9d-b97c-553157cf1cb6 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Calling method '.version_select at 0x7f5e0a4a6700>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:23.899066 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:23.923697 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-71c6fe20-c7cf-4a9d-b97c-553157cf1cb6 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1511158400" status: 204 len: 0 microversion: 2.2 time: 0.051128 Jul 12 11:51:23.924708 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 349/652] 10.222.0.50 () {60 vars in 1320 bytes} [Tue Jul 12 11:51:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1511158400 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:51:23.930232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8edadbde-4a14-4f9f-82da-64914d8a1269 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:23.931233 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8edadbde-4a14-4f9f-82da-64914d8a1269 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:23.938345 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8edadbde-4a14-4f9f-82da-64914d8a1269 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:23.939170 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8edadbde-4a14-4f9f-82da-64914d8a1269 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:23.940254 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8edadbde-4a14-4f9f-82da-64914d8a1269 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:23.941023 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8edadbde-4a14-4f9f-82da-64914d8a1269 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:23.989161 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-8edadbde-4a14-4f9f-82da-64914d8a1269 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lazy-loading 'flavor' on Instance uuid a873a920-f2b5-4503-97e5-0ddaae09abc6 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:51:24.139796 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8edadbde-4a14-4f9f-82da-64914d8a1269 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6/action" status: 202 len: 0 microversion: 2.1 time: 0.213435 Jul 12 11:51:24.143826 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 350/653] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:51:23 2022] POST /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:51:24.162049 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7e81ada5-cd8b-48a9-810e-54c09a7d5a07 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Calling method '.version_select at 0x7f5e0a5340d0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:24.205058 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7e81ada5-cd8b-48a9-810e-54c09a7d5a07 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-256869421" status: 204 len: 0 microversion: 2.2 time: 0.057043 Jul 12 11:51:24.205810 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 351/654] 10.222.0.50 () {60 vars in 1317 bytes} [Tue Jul 12 11:51:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-256869421 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:51:24.213079 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fc1b1305-c445-498e-a038-a7e04b0a98c5 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:24.213894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fc1b1305-c445-498e-a038-a7e04b0a98c5 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:24.221731 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc1b1305-c445-498e-a038-a7e04b0a98c5 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:24.222288 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc1b1305-c445-498e-a038-a7e04b0a98c5 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:24.223098 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc1b1305-c445-498e-a038-a7e04b0a98c5 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:24.223546 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc1b1305-c445-498e-a038-a7e04b0a98c5 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:24.339619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a44d6394-474d-4e93-a0fa-65a25f6447f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:24.351898 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a44d6394-474d-4e93-a0fa-65a25f6447f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1471 microversion: 2.1 time: 0.550165 Jul 12 11:51:24.361644 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 304/655] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:23 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1471 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:24.368069 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-96045ef8-ccd4-4330-97ab-56ef5236ec2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:24.372530 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-96045ef8-ccd4-4330-97ab-56ef5236ec2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:24.392022 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-96045ef8-ccd4-4330-97ab-56ef5236ec2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:24.392861 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-96045ef8-ccd4-4330-97ab-56ef5236ec2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:24.393903 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-96045ef8-ccd4-4330-97ab-56ef5236ec2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:24.395193 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-96045ef8-ccd4-4330-97ab-56ef5236ec2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:24.538431 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fc1b1305-c445-498e-a038-a7e04b0a98c5 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:24.552197 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fc1b1305-c445-498e-a038-a7e04b0a98c5 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1388 microversion: 2.1 time: 0.344805 Jul 12 11:51:24.553394 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 352/656] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:24 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1388 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:24.559073 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-27f2eaf7-8737-498e-8898-f2e4fec5e031 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:24.559970 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-27f2eaf7-8737-498e-8898-f2e4fec5e031 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:24.567710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27f2eaf7-8737-498e-8898-f2e4fec5e031 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:24.568694 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27f2eaf7-8737-498e-8898-f2e4fec5e031 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:24.569046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27f2eaf7-8737-498e-8898-f2e4fec5e031 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:24.569693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27f2eaf7-8737-498e-8898-f2e4fec5e031 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:24.761896 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-27f2eaf7-8737-498e-8898-f2e4fec5e031 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:24.771801 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-27f2eaf7-8737-498e-8898-f2e4fec5e031 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1477 microversion: 2.1 time: 0.217241 Jul 12 11:51:24.773036 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 353/657] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:24 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1477 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:24.778781 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d4f4acbd-f34e-407a-8320-ba0a1bbe67ab tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Action: 'create', calling method: .version_select at 0x7f5e0a5340d0>, body: {"keypair": {"name": "tempest-keypair-1035806232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpat+MuGxl/JnEHgdqiFo/Yx2O7DhHrjKJqWDeS/oHrQUSerTU6qEJkC3IRB9mKWQ+XNYdIDKJsQK58MTpYSJXnaUiWFSVLW4kCUjTnmKgauHz+TcMryGgD5Ze/2AX3vQ=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:24.802374 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-d4f4acbd-f34e-407a-8320-ba0a1bbe67ab tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:24.810975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-d4f4acbd-f34e-407a-8320-ba0a1bbe67ab tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for user 243d9e8e904d45a1b8c2c125a1ddbd16 and project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:24.844657 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d4f4acbd-f34e-407a-8320-ba0a1bbe67ab tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.070196 Jul 12 11:51:24.845913 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 354/658] 10.222.0.50 () {62 vars in 1198 bytes} [Tue Jul 12 11:51:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 12 11:51:24.852004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3470761b-6c70-44a0-b363-bb414bc8a8cf tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:24.852861 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3470761b-6c70-44a0-b363-bb414bc8a8cf tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:24.862955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3470761b-6c70-44a0-b363-bb414bc8a8cf tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:24.863811 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3470761b-6c70-44a0-b363-bb414bc8a8cf tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:24.866148 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3470761b-6c70-44a0-b363-bb414bc8a8cf tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:24.868847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3470761b-6c70-44a0-b363-bb414bc8a8cf tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:25.103891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3470761b-6c70-44a0-b363-bb414bc8a8cf tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:25.112367 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3470761b-6c70-44a0-b363-bb414bc8a8cf tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1314 microversion: 2.1 time: 0.264939 Jul 12 11:51:25.113311 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 355/659] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:24 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:25.119057 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-70bbf0a0-00d3-43d4-9b21-e5cccf775140 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:25.119690 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-70bbf0a0-00d3-43d4-9b21-e5cccf775140 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:25.129233 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-70bbf0a0-00d3-43d4-9b21-e5cccf775140 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:25.129731 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-70bbf0a0-00d3-43d4-9b21-e5cccf775140 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:25.130971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-70bbf0a0-00d3-43d4-9b21-e5cccf775140 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:25.131452 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-70bbf0a0-00d3-43d4-9b21-e5cccf775140 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:25.135039 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-96045ef8-ccd4-4330-97ab-56ef5236ec2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:25.150542 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-96045ef8-ccd4-4330-97ab-56ef5236ec2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e" status: 200 len: 1319 microversion: 2.1 time: 0.787356 Jul 12 11:51:25.151140 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 305/660] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:24 2022] GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e => generated 1319 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:25.177222 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-303ed339-9e7b-43f6-af3c-a6235847644b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Calling method '.version_select at 0x7f5e0b1009d0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:25.204889 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-303ed339-9e7b-43f6-af3c-a6235847644b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-1035806232" status: 200 len: 513 microversion: 2.2 time: 0.042736 Jul 12 11:51:25.206353 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 306/661] 10.222.0.50 () {60 vars in 1257 bytes} [Tue Jul 12 11:51:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1035806232 => generated 513 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:25.218837 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6622c49d-7485-412d-bbdc-e3a315e086c9 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Calling method '.version_select at 0x7f5e0b0b2ca0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:25.225799 n-d-849104-4 devstack@n-api.service[125983]: WARNING oslo_db.sqlalchemy.utils [None req-6622c49d-7485-412d-bbdc-e3a315e086c9 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 12 11:51:25.238974 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6622c49d-7485-412d-bbdc-e3a315e086c9 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.025459 Jul 12 11:51:25.239998 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 307/662] 10.222.0.50 () {60 vars in 1176 bytes} [Tue Jul 12 11:51:25 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:51:25.261621 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6e27081f-0df5-4741-8b23-e9d34bb1ba5a tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Calling method '.version_select at 0x7f5e0b0da5e0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:25.303318 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6e27081f-0df5-4741-8b23-e9d34bb1ba5a tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035806232" status: 204 len: 0 microversion: 2.2 time: 0.055330 Jul 12 11:51:25.304326 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 308/663] 10.222.0.50 () {60 vars in 1260 bytes} [Tue Jul 12 11:51:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035806232 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:51:25.316706 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6d8f3fb1-d43a-47b2-8750-ae769eee5e6b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Action: 'create', calling method: .version_select at 0x7f5e0b074280>, body: {"keypair": {"name": "tempest-keypair-1018791205", "type": "x509"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:25.336017 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-6d8f3fb1-d43a-47b2-8750-ae769eee5e6b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:25.346269 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-6d8f3fb1-d43a-47b2-8750-ae769eee5e6b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for user 243d9e8e904d45a1b8c2c125a1ddbd16 and project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:25.381941 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.processutils [None req-6d8f3fb1-d43a-47b2-8750-ae769eee5e6b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpp4qs6niy/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpp4qs6niy/temp.key -subj /CN=243d9e8e904d45a1b8c2c125a1ddbd16 -extensions v3_req_client {{(pid=125983) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 12 11:51:25.568257 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-70bbf0a0-00d3-43d4-9b21-e5cccf775140 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:25.591110 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-70bbf0a0-00d3-43d4-9b21-e5cccf775140 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1503 microversion: 2.1 time: 0.476475 Jul 12 11:51:25.595726 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 356/664] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:25 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1503 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:25.614610 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ba23b377-cfe7-489b-b6de-1de8578e7f61 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:25.619428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ba23b377-cfe7-489b-b6de-1de8578e7f61 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:25.644766 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ba23b377-cfe7-489b-b6de-1de8578e7f61 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:25.648259 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ba23b377-cfe7-489b-b6de-1de8578e7f61 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:25.649299 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ba23b377-cfe7-489b-b6de-1de8578e7f61 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:25.656092 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ba23b377-cfe7-489b-b6de-1de8578e7f61 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:26.043084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ba23b377-cfe7-489b-b6de-1de8578e7f61 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:26.049194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:26.058492 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ba23b377-cfe7-489b-b6de-1de8578e7f61 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1471 microversion: 2.1 time: 0.458851 Jul 12 11:51:26.059086 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 357/665] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:25 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1471 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:26.075427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c2686e62-5dfc-481f-8db4-0cdcca538cac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:26.076080 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c2686e62-5dfc-481f-8db4-0cdcca538cac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:26.097041 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c2686e62-5dfc-481f-8db4-0cdcca538cac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:26.097284 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c2686e62-5dfc-481f-8db4-0cdcca538cac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:26.097921 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c2686e62-5dfc-481f-8db4-0cdcca538cac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:26.098384 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c2686e62-5dfc-481f-8db4-0cdcca538cac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:26.102113 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.processutils [None req-6d8f3fb1-d43a-47b2-8750-ae769eee5e6b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpp4qs6niy/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpp4qs6niy/temp.key -subj /CN=243d9e8e904d45a1b8c2c125a1ddbd16 -extensions v3_req_client" returned: 0 in 0.720s {{(pid=125983) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 12 11:51:26.105451 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.processutils [None req-6d8f3fb1-d43a-47b2-8750-ae769eee5e6b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpp4qs6niy/temp.key -password pass: {{(pid=125983) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 12 11:51:26.168389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.processutils [None req-6d8f3fb1-d43a-47b2-8750-ae769eee5e6b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpp4qs6niy/temp.key -password pass:" returned: 0 in 0.062s {{(pid=125983) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 12 11:51:26.239632 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-6d8f3fb1-d43a-47b2-8750-ae769eee5e6b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:26.253428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-6d8f3fb1-d43a-47b2-8750-ae769eee5e6b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Getting quotas for user 243d9e8e904d45a1b8c2c125a1ddbd16 and project e85a83754b4546b79d0b53444a28a32c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:26.286654 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6d8f3fb1-d43a-47b2-8750-ae769eee5e6b tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.976377 Jul 12 11:51:26.288021 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 309/666] 10.222.0.50 () {62 vars in 1197 bytes} [Tue Jul 12 11:51:25 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 979 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:51:26.295328 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2e1affc4-fbec-4dd2-a8b0-93b996553893 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:26.296668 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2e1affc4-fbec-4dd2-a8b0-93b996553893 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:26.305396 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2e1affc4-fbec-4dd2-a8b0-93b996553893 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:26.306364 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2e1affc4-fbec-4dd2-a8b0-93b996553893 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:26.307653 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2e1affc4-fbec-4dd2-a8b0-93b996553893 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:26.308531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2e1affc4-fbec-4dd2-a8b0-93b996553893 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:26.413255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c2686e62-5dfc-481f-8db4-0cdcca538cac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:26.435048 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c2686e62-5dfc-481f-8db4-0cdcca538cac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1587 microversion: 2.1 time: 0.374492 Jul 12 11:51:26.442962 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 358/667] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:26 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1587 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:26.453860 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-b66ce471-cf6e-4655-b887-3c9a647f936a req-1545704c-194f-42c4-95af-5cd114ca37e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6f463a-4dd8-4d96-9092-f41f16f1e13e", "name": "network-vif-plugged", "status": "completed", "tag": "a41f8d53-2f24-43d5-b2b8-7a611037f182"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:26.480210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b66ce471-cf6e-4655-b887-3c9a647f936a req-1545704c-194f-42c4-95af-5cd114ca37e7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:26.480936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b66ce471-cf6e-4655-b887-3c9a647f936a req-1545704c-194f-42c4-95af-5cd114ca37e7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:26.509311 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-b66ce471-cf6e-4655-b887-3c9a647f936a req-1545704c-194f-42c4-95af-5cd114ca37e7 service nova] Creating event network-vif-plugged:a41f8d53-2f24-43d5-b2b8-7a611037f182 for instance ab6f463a-4dd8-4d96-9092-f41f16f1e13e on n-h1-849104-4 Jul 12 11:51:26.525361 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-b66ce471-cf6e-4655-b887-3c9a647f936a req-1545704c-194f-42c4-95af-5cd114ca37e7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080177 Jul 12 11:51:26.526567 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 359/668] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:26.534209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-87050f4b-6757-4c70-904c-4b1e9c47220e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:26.536299 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-87050f4b-6757-4c70-904c-4b1e9c47220e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:26.545534 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-87050f4b-6757-4c70-904c-4b1e9c47220e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:26.548196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-87050f4b-6757-4c70-904c-4b1e9c47220e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:26.552456 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-87050f4b-6757-4c70-904c-4b1e9c47220e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:26.555494 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-87050f4b-6757-4c70-904c-4b1e9c47220e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:26.857894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-87050f4b-6757-4c70-904c-4b1e9c47220e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:26.867109 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-87050f4b-6757-4c70-904c-4b1e9c47220e tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1314 microversion: 2.1 time: 0.337502 Jul 12 11:51:26.872541 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 360/669] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:26 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:26.880440 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4dc93eb0-17a3-4c06-a1e6-3b0e7c8d3e64 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:26.883045 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4dc93eb0-17a3-4c06-a1e6-3b0e7c8d3e64 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:26.893183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4dc93eb0-17a3-4c06-a1e6-3b0e7c8d3e64 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:26.893856 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4dc93eb0-17a3-4c06-a1e6-3b0e7c8d3e64 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:26.894708 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4dc93eb0-17a3-4c06-a1e6-3b0e7c8d3e64 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:26.895141 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4dc93eb0-17a3-4c06-a1e6-3b0e7c8d3e64 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:27.015434 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2e1affc4-fbec-4dd2-a8b0-93b996553893 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:27.039855 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2e1affc4-fbec-4dd2-a8b0-93b996553893 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1460 microversion: 2.1 time: 0.746516 Jul 12 11:51:27.051576 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 310/670] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:26 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1460 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:27.051576 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d1ad9f7a-c45d-40d9-a6fa-16ea8daad198 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Calling method '.version_select at 0x7f5e0b138ee0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:27.084122 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d1ad9f7a-c45d-40d9-a6fa-16ea8daad198 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-1018791205" status: 200 len: 1534 microversion: 2.2 time: 0.041861 Jul 12 11:51:27.091941 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 311/671] 10.222.0.50 () {60 vars in 1257 bytes} [Tue Jul 12 11:51:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1018791205 => generated 1534 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:27.100101 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b2a8e08b-bca8-4871-888f-46d781f02f2d tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:27.100746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b2a8e08b-bca8-4871-888f-46d781f02f2d tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:27.109561 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b2a8e08b-bca8-4871-888f-46d781f02f2d tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:27.110072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b2a8e08b-bca8-4871-888f-46d781f02f2d tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:27.110885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b2a8e08b-bca8-4871-888f-46d781f02f2d tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:27.111329 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b2a8e08b-bca8-4871-888f-46d781f02f2d tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:27.134102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4dc93eb0-17a3-4c06-a1e6-3b0e7c8d3e64 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:27.151284 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4dc93eb0-17a3-4c06-a1e6-3b0e7c8d3e64 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e" status: 200 len: 1319 microversion: 2.1 time: 0.276058 Jul 12 11:51:27.164971 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 361/672] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:26 2022] GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:27.188353 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8ec64d0e-461e-4812-a197-dcc98bb0a4c1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:27.189751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8ec64d0e-461e-4812-a197-dcc98bb0a4c1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:27.200890 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8ec64d0e-461e-4812-a197-dcc98bb0a4c1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:27.202046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8ec64d0e-461e-4812-a197-dcc98bb0a4c1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:27.203450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8ec64d0e-461e-4812-a197-dcc98bb0a4c1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:27.204102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8ec64d0e-461e-4812-a197-dcc98bb0a4c1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:27.290604 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b2a8e08b-bca8-4871-888f-46d781f02f2d tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196434 Jul 12 11:51:27.292155 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 312/673] 10.222.0.50 () {58 vars in 1274 bytes} [Tue Jul 12 11:51:27 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:27.299027 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-93a8d99d-ee52-47ef-959d-cc4a0cff9b51 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:27.300260 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-93a8d99d-ee52-47ef-959d-cc4a0cff9b51 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:27.308679 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93a8d99d-ee52-47ef-959d-cc4a0cff9b51 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:27.309446 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93a8d99d-ee52-47ef-959d-cc4a0cff9b51 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:27.310445 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93a8d99d-ee52-47ef-959d-cc4a0cff9b51 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:27.311060 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93a8d99d-ee52-47ef-959d-cc4a0cff9b51 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:27.597375 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8ec64d0e-461e-4812-a197-dcc98bb0a4c1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:27.610288 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8ec64d0e-461e-4812-a197-dcc98bb0a4c1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1493 microversion: 2.1 time: 0.443575 Jul 12 11:51:27.625122 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 362/674] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:27 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1493 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:27.625122 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f241b99a-e712-4035-ad4e-53e6071571b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:27.625122 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f241b99a-e712-4035-ad4e-53e6071571b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:27.637173 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f241b99a-e712-4035-ad4e-53e6071571b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:27.637798 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f241b99a-e712-4035-ad4e-53e6071571b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:27.640705 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f241b99a-e712-4035-ad4e-53e6071571b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:27.641557 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f241b99a-e712-4035-ad4e-53e6071571b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:28.131004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f241b99a-e712-4035-ad4e-53e6071571b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:28.149997 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f241b99a-e712-4035-ad4e-53e6071571b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1476 microversion: 2.1 time: 0.537716 Jul 12 11:51:28.161968 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 363/675] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:27 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1476 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:28.172427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c86df3ba-b1ec-4f8e-9a35-d5484f95204c tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Calling method '.version_select at 0x7f5e0a505c10>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:28.184290 n-d-849104-4 devstack@n-api.service[125984]: WARNING oslo_db.sqlalchemy.utils [None req-c86df3ba-b1ec-4f8e-9a35-d5484f95204c tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 12 11:51:28.198358 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c86df3ba-b1ec-4f8e-9a35-d5484f95204c tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.042759 Jul 12 11:51:28.199101 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 364/676] 10.222.0.50 () {60 vars in 1176 bytes} [Tue Jul 12 11:51:28 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:28.212914 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1fe264bf-b9b5-494e-9d82-621709eb42cd tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '.version_select at 0x7f5e0a884550>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:28.223332 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1fe264bf-b9b5-494e-9d82-621709eb42cd tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:28.225293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1fe264bf-b9b5-494e-9d82-621709eb42cd tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:28.244630 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1fe264bf-b9b5-494e-9d82-621709eb42cd tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1186 microversion: 2.1 time: 0.044069 Jul 12 11:51:28.253739 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 365/677] 10.222.0.50 () {58 vars in 1142 bytes} [Tue Jul 12 11:51:28 2022] GET /compute/v2.1/os-migrations => generated 1186 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:28.260175 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c73ef191-8a7b-42f8-910d-fe9ec431f273 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:28.261061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c73ef191-8a7b-42f8-910d-fe9ec431f273 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:28.270928 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c73ef191-8a7b-42f8-910d-fe9ec431f273 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:28.271728 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c73ef191-8a7b-42f8-910d-fe9ec431f273 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:28.272767 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c73ef191-8a7b-42f8-910d-fe9ec431f273 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:28.273927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c73ef191-8a7b-42f8-910d-fe9ec431f273 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:28.535176 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-93a8d99d-ee52-47ef-959d-cc4a0cff9b51 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1611 microversion: 2.1 time: 1.241376 Jul 12 11:51:28.546380 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 313/678] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:27 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1611 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:28.549092 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7a4c37fe-e4d1-4c0e-a1ad-3e53d18de90c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:28.549951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7a4c37fe-e4d1-4c0e-a1ad-3e53d18de90c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:28.563285 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a4c37fe-e4d1-4c0e-a1ad-3e53d18de90c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:28.563878 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a4c37fe-e4d1-4c0e-a1ad-3e53d18de90c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:28.567423 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a4c37fe-e4d1-4c0e-a1ad-3e53d18de90c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:28.569955 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a4c37fe-e4d1-4c0e-a1ad-3e53d18de90c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:28.690120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c73ef191-8a7b-42f8-910d-fe9ec431f273 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:28.699689 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c73ef191-8a7b-42f8-910d-fe9ec431f273 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1314 microversion: 2.1 time: 0.444171 Jul 12 11:51:28.700900 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 366/679] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:28 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:28.708441 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-233614fb-979b-461f-a968-1a4ee62610a5 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] Calling method '.version_select at 0x7f5e0a7acc10>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:28.731792 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-233614fb-979b-461f-a968-1a4ee62610a5 tempest-KeyPairsV22TestJSON-172599061 tempest-KeyPairsV22TestJSON-172599061-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018791205" status: 204 len: 0 microversion: 2.2 time: 0.029456 Jul 12 11:51:28.736365 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 367/680] 10.222.0.50 () {60 vars in 1260 bytes} [Tue Jul 12 11:51:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018791205 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:51:28.746133 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c81ea80c-c147-4f86-b740-ad5afbf837a6 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:28.749791 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c81ea80c-c147-4f86-b740-ad5afbf837a6 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:28.772732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c81ea80c-c147-4f86-b740-ad5afbf837a6 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:28.773627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c81ea80c-c147-4f86-b740-ad5afbf837a6 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:28.775608 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c81ea80c-c147-4f86-b740-ad5afbf837a6 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:28.776331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c81ea80c-c147-4f86-b740-ad5afbf837a6 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:28.822885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7a4c37fe-e4d1-4c0e-a1ad-3e53d18de90c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:28.830894 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7a4c37fe-e4d1-4c0e-a1ad-3e53d18de90c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e" status: 200 len: 1468 microversion: 2.1 time: 0.294049 Jul 12 11:51:28.831494 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 314/681] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:28 2022] GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e => generated 1468 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:28.853583 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6f684491-dcd2-49ce-9e63-74566d7ca1b6 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:28.857027 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:51:28.857027 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:51:28.859760 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f684491-dcd2-49ce-9e63-74566d7ca1b6 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:28.860564 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f684491-dcd2-49ce-9e63-74566d7ca1b6 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:28.861555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f684491-dcd2-49ce-9e63-74566d7ca1b6 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:28.863008 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f684491-dcd2-49ce-9e63-74566d7ca1b6 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:28.903275 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6f684491-dcd2-49ce-9e63-74566d7ca1b6 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.070713 Jul 12 11:51:28.912160 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 315/682] 10.222.0.50 () {58 vars in 1175 bytes} [Tue Jul 12 11:51:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:28.926560 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-04a22368-af90-4d7f-872f-44b1d92cd120 req-94019f39-938d-4e00-b5f2-dde2f10b1600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf4618e-3af1-46a8-9712-60af0f29a71f", "name": "network-vif-plugged", "status": "completed", "tag": "089bf9c8-9bfa-48c0-bf88-af44a67566bb"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:28.940231 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-04a22368-af90-4d7f-872f-44b1d92cd120 req-94019f39-938d-4e00-b5f2-dde2f10b1600 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:28.940997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-04a22368-af90-4d7f-872f-44b1d92cd120 req-94019f39-938d-4e00-b5f2-dde2f10b1600 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:28.956611 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-04a22368-af90-4d7f-872f-44b1d92cd120 req-94019f39-938d-4e00-b5f2-dde2f10b1600 service nova] Creating event network-vif-plugged:089bf9c8-9bfa-48c0-bf88-af44a67566bb for instance 4bf4618e-3af1-46a8-9712-60af0f29a71f on n-h2-849104-4 Jul 12 11:51:28.978598 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-04a22368-af90-4d7f-872f-44b1d92cd120 req-94019f39-938d-4e00-b5f2-dde2f10b1600 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053045 Jul 12 11:51:28.980159 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 316/683] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:28.995026 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8a30dd67-7c0c-4a53-862e-bb26c743af8e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:28.997194 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8a30dd67-7c0c-4a53-862e-bb26c743af8e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 19c7d0ce-ac82-402c-b58a-e62d1f5eb767] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:29.013924 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8a30dd67-7c0c-4a53-862e-bb26c743af8e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:29.016317 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8a30dd67-7c0c-4a53-862e-bb26c743af8e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:29.018081 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8a30dd67-7c0c-4a53-862e-bb26c743af8e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:29.019197 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8a30dd67-7c0c-4a53-862e-bb26c743af8e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:29.052592 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c81ea80c-c147-4f86-b740-ad5afbf837a6 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1644 microversion: 2.1 time: 0.314742 Jul 12 11:51:29.053482 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 368/684] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:28 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1644 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:29.058866 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-58d8a872-fb37-4a76-82b7-9afe37d23547 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849104-4", "block_migration": true, "disk_over_commit": false}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:29.062493 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-58d8a872-fb37-4a76-82b7-9afe37d23547 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:29.073898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58d8a872-fb37-4a76-82b7-9afe37d23547 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:29.074361 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58d8a872-fb37-4a76-82b7-9afe37d23547 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:29.075190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58d8a872-fb37-4a76-82b7-9afe37d23547 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:29.075664 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58d8a872-fb37-4a76-82b7-9afe37d23547 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:29.134890 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-58d8a872-fb37-4a76-82b7-9afe37d23547 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Lazy-loading 'flavor' on Instance uuid a873a920-f2b5-4503-97e5-0ddaae09abc6 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:51:29.155667 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-58d8a872-fb37-4a76-82b7-9afe37d23547 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance a873a920-f2b5-4503-97e5-0ddaae09abc6 while it is in vm_state suspended Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-58d8a872-fb37-4a76-82b7-9afe37d23547 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Request method failure captured: Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6/action HTTP/1.1 Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 97 Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_70XjGZJWDVYC33v2_JDmyS6BeAk4xMBGxvyHh1a70jp1rNqHfLwA0eBDox7gr-I95wz_ZEOXBZ7yRrtHtCTD4WX7SfYQhogtI0rAikX8XdpHF14ZDd-2HJdRqVQsUOx-1FOamnSRsNPWp_viWk3n5kc3MAh52AUafOGyHTx9MKY4 Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d593caa655dd49fab180a18f8018d20a Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-LiveMigrationNegativeTest-696013187 Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d593caa655dd49fab180a18f8018d20a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d593caa655dd49fab180a18f8018d20a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d593caa655dd49fab180a18f8018d20a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d593caa655dd49fab180a18f8018d20a", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-LiveMigrationNegativeTest-696013187 Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d593caa655dd49fab180a18f8018d20a Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-696013187 Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-LiveMigrationNegativeTest-696013187-project-admin Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: b3d223e6a56c41bc90d0aca89601a6df Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-LiveMigrationNegativeTest-696013187-project-admin Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: {"os-migrateLive": {"host": "n-h2-849104-4", "block_migration": true, "disk_over_commit": false}} Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: exception: Cannot 'os-migrateLive' instance a873a920-f2b5-4503-97e5-0ddaae09abc6 while it is in vm_state suspended Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'a873a920-f2b5-4503-97e5-0ddaae09abc6', 'body': {'os-migrateLive': {'host': 'n-h2-849104-4', 'block_migration': True, 'disk_over_commit': False}}} Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a873a920-f2b5-4503-97e5-0ddaae09abc6 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:29.159759 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance a873a920-f2b5-4503-97e5-0ddaae09abc6 while it is in vm_state suspended Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance a873a920-f2b5-4503-97e5-0ddaae09abc6 while it is in vm_state suspended Jul 12 11:51:29.165278 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:29.169819 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-58d8a872-fb37-4a76-82b7-9afe37d23547 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance a873a920-f2b5-4503-97e5-0ddaae09abc6 while it is in vm_state suspended {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:51:29.171547 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-58d8a872-fb37-4a76-82b7-9afe37d23547 tempest-LiveMigrationNegativeTest-696013187 tempest-LiveMigrationNegativeTest-696013187-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6/action" status: 409 len: 155 microversion: 2.1 time: 0.116262 Jul 12 11:51:29.172733 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 369/685] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:51:29 2022] POST /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6/action => generated 155 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:51:29.182759 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bf68ac2b-6be9-493e-a25a-4de801f5a5a8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:29.183622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bf68ac2b-6be9-493e-a25a-4de801f5a5a8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:29.209826 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf68ac2b-6be9-493e-a25a-4de801f5a5a8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:29.211091 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf68ac2b-6be9-493e-a25a-4de801f5a5a8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:29.213160 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf68ac2b-6be9-493e-a25a-4de801f5a5a8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:29.213841 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf68ac2b-6be9-493e-a25a-4de801f5a5a8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:29.436099 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8a30dd67-7c0c-4a53-862e-bb26c743af8e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:29.462279 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8a30dd67-7c0c-4a53-862e-bb26c743af8e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767" status: 200 len: 1319 microversion: 2.1 time: 0.480080 Jul 12 11:51:29.464154 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 317/686] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:28 2022] GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767 => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:29.486785 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2d439e1c-f311-4f97-a38b-b39f100d3cc6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:29.494195 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2d439e1c-f311-4f97-a38b-b39f100d3cc6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:29.514692 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d439e1c-f311-4f97-a38b-b39f100d3cc6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:29.517563 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d439e1c-f311-4f97-a38b-b39f100d3cc6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:29.521433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d439e1c-f311-4f97-a38b-b39f100d3cc6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:29.523035 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d439e1c-f311-4f97-a38b-b39f100d3cc6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:29.575754 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bf68ac2b-6be9-493e-a25a-4de801f5a5a8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:29.588463 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bf68ac2b-6be9-493e-a25a-4de801f5a5a8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1476 microversion: 2.1 time: 0.413373 Jul 12 11:51:29.591186 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 370/687] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:29 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1476 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:29.596753 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1971939791", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "d3804aae-e5e6-40af-a993-2653361ea3e0"}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:29.603219 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2d439e1c-f311-4f97-a38b-b39f100d3cc6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:51:29.713713 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] validate_networks() for [('d3804aae-e5e6-40af-a993-2653361ea3e0', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:51:29.782818 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2d439e1c-f311-4f97-a38b-b39f100d3cc6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 204 len: 0 microversion: 2.1 time: 0.316414 Jul 12 11:51:29.790120 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 318/688] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:51:29 2022] DELETE /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:51:30.062703 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4067d77d-e572-47e7-82fe-78a64126e58f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Action: 'create', calling method: .version_select at 0x7f5e0b0593a0>, body: {"keypair": {"name": "tempest-keypair-1342155430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqfC4o4JKGXcg5b664+3FgWhdD+55GhJOC1SMdoiYCLXzyE5eY5ptf5OoroxxVAcC+nNT74K9hcTZX/ec1st6wmAUVEzIMJ0Bl/jXAT3QeR69I2srCvWq+yAo4/QRBtVg=="}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:30.093181 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-4067d77d-e572-47e7-82fe-78a64126e58f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Getting quotas for project bd080a7dad6c4a6ebf684e44bf7a6e76. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:30.103176 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-4067d77d-e572-47e7-82fe-78a64126e58f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Getting quotas for user 5a7ca463d55047caa749c514a3e1499d and project bd080a7dad6c4a6ebf684e44bf7a6e76. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:30.146193 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4067d77d-e572-47e7-82fe-78a64126e58f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.354216 Jul 12 11:51:30.147524 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 319/689] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:51:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:30.193039 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-55d339e9-bf05-4c9e-aa0a-6a53855415d6 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:30.194676 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-55d339e9-bf05-4c9e-aa0a-6a53855415d6 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:30.229170 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55d339e9-bf05-4c9e-aa0a-6a53855415d6 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:30.230726 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55d339e9-bf05-4c9e-aa0a-6a53855415d6 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:30.232176 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55d339e9-bf05-4c9e-aa0a-6a53855415d6 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:30.232954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55d339e9-bf05-4c9e-aa0a-6a53855415d6 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:30.764384 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-55d339e9-bf05-4c9e-aa0a-6a53855415d6 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:30.784556 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-55d339e9-bf05-4c9e-aa0a-6a53855415d6 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1314 microversion: 2.1 time: 0.634531 Jul 12 11:51:30.796785 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 320/690] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:30 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:30.804565 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bd9afaf3-ceac-4e1a-8296-526e9d007110 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:30.807225 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-bd9afaf3-ceac-4e1a-8296-526e9d007110 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:30.824020 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bd9afaf3-ceac-4e1a-8296-526e9d007110 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:30.824511 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bd9afaf3-ceac-4e1a-8296-526e9d007110 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:30.825297 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bd9afaf3-ceac-4e1a-8296-526e9d007110 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:30.825937 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bd9afaf3-ceac-4e1a-8296-526e9d007110 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:31.041984 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bd9afaf3-ceac-4e1a-8296-526e9d007110 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:31.054983 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bd9afaf3-ceac-4e1a-8296-526e9d007110 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1466 microversion: 2.1 time: 0.262168 Jul 12 11:51:31.055790 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 321/691] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:30 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1466 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:31.074302 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-85197a9d-144e-440e-9a4a-2ce8db0fd4f8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:31.091067 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-85197a9d-144e-440e-9a4a-2ce8db0fd4f8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:31.103786 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-85197a9d-144e-440e-9a4a-2ce8db0fd4f8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:31.104548 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-85197a9d-144e-440e-9a4a-2ce8db0fd4f8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:31.115127 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-85197a9d-144e-440e-9a4a-2ce8db0fd4f8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:31.117541 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-85197a9d-144e-440e-9a4a-2ce8db0fd4f8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:31.204442 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:51:31.206564 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:51:31.207610 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:51:31.208314 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:51:31.208990 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:51:31.232375 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:31.233118 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:31.234276 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:31.234930 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:31.281608 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Getting quotas for project d9393a32f934440e975f62b7d59eed32. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:31.289647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Getting quotas for user 86ca9c0d2f474f1f9c35aaf5fb9c6064 and project d9393a32f934440e975f62b7d59eed32. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:31.333731 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:51:31.339546 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:51:31.445184 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2d8beef3-53a8-4d06-af92-360640610ffe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.851874 Jul 12 11:51:31.446715 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 371/692] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:51:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:51:31.458158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-fc4cc859-afff-460a-b047-440e1c2a9b2c req-690399f8-9f5d-4806-bcb6-4722f6dbc03c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c809d104-cbc0-4f60-bd08-d9b669685f5e", "tag": "2218e552-6bd9-4914-b419-9c29009d158d"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:31.477597 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-fc4cc859-afff-460a-b047-440e1c2a9b2c req-690399f8-9f5d-4806-bcb6-4722f6dbc03c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:31.478375 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-fc4cc859-afff-460a-b047-440e1c2a9b2c req-690399f8-9f5d-4806-bcb6-4722f6dbc03c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:31.493932 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-fc4cc859-afff-460a-b047-440e1c2a9b2c req-690399f8-9f5d-4806-bcb6-4722f6dbc03c service nova] Creating event network-changed:2218e552-6bd9-4914-b419-9c29009d158d for instance c809d104-cbc0-4f60-bd08-d9b669685f5e on n-h2-849104-4 Jul 12 11:51:31.512634 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-fc4cc859-afff-460a-b047-440e1c2a9b2c req-690399f8-9f5d-4806-bcb6-4722f6dbc03c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059897 Jul 12 11:51:31.532514 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 372/693] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:31.546294 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2428904e-4d55-4132-8fc6-42cbd43626a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:31.547007 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2428904e-4d55-4132-8fc6-42cbd43626a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 19c7d0ce-ac82-402c-b58a-e62d1f5eb767] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:31.556355 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2428904e-4d55-4132-8fc6-42cbd43626a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:31.556913 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2428904e-4d55-4132-8fc6-42cbd43626a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:31.557784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2428904e-4d55-4132-8fc6-42cbd43626a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:31.558231 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2428904e-4d55-4132-8fc6-42cbd43626a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:31.996976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2428904e-4d55-4132-8fc6-42cbd43626a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:32.012243 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2428904e-4d55-4132-8fc6-42cbd43626a8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767" status: 200 len: 1319 microversion: 2.1 time: 0.475634 Jul 12 11:51:32.014753 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 373/694] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:31 2022] GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:32.027154 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-77e2137d-06de-483c-a204-e59105e47a90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:32.027781 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-77e2137d-06de-483c-a204-e59105e47a90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:32.042933 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-77e2137d-06de-483c-a204-e59105e47a90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:32.044322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-77e2137d-06de-483c-a204-e59105e47a90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:32.047879 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-77e2137d-06de-483c-a204-e59105e47a90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:32.048366 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-77e2137d-06de-483c-a204-e59105e47a90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:32.248656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-85197a9d-144e-440e-9a4a-2ce8db0fd4f8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:32.275667 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-85197a9d-144e-440e-9a4a-2ce8db0fd4f8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 200 len: 1587 microversion: 2.1 time: 1.205262 Jul 12 11:51:32.278775 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 322/695] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:31 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 1587 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:32.289341 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-4c18d981-52ba-4d66-aac7-b90e9b6d1bc3 req-3058148d-c1eb-44a4-928e-a8de044f06ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c7d0ce-ac82-402c-b58a-e62d1f5eb767", "name": "network-vif-plugged", "status": "completed", "tag": "07eed80d-641f-4b46-953e-3bb05cb86283"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:32.310849 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4c18d981-52ba-4d66-aac7-b90e9b6d1bc3 req-3058148d-c1eb-44a4-928e-a8de044f06ea service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:32.313091 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4c18d981-52ba-4d66-aac7-b90e9b6d1bc3 req-3058148d-c1eb-44a4-928e-a8de044f06ea service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:32.348785 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-4c18d981-52ba-4d66-aac7-b90e9b6d1bc3 req-3058148d-c1eb-44a4-928e-a8de044f06ea service nova] Creating event network-vif-plugged:07eed80d-641f-4b46-953e-3bb05cb86283 for instance 19c7d0ce-ac82-402c-b58a-e62d1f5eb767 on n-h1-849104-4 Jul 12 11:51:32.370364 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-4c18d981-52ba-4d66-aac7-b90e9b6d1bc3 req-3058148d-c1eb-44a4-928e-a8de044f06ea service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089119 Jul 12 11:51:32.371854 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 323/696] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:32.389012 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3a1ea59b-7b4e-4f96-8ba5-6355cc24d576 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:32.394247 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3a1ea59b-7b4e-4f96-8ba5-6355cc24d576 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:32.415736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a1ea59b-7b4e-4f96-8ba5-6355cc24d576 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:32.416608 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a1ea59b-7b4e-4f96-8ba5-6355cc24d576 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:32.419104 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a1ea59b-7b4e-4f96-8ba5-6355cc24d576 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:32.423810 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a1ea59b-7b4e-4f96-8ba5-6355cc24d576 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:32.599257 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3a1ea59b-7b4e-4f96-8ba5-6355cc24d576 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:32.633843 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3a1ea59b-7b4e-4f96-8ba5-6355cc24d576 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1215 microversion: 2.1 time: 0.260032 Jul 12 11:51:32.641698 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 324/697] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:32 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:32.654765 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-77e2137d-06de-483c-a204-e59105e47a90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:32.666916 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-77e2137d-06de-483c-a204-e59105e47a90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1476 microversion: 2.1 time: 0.651071 Jul 12 11:51:32.667509 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 374/698] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:32 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1476 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:32.682417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2b93f5f2-77d6-4c41-ba52-9f1bac346fa1 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:32.686698 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2b93f5f2-77d6-4c41-ba52-9f1bac346fa1 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:32.693662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c2b503e6-5d22-4480-964b-a137f43bfd5c tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:32.694620 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c2b503e6-5d22-4480-964b-a137f43bfd5c tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:32.714610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2b93f5f2-77d6-4c41-ba52-9f1bac346fa1 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:32.715612 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2b93f5f2-77d6-4c41-ba52-9f1bac346fa1 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:32.716682 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2b93f5f2-77d6-4c41-ba52-9f1bac346fa1 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:32.720612 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2b93f5f2-77d6-4c41-ba52-9f1bac346fa1 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:32.736882 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c2b503e6-5d22-4480-964b-a137f43bfd5c tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:32.745614 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c2b503e6-5d22-4480-964b-a137f43bfd5c tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:32.746910 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c2b503e6-5d22-4480-964b-a137f43bfd5c tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:32.747373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c2b503e6-5d22-4480-964b-a137f43bfd5c tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:33.172595 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2b93f5f2-77d6-4c41-ba52-9f1bac346fa1 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:33.189885 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2b93f5f2-77d6-4c41-ba52-9f1bac346fa1 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1463 microversion: 2.1 time: 0.537668 Jul 12 11:51:33.190960 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 325/699] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:32 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1463 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:33.252395 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c2b503e6-5d22-4480-964b-a137f43bfd5c tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:33.264425 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c2b503e6-5d22-4480-964b-a137f43bfd5c tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1466 microversion: 2.1 time: 0.593759 Jul 12 11:51:33.265450 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 375/700] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:32 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1466 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:33.272818 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-038bb0be-07dd-44c7-93bf-342b914fc00f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:33.294390 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-038bb0be-07dd-44c7-93bf-342b914fc00f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 19c7d0ce-ac82-402c-b58a-e62d1f5eb767] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:33.340817 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-038bb0be-07dd-44c7-93bf-342b914fc00f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:33.341994 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-038bb0be-07dd-44c7-93bf-342b914fc00f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:33.345476 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-038bb0be-07dd-44c7-93bf-342b914fc00f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:33.346525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-038bb0be-07dd-44c7-93bf-342b914fc00f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:33.533069 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-45492187-f544-421b-931e-939b7382cd35 tempest-AbsoluteLimitsTestJSON-951449441 tempest-AbsoluteLimitsTestJSON-951449441-project] Calling method '.version_select at 0x7f5e0b0b2430>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:33.564673 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-45492187-f544-421b-931e-939b7382cd35 tempest-AbsoluteLimitsTestJSON-951449441 tempest-AbsoluteLimitsTestJSON-951449441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:33.565101 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-45492187-f544-421b-931e-939b7382cd35 tempest-AbsoluteLimitsTestJSON-951449441 tempest-AbsoluteLimitsTestJSON-951449441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:33.572320 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-45492187-f544-421b-931e-939b7382cd35 tempest-AbsoluteLimitsTestJSON-951449441 tempest-AbsoluteLimitsTestJSON-951449441-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:33.572918 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-45492187-f544-421b-931e-939b7382cd35 tempest-AbsoluteLimitsTestJSON-951449441 tempest-AbsoluteLimitsTestJSON-951449441-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:33.690857 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-45492187-f544-421b-931e-939b7382cd35 tempest-AbsoluteLimitsTestJSON-951449441 tempest-AbsoluteLimitsTestJSON-951449441-project] 10.222.0.50 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.484645 Jul 12 11:51:33.695609 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 326/701] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 11:51:33 2022] GET /compute/v2.1/limits => generated 511 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:34.102581 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-53f4378f-29d0-4e9b-88fd-e96795fcb4f5 tempest-TenantUsagesTestJSON-1636399145 tempest-TenantUsagesTestJSON-1636399145-project-admin] Calling method '.version_select at 0x7f5e0b1d38b0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:34.137149 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-53f4378f-29d0-4e9b-88fd-e96795fcb4f5 tempest-TenantUsagesTestJSON-1636399145 tempest-TenantUsagesTestJSON-1636399145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:34.140716 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-53f4378f-29d0-4e9b-88fd-e96795fcb4f5 tempest-TenantUsagesTestJSON-1636399145 tempest-TenantUsagesTestJSON-1636399145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:34.205842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-53f4378f-29d0-4e9b-88fd-e96795fcb4f5 tempest-TenantUsagesTestJSON-1636399145 tempest-TenantUsagesTestJSON-1636399145-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:34.206513 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-53f4378f-29d0-4e9b-88fd-e96795fcb4f5 tempest-TenantUsagesTestJSON-1636399145 tempest-TenantUsagesTestJSON-1636399145-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:34.234792 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-53f4378f-29d0-4e9b-88fd-e96795fcb4f5 tempest-TenantUsagesTestJSON-1636399145 tempest-TenantUsagesTestJSON-1636399145-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/05d6bb5e5dc44aaa9571c7f9c8de0c4b?start=2022-07-11T11%3A51%3A33.200405&end=2022-07-13T11%3A51%3A33.200405" status: 200 len: 694 microversion: 2.1 time: 0.537494 Jul 12 11:51:34.235627 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 327/702] 10.222.0.50 () {58 vars in 1411 bytes} [Tue Jul 12 11:51:33 2022] GET /compute/v2.1/os-simple-tenant-usage/05d6bb5e5dc44aaa9571c7f9c8de0c4b?start=2022-07-11T11%3A51%3A33.200405&end=2022-07-13T11%3A51%3A33.200405 => generated 694 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:34.242532 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d5f29b8f-7bdb-4cab-8556-501ebd826cbe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:34.243742 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d5f29b8f-7bdb-4cab-8556-501ebd826cbe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:34.248303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:34.256123 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d5f29b8f-7bdb-4cab-8556-501ebd826cbe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:34.257570 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d5f29b8f-7bdb-4cab-8556-501ebd826cbe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:34.259230 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d5f29b8f-7bdb-4cab-8556-501ebd826cbe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:34.260337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d5f29b8f-7bdb-4cab-8556-501ebd826cbe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:34.355458 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-038bb0be-07dd-44c7-93bf-342b914fc00f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:34.380574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d5f29b8f-7bdb-4cab-8556-501ebd826cbe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:34.383787 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-038bb0be-07dd-44c7-93bf-342b914fc00f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767" status: 200 len: 1319 microversion: 2.1 time: 1.114805 Jul 12 11:51:34.385737 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 376/703] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:33 2022] GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767 => generated 1319 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:34.390336 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d5f29b8f-7bdb-4cab-8556-501ebd826cbe tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1269 microversion: 2.1 time: 0.152769 Jul 12 11:51:34.393237 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 328/704] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:34 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:34.398418 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-42a85243-4e19-45de-908e-819b0b44d80f req-febe8d1f-8b32-4199-9a90-073ad9fee9eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a873a920-f2b5-4503-97e5-0ddaae09abc6", "name": "network-vif-deleted", "tag": "49099d37-8d54-47cd-a861-028d9ec73033"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:34.407799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-42a85243-4e19-45de-908e-819b0b44d80f req-febe8d1f-8b32-4199-9a90-073ad9fee9eb service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:34.408383 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-42a85243-4e19-45de-908e-819b0b44d80f req-febe8d1f-8b32-4199-9a90-073ad9fee9eb service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:34.412997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:34.415164 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f45fd090-92c7-4091-8b4b-e84cf76337e4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:34.419559 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f45fd090-92c7-4091-8b4b-e84cf76337e4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:34.432542 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-42a85243-4e19-45de-908e-819b0b44d80f req-febe8d1f-8b32-4199-9a90-073ad9fee9eb service nova] Creating event network-vif-deleted:49099d37-8d54-47cd-a861-028d9ec73033 for instance a873a920-f2b5-4503-97e5-0ddaae09abc6 on n-h1-849104-4 Jul 12 11:51:34.439179 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-42a85243-4e19-45de-908e-819b0b44d80f req-febe8d1f-8b32-4199-9a90-073ad9fee9eb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044273 Jul 12 11:51:34.440555 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 329/705] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:34.447688 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c0c0bac6-0fc1-44ea-b4b4-de3be0d4877d tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '.version_select at 0x7f5e0b15d280>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:34.455366 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45fd090-92c7-4091-8b4b-e84cf76337e4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:34.457065 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45fd090-92c7-4091-8b4b-e84cf76337e4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:34.458629 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45fd090-92c7-4091-8b4b-e84cf76337e4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:34.459483 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c0c0bac6-0fc1-44ea-b4b4-de3be0d4877d tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:34.459957 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45fd090-92c7-4091-8b4b-e84cf76337e4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:34.460389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c0c0bac6-0fc1-44ea-b4b4-de3be0d4877d tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:34.484152 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c0c0bac6-0fc1-44ea-b4b4-de3be0d4877d tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:34.484699 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c0c0bac6-0fc1-44ea-b4b4-de3be0d4877d tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:34.508668 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c0c0bac6-0fc1-44ea-b4b4-de3be0d4877d tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/05d6bb5e5dc44aaa9571c7f9c8de0c4b?start=2022-07-11T11%3A51%3A33.200405&end=2022-07-13T11%3A51%3A33.200405" status: 200 len: 695 microversion: 2.1 time: 0.066527 Jul 12 11:51:34.510013 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 330/706] 10.222.0.50 () {58 vars in 1411 bytes} [Tue Jul 12 11:51:34 2022] GET /compute/v2.1/os-simple-tenant-usage/05d6bb5e5dc44aaa9571c7f9c8de0c4b?start=2022-07-11T11%3A51%3A33.200405&end=2022-07-13T11%3A51%3A33.200405 => generated 695 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:34.516857 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-02accc4b-06ab-495c-8fa4-f0d633b5adb3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:34.518190 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-02accc4b-06ab-495c-8fa4-f0d633b5adb3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:34.526583 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02accc4b-06ab-495c-8fa4-f0d633b5adb3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:34.527177 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02accc4b-06ab-495c-8fa4-f0d633b5adb3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:34.528285 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02accc4b-06ab-495c-8fa4-f0d633b5adb3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:34.528941 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02accc4b-06ab-495c-8fa4-f0d633b5adb3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:34.615586 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02accc4b-06ab-495c-8fa4-f0d633b5adb3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:34.618924 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02accc4b-06ab-495c-8fa4-f0d633b5adb3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:34.619930 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-02accc4b-06ab-495c-8fa4-f0d633b5adb3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lazy-loading 'fault' on Instance uuid a873a920-f2b5-4503-97e5-0ddaae09abc6 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:51:34.723424 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-02accc4b-06ab-495c-8fa4-f0d633b5adb3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:34.741826 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-02accc4b-06ab-495c-8fa4-f0d633b5adb3 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 200 len: 1309 microversion: 2.1 time: 0.230000 Jul 12 11:51:34.752554 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 331/707] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:34 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 1309 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:34.759737 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0c4d6569-686a-4174-8fc5-f0eb826abf97 tempest-TenantUsagesTestJSON-1636399145 tempest-TenantUsagesTestJSON-1636399145-project-admin] Calling method '.version_select at 0x7f5e0b0b2820>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:34.809971 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c4d6569-686a-4174-8fc5-f0eb826abf97 tempest-TenantUsagesTestJSON-1636399145 tempest-TenantUsagesTestJSON-1636399145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:34.811129 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c4d6569-686a-4174-8fc5-f0eb826abf97 tempest-TenantUsagesTestJSON-1636399145 tempest-TenantUsagesTestJSON-1636399145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:34.860738 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c4d6569-686a-4174-8fc5-f0eb826abf97 tempest-TenantUsagesTestJSON-1636399145 tempest-TenantUsagesTestJSON-1636399145-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:34.861558 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c4d6569-686a-4174-8fc5-f0eb826abf97 tempest-TenantUsagesTestJSON-1636399145 tempest-TenantUsagesTestJSON-1636399145-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:34.923865 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f45fd090-92c7-4091-8b4b-e84cf76337e4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:34.945011 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f45fd090-92c7-4091-8b4b-e84cf76337e4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1476 microversion: 2.1 time: 0.556516 Jul 12 11:51:34.948372 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 377/708] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:34 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1476 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:34.956507 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1416353076", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "86a45c3d-d234-45c3-8ca4-afa66535a366"}], "security_groups": [{"name": "tempest-securitygroup--1680143082"}], "key_name": "tempest-keypair-1342155430", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:34.978516 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0c4d6569-686a-4174-8fc5-f0eb826abf97 tempest-TenantUsagesTestJSON-1636399145 tempest-TenantUsagesTestJSON-1636399145-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-11T11%3A51%3A33.200405&end=2022-07-13T11%3A51%3A33.200405&detailed=1" status: 200 len: 8393 microversion: 2.1 time: 0.230464 Jul 12 11:51:34.979538 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 332/709] 10.222.0.50 () {58 vars in 1334 bytes} [Tue Jul 12 11:51:34 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-11T11%3A51%3A33.200405&end=2022-07-13T11%3A51%3A33.200405&detailed=1 => generated 8393 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:35.016335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-56d04c9b-08cc-4e5b-acdb-9f4321ad32b3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:35.017263 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-56d04c9b-08cc-4e5b-acdb-9f4321ad32b3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:35.025653 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56d04c9b-08cc-4e5b-acdb-9f4321ad32b3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:35.026274 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56d04c9b-08cc-4e5b-acdb-9f4321ad32b3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:35.027249 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56d04c9b-08cc-4e5b-acdb-9f4321ad32b3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:35.027809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56d04c9b-08cc-4e5b-acdb-9f4321ad32b3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:35.057062 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-56d04c9b-08cc-4e5b-acdb-9f4321ad32b3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:51:35.148461 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-56d04c9b-08cc-4e5b-acdb-9f4321ad32b3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 204 len: 0 microversion: 2.1 time: 0.139054 Jul 12 11:51:35.150112 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 333/710] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:51:35 2022] DELETE /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:51:35.161909 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e9a31203-bb85-4b19-b90a-c317aef91d14 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:35.162722 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e9a31203-bb85-4b19-b90a-c317aef91d14 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:35.175701 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9a31203-bb85-4b19-b90a-c317aef91d14 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:35.176459 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9a31203-bb85-4b19-b90a-c317aef91d14 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:35.177540 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9a31203-bb85-4b19-b90a-c317aef91d14 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:35.177914 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9a31203-bb85-4b19-b90a-c317aef91d14 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:35.215849 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] validate_networks() for [('86a45c3d-d234-45c3-8ca4-afa66535a366', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:51:35.341823 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e9a31203-bb85-4b19-b90a-c317aef91d14 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:35.354914 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e9a31203-bb85-4b19-b90a-c317aef91d14 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1469 microversion: 2.1 time: 0.198284 Jul 12 11:51:35.355586 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 334/711] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:35 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1469 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:35.413087 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-067abcb3-653f-4ab8-9260-a09334ab860a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:35.413861 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-067abcb3-653f-4ab8-9260-a09334ab860a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:35.425402 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-067abcb3-653f-4ab8-9260-a09334ab860a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:35.426339 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-067abcb3-653f-4ab8-9260-a09334ab860a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:35.427663 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-067abcb3-653f-4ab8-9260-a09334ab860a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:35.428663 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-067abcb3-653f-4ab8-9260-a09334ab860a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:35.547341 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-067abcb3-653f-4ab8-9260-a09334ab860a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:35.562869 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-067abcb3-653f-4ab8-9260-a09334ab860a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1269 microversion: 2.1 time: 0.153969 Jul 12 11:51:35.563874 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 335/712] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:35 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:51:35.577320 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ce9c7925-33bd-4405-a5f6-28cdf71f8a6f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:35.578611 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ce9c7925-33bd-4405-a5f6-28cdf71f8a6f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 19c7d0ce-ac82-402c-b58a-e62d1f5eb767] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:35.590565 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce9c7925-33bd-4405-a5f6-28cdf71f8a6f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:35.595041 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce9c7925-33bd-4405-a5f6-28cdf71f8a6f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:35.596631 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce9c7925-33bd-4405-a5f6-28cdf71f8a6f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:35.597454 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce9c7925-33bd-4405-a5f6-28cdf71f8a6f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:35.767286 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ce9c7925-33bd-4405-a5f6-28cdf71f8a6f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:35.778081 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ce9c7925-33bd-4405-a5f6-28cdf71f8a6f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767" status: 200 len: 1468 microversion: 2.1 time: 0.212052 Jul 12 11:51:35.779364 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 336/713] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:35 2022] GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767 => generated 1468 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:35.789300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fc1dad5a-9f8b-48f7-980c-602b9868d707 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:35.790235 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fc1dad5a-9f8b-48f7-980c-602b9868d707 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: a873a920-f2b5-4503-97e5-0ddaae09abc6] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:35.805303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fc1dad5a-9f8b-48f7-980c-602b9868d707 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:35.805615 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fc1dad5a-9f8b-48f7-980c-602b9868d707 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:35.806452 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fc1dad5a-9f8b-48f7-980c-602b9868d707 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:35.806952 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fc1dad5a-9f8b-48f7-980c-602b9868d707 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:35.837817 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-fc1dad5a-9f8b-48f7-980c-602b9868d707 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] HTTP exception thrown: Instance a873a920-f2b5-4503-97e5-0ddaae09abc6 could not be found. Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fc1dad5a-9f8b-48f7-980c-602b9868d707 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Request method failure captured: Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 HTTP/1.1 Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_5NvUlRvk-trcxE-X0Q1QaDm4OXYppq9prNBjNkiv3GXKYF3xjozkeNFO1ANKj4ca2zm7RXd24evbhgnvBEqXnt2noXFDzMbvnukCrHE4EUJHobXXLwfLKzhQ1pKD6qpaGSkqoDzDPDDrf8zEP7a24G3S4cv0RO9WTaz-XV5MEbkA Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 8fff158fbe4b47d6a0c50888c251e8e7 Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-LiveMigrationNegativeTest-1372712352 Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fff158fbe4b47d6a0c50888c251e8e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fff158fbe4b47d6a0c50888c251e8e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8fff158fbe4b47d6a0c50888c251e8e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8fff158fbe4b47d6a0c50888c251e8e7", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-LiveMigrationNegativeTest-1372712352 Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 8fff158fbe4b47d6a0c50888c251e8e7 Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1372712352 Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-LiveMigrationNegativeTest-1372712352-project Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 7f4c711ca1f44a2ca6c08ee99931cdcc Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-LiveMigrationNegativeTest-1372712352-project Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance a873a920-f2b5-4503-97e5-0ddaae09abc6 could not be found. Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'a873a920-f2b5-4503-97e5-0ddaae09abc6'} Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a873a920-f2b5-4503-97e5-0ddaae09abc6 could not be found. Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a873a920-f2b5-4503-97e5-0ddaae09abc6 could not be found. Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:35.843754 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:35.848248 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:35.848248 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:35.848248 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:35.848248 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:51:35.848248 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:51:35.848248 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a873a920-f2b5-4503-97e5-0ddaae09abc6 could not be found. Jul 12 11:51:35.848248 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:51:35.848248 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fc1dad5a-9f8b-48f7-980c-602b9868d707 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Returning 404 to user: Instance a873a920-f2b5-4503-97e5-0ddaae09abc6 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:51:35.849778 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fc1dad5a-9f8b-48f7-980c-602b9868d707 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6" status: 404 len: 111 microversion: 2.1 time: 0.066958 Jul 12 11:51:35.851863 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 337/714] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:35 2022] GET /compute/v2.1/servers/a873a920-f2b5-4503-97e5-0ddaae09abc6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:51:35.862264 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8942cc34-8241-4b6a-97af-281fd814bd8a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:35.868973 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8942cc34-8241-4b6a-97af-281fd814bd8a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:35.870345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8942cc34-8241-4b6a-97af-281fd814bd8a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Searching by: {'reservation_id': 'r-60y0pi3j', 'deleted': False, 'project_id': '810246cfc801446599831d243d3a48dd'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 11:51:35.882206 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8942cc34-8241-4b6a-97af-281fd814bd8a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:35.883092 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8942cc34-8241-4b6a-97af-281fd814bd8a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:35.884656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8942cc34-8241-4b6a-97af-281fd814bd8a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:35.885689 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8942cc34-8241-4b6a-97af-281fd814bd8a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.046257 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:51:36.047900 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:51:36.049349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:51:36.050344 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:51:36.051403 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:51:36.068639 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:36.069726 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.071948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:36.072809 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.086403 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.multi_cell_list [None req-8942cc34-8241-4b6a-97af-281fd814bd8a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 11:51:36.111146 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Getting quotas for project bd080a7dad6c4a6ebf684e44bf7a6e76. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:36.119145 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Getting quotas for user 5a7ca463d55047caa749c514a3e1499d and project bd080a7dad6c4a6ebf684e44bf7a6e76. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:36.134079 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:51:36.136471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:51:36.149649 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=5 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:36.196941 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5898540d-6b60-4fda-9adc-4888bb41f682 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.247156 Jul 12 11:51:36.198214 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 378/715] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:51:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:51:36.204863 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e73f867d-e18c-4a82-954a-182cbdb619e6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:36.205591 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e73f867d-e18c-4a82-954a-182cbdb619e6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:36.213291 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e73f867d-e18c-4a82-954a-182cbdb619e6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:36.213992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e73f867d-e18c-4a82-954a-182cbdb619e6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.214973 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e73f867d-e18c-4a82-954a-182cbdb619e6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:36.215580 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e73f867d-e18c-4a82-954a-182cbdb619e6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.251132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e73f867d-e18c-4a82-954a-182cbdb619e6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:51:36.255288 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:36.286217 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8942cc34-8241-4b6a-97af-281fd814bd8a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:36.301288 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8942cc34-8241-4b6a-97af-281fd814bd8a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:36.302047 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8942cc34-8241-4b6a-97af-281fd814bd8a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.377839 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e73f867d-e18c-4a82-954a-182cbdb619e6 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "DELETE /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 204 len: 0 microversion: 2.1 time: 0.177743 Jul 12 11:51:36.378727 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 379/716] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:51:36 2022] DELETE /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:51:36.385773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3d53be74-17d6-403d-8c57-8989cec2f798 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:36.386746 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3d53be74-17d6-403d-8c57-8989cec2f798 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:36.394366 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d53be74-17d6-403d-8c57-8989cec2f798 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:36.394830 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d53be74-17d6-403d-8c57-8989cec2f798 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.395632 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d53be74-17d6-403d-8c57-8989cec2f798 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:36.396107 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d53be74-17d6-403d-8c57-8989cec2f798 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.481421 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8942cc34-8241-4b6a-97af-281fd814bd8a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?reservation_id=r-60y0pi3j" status: 200 len: 2929 microversion: 2.1 time: 0.627476 Jul 12 11:51:36.481817 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 338/717] 10.222.0.50 () {58 vars in 1196 bytes} [Tue Jul 12 11:51:35 2022] GET /compute/v2.1/servers/detail?reservation_id=r-60y0pi3j => generated 2929 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:36.488782 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bce24e5d-a1df-408d-84c7-4f02a5898f37 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:36.489417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-bce24e5d-a1df-408d-84c7-4f02a5898f37 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:36.572336 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bce24e5d-a1df-408d-84c7-4f02a5898f37 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:36.606716 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bce24e5d-a1df-408d-84c7-4f02a5898f37 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1242 microversion: 2.1 time: 0.122838 Jul 12 11:51:36.609212 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 339/718] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:36 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1242 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:36.626632 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3d53be74-17d6-403d-8c57-8989cec2f798 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:36.630013 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4ea0b044-55b3-45a7-996f-c8aa29f6fb5c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:36.631484 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4ea0b044-55b3-45a7-996f-c8aa29f6fb5c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:36.637788 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3d53be74-17d6-403d-8c57-8989cec2f798 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1476 microversion: 2.1 time: 0.257247 Jul 12 11:51:36.638735 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 380/719] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:36 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1476 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:36.644523 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6a072fdc-6886-4da5-a182-b91e2aa869ed tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:36.645427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6a072fdc-6886-4da5-a182-b91e2aa869ed tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:36.646993 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4ea0b044-55b3-45a7-996f-c8aa29f6fb5c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:36.648084 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4ea0b044-55b3-45a7-996f-c8aa29f6fb5c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.648977 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4ea0b044-55b3-45a7-996f-c8aa29f6fb5c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:36.649756 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4ea0b044-55b3-45a7-996f-c8aa29f6fb5c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.652322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a072fdc-6886-4da5-a182-b91e2aa869ed tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:36.652853 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a072fdc-6886-4da5-a182-b91e2aa869ed tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.653703 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a072fdc-6886-4da5-a182-b91e2aa869ed tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:36.654213 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a072fdc-6886-4da5-a182-b91e2aa869ed tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.866057 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4ea0b044-55b3-45a7-996f-c8aa29f6fb5c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:36.882788 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4ea0b044-55b3-45a7-996f-c8aa29f6fb5c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1469 microversion: 2.1 time: 0.266009 Jul 12 11:51:36.883545 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 340/720] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:36 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1469 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:36.900417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a5b005ec-09e2-41bd-8064-e3d42bd80c2e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:36.922222 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.compute.server_groups [None req-a5b005ec-09e2-41bd-8064-e3d42bd80c2e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Querying cell dd950407-7fc7-406c-84b0-4304624ff8c8(cell1) for 2 instances {{(pid=125983) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 12 11:51:36.923446 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5b005ec-09e2-41bd-8064-e3d42bd80c2e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:36.923677 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5b005ec-09e2-41bd-8064-e3d42bd80c2e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.962583 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a5b005ec-09e2-41bd-8064-e3d42bd80c2e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/3643958b-855b-4467-9146-3988921502d5" status: 200 len: 266 microversion: 2.1 time: 0.077618 Jul 12 11:51:36.963540 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 341/721] 10.222.0.50 () {58 vars in 1262 bytes} [Tue Jul 12 11:51:36 2022] GET /compute/v2.1/os-server-groups/3643958b-855b-4467-9146-3988921502d5 => generated 266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:36.968506 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-348216ff-bf1b-47a6-a628-fbb88ecb7655 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:36.969279 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-348216ff-bf1b-47a6-a628-fbb88ecb7655 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:36.972684 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6a072fdc-6886-4da5-a182-b91e2aa869ed tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:36.976410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-348216ff-bf1b-47a6-a628-fbb88ecb7655 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:36.977486 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-348216ff-bf1b-47a6-a628-fbb88ecb7655 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.978581 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-348216ff-bf1b-47a6-a628-fbb88ecb7655 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:36.979156 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-348216ff-bf1b-47a6-a628-fbb88ecb7655 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:36.990123 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6a072fdc-6886-4da5-a182-b91e2aa869ed tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1474 microversion: 2.1 time: 0.349178 Jul 12 11:51:36.991384 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 381/722] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:36 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1474 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:37.154314 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-348216ff-bf1b-47a6-a628-fbb88ecb7655 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:37.165596 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-348216ff-bf1b-47a6-a628-fbb88ecb7655 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1311 microversion: 2.1 time: 0.200805 Jul 12 11:51:37.166250 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 342/723] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:36 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1311 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:37.173629 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c16b4892-c13e-4f97-ac05-763c7d7fedd4 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:37.175213 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c16b4892-c13e-4f97-ac05-763c7d7fedd4 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] [instance: 19c7d0ce-ac82-402c-b58a-e62d1f5eb767] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:37.178896 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c58c099c-9e59-45a0-a1bf-3377139316e9 tempest-AbsoluteLimitsNegativeTestJSON-302757986 tempest-AbsoluteLimitsNegativeTestJSON-302757986-project] Calling method '.version_select at 0x7f5e0accf3a0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:37.191336 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c16b4892-c13e-4f97-ac05-763c7d7fedd4 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:37.192714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c16b4892-c13e-4f97-ac05-763c7d7fedd4 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:37.193997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c16b4892-c13e-4f97-ac05-763c7d7fedd4 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:37.194623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c16b4892-c13e-4f97-ac05-763c7d7fedd4 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:37.195541 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c58c099c-9e59-45a0-a1bf-3377139316e9 tempest-AbsoluteLimitsNegativeTestJSON-302757986 tempest-AbsoluteLimitsNegativeTestJSON-302757986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:37.196000 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c58c099c-9e59-45a0-a1bf-3377139316e9 tempest-AbsoluteLimitsNegativeTestJSON-302757986 tempest-AbsoluteLimitsNegativeTestJSON-302757986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:37.196837 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c58c099c-9e59-45a0-a1bf-3377139316e9 tempest-AbsoluteLimitsNegativeTestJSON-302757986 tempest-AbsoluteLimitsNegativeTestJSON-302757986-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:37.197282 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c58c099c-9e59-45a0-a1bf-3377139316e9 tempest-AbsoluteLimitsNegativeTestJSON-302757986 tempest-AbsoluteLimitsNegativeTestJSON-302757986-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:37.227109 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c58c099c-9e59-45a0-a1bf-3377139316e9 tempest-AbsoluteLimitsNegativeTestJSON-302757986 tempest-AbsoluteLimitsNegativeTestJSON-302757986-project] 10.222.0.50 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.233980 Jul 12 11:51:37.228065 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 382/724] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 11:51:36 2022] GET /compute/v2.1/limits => generated 511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:37.293158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f5260022-35de-4b7d-902f-76a1fd0734db tempest-AbsoluteLimitsNegativeTestJSON-302757986 tempest-AbsoluteLimitsNegativeTestJSON-302757986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-592910300", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:37.369641 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c16b4892-c13e-4f97-ac05-763c7d7fedd4 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767" status: 200 len: 1619 microversion: 2.1 time: 0.201104 Jul 12 11:51:37.374942 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 343/725] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:37 2022] GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767 => generated 1619 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:37.383110 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-f5260022-35de-4b7d-902f-76a1fd0734db tempest-AbsoluteLimitsNegativeTestJSON-302757986 tempest-AbsoluteLimitsNegativeTestJSON-302757986-project] validate_networks() for None {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:51:37.392170 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-14b34a28-3f3c-4d2d-9785-8b42f3b32e9b tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:37.392966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-14b34a28-3f3c-4d2d-9785-8b42f3b32e9b tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:37.400294 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-14b34a28-3f3c-4d2d-9785-8b42f3b32e9b tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:37.400753 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-14b34a28-3f3c-4d2d-9785-8b42f3b32e9b tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:37.401537 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-14b34a28-3f3c-4d2d-9785-8b42f3b32e9b tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:37.402165 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-14b34a28-3f3c-4d2d-9785-8b42f3b32e9b tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:37.563389 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-14b34a28-3f3c-4d2d-9785-8b42f3b32e9b tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e" status: 200 len: 1619 microversion: 2.1 time: 0.177443 Jul 12 11:51:37.572665 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 344/726] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:37 2022] GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e => generated 1619 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:51:37.588508 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a9525d68-dadc-4b26-996b-dbe856a76d57 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Action: 'create', calling method: .version_select at 0x7f5e0b039dc0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-349366891", "policies": ["anti-affinity"]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:37.612347 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a9525d68-dadc-4b26-996b-dbe856a76d57 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'server_groups'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:37.619931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a9525d68-dadc-4b26-996b-dbe856a76d57 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'server_groups'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:37.708304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a9525d68-dadc-4b26-996b-dbe856a76d57 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'server_groups'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:37.717419 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a9525d68-dadc-4b26-996b-dbe856a76d57 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'server_groups'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:37.737931 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a9525d68-dadc-4b26-996b-dbe856a76d57 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.153254 Jul 12 11:51:37.739265 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 345/727] 10.222.0.50 () {60 vars in 1173 bytes} [Tue Jul 12 11:51:37 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:37.751401 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0a84e09f-a816-455c-8092-c618a1aa164e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:37.752655 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0a84e09f-a816-455c-8092-c618a1aa164e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:37.765435 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0a84e09f-a816-455c-8092-c618a1aa164e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:37.766343 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0a84e09f-a816-455c-8092-c618a1aa164e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:37.767252 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0a84e09f-a816-455c-8092-c618a1aa164e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:37.767749 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0a84e09f-a816-455c-8092-c618a1aa164e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:37.862359 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0a84e09f-a816-455c-8092-c618a1aa164e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:37.872697 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0a84e09f-a816-455c-8092-c618a1aa164e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1246 microversion: 2.1 time: 0.130776 Jul 12 11:51:37.873479 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 346/728] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:37 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1246 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:37.879729 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a4a24895-3af5-49a1-a3db-47cf7d63fcf1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:37.880837 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a4a24895-3af5-49a1-a3db-47cf7d63fcf1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:37.888449 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4a24895-3af5-49a1-a3db-47cf7d63fcf1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:37.888988 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4a24895-3af5-49a1-a3db-47cf7d63fcf1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:37.891195 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4a24895-3af5-49a1-a3db-47cf7d63fcf1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:37.892527 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4a24895-3af5-49a1-a3db-47cf7d63fcf1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:38.043407 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-f5260022-35de-4b7d-902f-76a1fd0734db tempest-AbsoluteLimitsNegativeTestJSON-302757986 tempest-AbsoluteLimitsNegativeTestJSON-302757986-project] Getting quotas for project bc71ad287dc24d679df10b7e6239446e. Resources: dict_keys(['metadata_items']) {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:38.050928 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-f5260022-35de-4b7d-902f-76a1fd0734db tempest-AbsoluteLimitsNegativeTestJSON-302757986 tempest-AbsoluteLimitsNegativeTestJSON-302757986-project] Getting quotas for user 10e1b68f6d794d05877d411a8f91bc43 and project bc71ad287dc24d679df10b7e6239446e. Resources: dict_keys(['metadata_items']) {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:38.068576 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-f5260022-35de-4b7d-902f-76a1fd0734db tempest-AbsoluteLimitsNegativeTestJSON-302757986 tempest-AbsoluteLimitsNegativeTestJSON-302757986-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f5260022-35de-4b7d-902f-76a1fd0734db tempest-AbsoluteLimitsNegativeTestJSON-302757986 tempest-AbsoluteLimitsNegativeTestJSON-302757986-project] Request method failure captured: Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 1751 Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWBI61pARD5nLqQSOnJ2lx0JUrExBJ_fVgKbUQAWEhbQhVJzztrfaESF1soQLDaKwJcBw18w68Htd9q0aQ_1f9qNw-RZ9_x2Fe76LnkR7vVreZ-uxsy4PXlTKNkrF4JlQLEBbJyk68IBj8IcyOLXq8B42X1MSjAiFdbIZqLdViuviv0 Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: bc71ad287dc24d679df10b7e6239446e Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-302757986 Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bc71ad287dc24d679df10b7e6239446e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bc71ad287dc24d679df10b7e6239446e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bc71ad287dc24d679df10b7e6239446e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bc71ad287dc24d679df10b7e6239446e", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-302757986 Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: bc71ad287dc24d679df10b7e6239446e Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-302757986 Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-302757986-project Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 10e1b68f6d794d05877d411a8f91bc43 Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-302757986-project Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-592910300", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:51:38.071735 n-d-849104-4 devstack@n-api.service[125984]: exception: Maximum number of metadata items exceeds 128 Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-592910300', 'imageRef': '5ee904a7-466a-46fc-89be-d728bca3527e', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:38.074308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f5260022-35de-4b7d-902f-76a1fd0734db tempest-AbsoluteLimitsNegativeTestJSON-302757986 tempest-AbsoluteLimitsNegativeTestJSON-302757986-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f5260022-35de-4b7d-902f-76a1fd0734db tempest-AbsoluteLimitsNegativeTestJSON-302757986 tempest-AbsoluteLimitsNegativeTestJSON-302757986-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.786996 Jul 12 11:51:38.077704 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 383/729] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Jul 12 11:51:37 2022] POST /compute/v2.1/servers => generated 87 bytes in 788 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Jul 12 11:51:38.080130 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8660416c-bc70-49dc-83f7-8bf87f3c76e3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:38.080130 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8660416c-bc70-49dc-83f7-8bf87f3c76e3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:38.087999 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8660416c-bc70-49dc-83f7-8bf87f3c76e3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:38.088511 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8660416c-bc70-49dc-83f7-8bf87f3c76e3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:38.089525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8660416c-bc70-49dc-83f7-8bf87f3c76e3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:38.090508 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8660416c-bc70-49dc-83f7-8bf87f3c76e3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:38.091813 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a4a24895-3af5-49a1-a3db-47cf7d63fcf1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:38.100947 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a4a24895-3af5-49a1-a3db-47cf7d63fcf1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1476 microversion: 2.1 time: 0.225631 Jul 12 11:51:38.102177 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 347/730] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:37 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:38.112853 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-722895833", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d859ea45-6a4e-4de9-aef3-6a8c9812cb9a"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:38.182175 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] validate_networks() for None {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:51:38.527690 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8660416c-bc70-49dc-83f7-8bf87f3c76e3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:38.539064 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:51:38.539532 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:51:38.540283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:51:38.540893 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:51:38.541590 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:51:38.557480 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8660416c-bc70-49dc-83f7-8bf87f3c76e3 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1469 microversion: 2.1 time: 0.482549 Jul 12 11:51:38.570944 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 384/731] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:38 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1469 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:38.584903 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3d5c70f7-1f13-41f9-a20f-eaeae7e056a1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:38.586244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3d5c70f7-1f13-41f9-a20f-eaeae7e056a1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:38.593429 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d5c70f7-1f13-41f9-a20f-eaeae7e056a1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:38.594014 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:38.594477 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:38.594914 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d5c70f7-1f13-41f9-a20f-eaeae7e056a1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:38.596215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d5c70f7-1f13-41f9-a20f-eaeae7e056a1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:38.596940 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d5c70f7-1f13-41f9-a20f-eaeae7e056a1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:38.601266 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:38.603336 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:38.621270 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:38.647809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:38.660938 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:38.678695 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Going to run 2 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:51:38.681434 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7763fa51-4518-440e-a663-f8dac78f536c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:51:38.743372 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:38.749341 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:38.756424 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:38.804282 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:38.813278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:38.831389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=7763fa51-4518-440e-a663-f8dac78f536c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:51:38.909422 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:38.916252 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:38.945139 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3d5c70f7-1f13-41f9-a20f-eaeae7e056a1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:38.960704 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3d5c70f7-1f13-41f9-a20f-eaeae7e056a1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1474 microversion: 2.1 time: 0.386063 Jul 12 11:51:38.961291 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 385/732] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:38 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1474 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:38.967523 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9245b2c3-87f5-4f24-9828-3805f88ff33e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:38.968353 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9245b2c3-87f5-4f24-9828-3805f88ff33e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:38.975570 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9245b2c3-87f5-4f24-9828-3805f88ff33e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:38.976301 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9245b2c3-87f5-4f24-9828-3805f88ff33e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:38.978202 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9245b2c3-87f5-4f24-9828-3805f88ff33e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:38.978673 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9245b2c3-87f5-4f24-9828-3805f88ff33e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:39.008528 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:39.018522 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'server_group_members'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:39.059908 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8dbf90f2-c70c-4c48-94d4-e2298773cfea tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.956298 Jul 12 11:51:39.060968 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 348/733] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:51:38 2022] POST /compute/v2.1/servers => generated 32 bytes in 958 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 12 11:51:39.069523 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-7a78583c-48a7-4232-a1e8-990698dc33b2 req-fbcefc61-fdbe-4f14-af93-ab7e003b0bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1556ea71-32c0-43d8-9a28-e364d25cc8e1", "tag": "42102276-b5d3-4916-a3fb-5ba8439f5c7f"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:39.078801 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-7a78583c-48a7-4232-a1e8-990698dc33b2 req-fbcefc61-fdbe-4f14-af93-ab7e003b0bf2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:39.078801 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-7a78583c-48a7-4232-a1e8-990698dc33b2 req-fbcefc61-fdbe-4f14-af93-ab7e003b0bf2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:39.093627 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-7a78583c-48a7-4232-a1e8-990698dc33b2 req-fbcefc61-fdbe-4f14-af93-ab7e003b0bf2 service nova] Creating event network-changed:42102276-b5d3-4916-a3fb-5ba8439f5c7f for instance 1556ea71-32c0-43d8-9a28-e364d25cc8e1 on n-h2-849104-4 Jul 12 11:51:39.100295 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-7a78583c-48a7-4232-a1e8-990698dc33b2 req-fbcefc61-fdbe-4f14-af93-ab7e003b0bf2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036932 Jul 12 11:51:39.101061 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 349/734] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:39.106893 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-177e0c14-0e1e-4d66-9cb3-a3b71f258351 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:39.107699 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-177e0c14-0e1e-4d66-9cb3-a3b71f258351 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:39.120323 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-177e0c14-0e1e-4d66-9cb3-a3b71f258351 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:39.120778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-177e0c14-0e1e-4d66-9cb3-a3b71f258351 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:39.121591 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-177e0c14-0e1e-4d66-9cb3-a3b71f258351 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:39.122033 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-177e0c14-0e1e-4d66-9cb3-a3b71f258351 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:39.333081 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-177e0c14-0e1e-4d66-9cb3-a3b71f258351 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:39.344429 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-177e0c14-0e1e-4d66-9cb3-a3b71f258351 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1294 microversion: 2.1 time: 0.241990 Jul 12 11:51:39.347774 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 350/735] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:39 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1294 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:39.352706 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2698f877-0947-4dc4-af37-73ed825f88d1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:39.364158 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2698f877-0947-4dc4-af37-73ed825f88d1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:39.369210 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2698f877-0947-4dc4-af37-73ed825f88d1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Searching by: {'deleted': False, 'project_id': '810246cfc801446599831d243d3a48dd'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 11:51:39.389994 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9245b2c3-87f5-4f24-9828-3805f88ff33e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:39.399484 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2698f877-0947-4dc4-af37-73ed825f88d1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:39.402064 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2698f877-0947-4dc4-af37-73ed825f88d1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:39.403548 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2698f877-0947-4dc4-af37-73ed825f88d1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:39.404265 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2698f877-0947-4dc4-af37-73ed825f88d1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:39.406381 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9245b2c3-87f5-4f24-9828-3805f88ff33e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1311 microversion: 2.1 time: 0.442953 Jul 12 11:51:39.407274 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 386/736] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:38 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1311 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:39.414429 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-74a799ff-21b9-4e7d-ba6c-e9c9daa41d97 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:39.415329 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-74a799ff-21b9-4e7d-ba6c-e9c9daa41d97 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:39.427841 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74a799ff-21b9-4e7d-ba6c-e9c9daa41d97 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:39.428261 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74a799ff-21b9-4e7d-ba6c-e9c9daa41d97 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:39.429039 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74a799ff-21b9-4e7d-ba6c-e9c9daa41d97 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:39.429479 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74a799ff-21b9-4e7d-ba6c-e9c9daa41d97 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:39.559035 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.multi_cell_list [None req-2698f877-0947-4dc4-af37-73ed825f88d1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=125983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 11:51:39.631350 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2698f877-0947-4dc4-af37-73ed825f88d1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.282204 Jul 12 11:51:39.632197 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 351/737] 10.222.0.50 () {58 vars in 1124 bytes} [Tue Jul 12 11:51:39 2022] GET /compute/v2.1/servers => generated 1663 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:39.638068 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-eaee8cdf-7243-40c3-ab77-a35fade1b2d0 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:39.640908 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-eaee8cdf-7243-40c3-ab77-a35fade1b2d0 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:39.647928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eaee8cdf-7243-40c3-ab77-a35fade1b2d0 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:39.648643 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eaee8cdf-7243-40c3-ab77-a35fade1b2d0 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:39.649664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eaee8cdf-7243-40c3-ab77-a35fade1b2d0 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:39.650317 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eaee8cdf-7243-40c3-ab77-a35fade1b2d0 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:39.970057 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-74a799ff-21b9-4e7d-ba6c-e9c9daa41d97 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:39.983071 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-74a799ff-21b9-4e7d-ba6c-e9c9daa41d97 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1476 microversion: 2.1 time: 0.571639 Jul 12 11:51:39.983730 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 387/738] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:39 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1476 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:39.989393 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-35f6b0d9-5580-4f67-b5fe-6345e8a421d6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:39.996511 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-35f6b0d9-5580-4f67-b5fe-6345e8a421d6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:40.063132 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eaee8cdf-7243-40c3-ab77-a35fade1b2d0 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:40.081844 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-eaee8cdf-7243-40c3-ab77-a35fade1b2d0 tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1427 microversion: 2.1 time: 0.443341 Jul 12 11:51:40.083592 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 352/739] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:39 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1427 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:40.100783 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f5752145-be20-4e0d-8d8e-e215d13006e4 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:40.101489 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f5752145-be20-4e0d-8d8e-e215d13006e4 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:40.121720 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5752145-be20-4e0d-8d8e-e215d13006e4 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:40.122231 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5752145-be20-4e0d-8d8e-e215d13006e4 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:40.126661 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5752145-be20-4e0d-8d8e-e215d13006e4 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:40.127262 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5752145-be20-4e0d-8d8e-e215d13006e4 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:40.128805 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-35f6b0d9-5580-4f67-b5fe-6345e8a421d6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:40.148312 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-35f6b0d9-5580-4f67-b5fe-6345e8a421d6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1218 microversion: 2.1 time: 0.159961 Jul 12 11:51:40.150717 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 388/740] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:39 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1218 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:40.366212 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d909c56d-3e89-4c6e-ac55-f69be9905574 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:40.367075 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d909c56d-3e89-4c6e-ac55-f69be9905574 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:40.379447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d909c56d-3e89-4c6e-ac55-f69be9905574 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:40.379913 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d909c56d-3e89-4c6e-ac55-f69be9905574 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:40.387843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d909c56d-3e89-4c6e-ac55-f69be9905574 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:40.388335 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d909c56d-3e89-4c6e-ac55-f69be9905574 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:40.519931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d909c56d-3e89-4c6e-ac55-f69be9905574 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:40.552151 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d909c56d-3e89-4c6e-ac55-f69be9905574 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1300 microversion: 2.1 time: 0.186964 Jul 12 11:51:40.568800 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 389/741] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:40 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1300 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:51:40.589894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-76d30a0b-8a4b-4b0e-8f25-22c09784168c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:40.590479 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-76d30a0b-8a4b-4b0e-8f25-22c09784168c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:40.605821 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76d30a0b-8a4b-4b0e-8f25-22c09784168c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:40.606452 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76d30a0b-8a4b-4b0e-8f25-22c09784168c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:40.610066 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76d30a0b-8a4b-4b0e-8f25-22c09784168c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:40.610743 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76d30a0b-8a4b-4b0e-8f25-22c09784168c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:40.635263 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f5752145-be20-4e0d-8d8e-e215d13006e4 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:40.652488 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f5752145-be20-4e0d-8d8e-e215d13006e4 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1474 microversion: 2.1 time: 0.567169 Jul 12 11:51:40.654236 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 353/742] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:40 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1474 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:40.804372 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-76d30a0b-8a4b-4b0e-8f25-22c09784168c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:40.815682 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-76d30a0b-8a4b-4b0e-8f25-22c09784168c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1311 microversion: 2.1 time: 0.243310 Jul 12 11:51:40.817238 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 390/743] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:40 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1311 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:40.871981 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-c01a2910-d078-471a-bbfc-c88d250d28c1 req-92550c3d-6b3d-4c8d-943d-59809322f99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da438037-1861-4a92-8be3-267aa902bcfa", "name": "network-vif-deleted", "tag": "e0a67407-6851-4155-aed9-b269c71d7329"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:40.886822 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-c01a2910-d078-471a-bbfc-c88d250d28c1 req-92550c3d-6b3d-4c8d-943d-59809322f99b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:40.887268 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-c01a2910-d078-471a-bbfc-c88d250d28c1 req-92550c3d-6b3d-4c8d-943d-59809322f99b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:40.914053 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-c01a2910-d078-471a-bbfc-c88d250d28c1 req-92550c3d-6b3d-4c8d-943d-59809322f99b service nova] Creating event network-vif-deleted:e0a67407-6851-4155-aed9-b269c71d7329 for instance da438037-1861-4a92-8be3-267aa902bcfa on n-h2-849104-4 Jul 12 11:51:40.925372 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-c01a2910-d078-471a-bbfc-c88d250d28c1 req-92550c3d-6b3d-4c8d-943d-59809322f99b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057487 Jul 12 11:51:40.928485 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 354/744] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:41.003190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fdbee78a-1741-44e5-9bf1-23ac97bc6e24 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:41.005189 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fdbee78a-1741-44e5-9bf1-23ac97bc6e24 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:41.014871 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fdbee78a-1741-44e5-9bf1-23ac97bc6e24 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:41.015664 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fdbee78a-1741-44e5-9bf1-23ac97bc6e24 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:41.016678 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fdbee78a-1741-44e5-9bf1-23ac97bc6e24 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:41.017298 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fdbee78a-1741-44e5-9bf1-23ac97bc6e24 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:41.102804 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5a3a00be-7ead-41a7-b9ce-89e44421769c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:41.104647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5a3a00be-7ead-41a7-b9ce-89e44421769c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:41.119388 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5a3a00be-7ead-41a7-b9ce-89e44421769c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:41.119861 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5a3a00be-7ead-41a7-b9ce-89e44421769c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:41.120690 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5a3a00be-7ead-41a7-b9ce-89e44421769c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:41.121118 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5a3a00be-7ead-41a7-b9ce-89e44421769c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:41.236605 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5a3a00be-7ead-41a7-b9ce-89e44421769c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:41.238740 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5a3a00be-7ead-41a7-b9ce-89e44421769c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:41.239869 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-5a3a00be-7ead-41a7-b9ce-89e44421769c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lazy-loading 'fault' on Instance uuid 4bf4618e-3af1-46a8-9712-60af0f29a71f {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:51:41.357404 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fdbee78a-1741-44e5-9bf1-23ac97bc6e24 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:41.381284 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fdbee78a-1741-44e5-9bf1-23ac97bc6e24 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1476 microversion: 2.1 time: 0.383659 Jul 12 11:51:41.386842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5a3a00be-7ead-41a7-b9ce-89e44421769c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff397e55cd0463ca550882a0907fa3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6bb5e5dc44aaa9571c7f9c8de0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:41.396198 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 391/745] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:40 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1476 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:41.401728 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-aa353de9-aafb-446e-b44d-407f1816be3a req-74064dff-4e09-44ba-9313-e6b1459342d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf4618e-3af1-46a8-9712-60af0f29a71f", "name": "network-vif-deleted", "tag": "089bf9c8-9bfa-48c0-bf88-af44a67566bb"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:41.402427 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5a3a00be-7ead-41a7-b9ce-89e44421769c tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 200 len: 1304 microversion: 2.1 time: 0.305182 Jul 12 11:51:41.403679 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 355/746] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:41 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 1304 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:41.421112 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f67fca7f-d99e-43c9-8f63-ff51c25d2d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:41.422060 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f67fca7f-d99e-43c9-8f63-ff51c25d2d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:41.433551 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f67fca7f-d99e-43c9-8f63-ff51c25d2d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:41.434648 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f67fca7f-d99e-43c9-8f63-ff51c25d2d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:41.435608 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f67fca7f-d99e-43c9-8f63-ff51c25d2d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:41.438618 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f67fca7f-d99e-43c9-8f63-ff51c25d2d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:41.450992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-aa353de9-aafb-446e-b44d-407f1816be3a req-74064dff-4e09-44ba-9313-e6b1459342d6 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:41.466403 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-aa353de9-aafb-446e-b44d-407f1816be3a req-74064dff-4e09-44ba-9313-e6b1459342d6 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:41.510566 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-aa353de9-aafb-446e-b44d-407f1816be3a req-74064dff-4e09-44ba-9313-e6b1459342d6 service nova] Creating event network-vif-deleted:089bf9c8-9bfa-48c0-bf88-af44a67566bb for instance 4bf4618e-3af1-46a8-9712-60af0f29a71f on n-h2-849104-4 Jul 12 11:51:41.521026 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-aa353de9-aafb-446e-b44d-407f1816be3a req-74064dff-4e09-44ba-9313-e6b1459342d6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122682 Jul 12 11:51:41.528809 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 392/747] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:41.566073 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f67fca7f-d99e-43c9-8f63-ff51c25d2d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:41.576431 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3c4c169b-13ed-44c9-ba27-aebf3f55c066 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:41.577848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3c4c169b-13ed-44c9-ba27-aebf3f55c066 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:41.580423 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f67fca7f-d99e-43c9-8f63-ff51c25d2d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1288 microversion: 2.1 time: 0.175175 Jul 12 11:51:41.581080 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 356/748] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:41 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1288 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:41.600972 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c4c169b-13ed-44c9-ba27-aebf3f55c066 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:41.601847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c4c169b-13ed-44c9-ba27-aebf3f55c066 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:41.603364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c4c169b-13ed-44c9-ba27-aebf3f55c066 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:41.605441 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c4c169b-13ed-44c9-ba27-aebf3f55c066 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:41.674160 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-26a78514-cb82-4cfe-a71c-42f60b8e7bb8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:41.675289 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-26a78514-cb82-4cfe-a71c-42f60b8e7bb8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:41.686093 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26a78514-cb82-4cfe-a71c-42f60b8e7bb8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:41.686682 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26a78514-cb82-4cfe-a71c-42f60b8e7bb8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:41.688364 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26a78514-cb82-4cfe-a71c-42f60b8e7bb8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:41.689451 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26a78514-cb82-4cfe-a71c-42f60b8e7bb8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:41.739284 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3c4c169b-13ed-44c9-ba27-aebf3f55c066 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:41.750497 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3c4c169b-13ed-44c9-ba27-aebf3f55c066 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1300 microversion: 2.1 time: 0.186244 Jul 12 11:51:41.752186 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 393/749] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:41 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1300 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:41.810682 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-26a78514-cb82-4cfe-a71c-42f60b8e7bb8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:41.824982 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-26a78514-cb82-4cfe-a71c-42f60b8e7bb8 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1432 microversion: 2.1 time: 0.156428 Jul 12 11:51:41.827104 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 357/750] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:41 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1432 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:41.834507 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dac09b5d-d067-4b2e-bf54-5ada91acd054 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:41.835490 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dac09b5d-d067-4b2e-bf54-5ada91acd054 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:41.843762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dac09b5d-d067-4b2e-bf54-5ada91acd054 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:41.846277 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dac09b5d-d067-4b2e-bf54-5ada91acd054 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:41.850559 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dac09b5d-d067-4b2e-bf54-5ada91acd054 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:41.853290 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dac09b5d-d067-4b2e-bf54-5ada91acd054 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:42.198820 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dac09b5d-d067-4b2e-bf54-5ada91acd054 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:42.210190 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dac09b5d-d067-4b2e-bf54-5ada91acd054 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1311 microversion: 2.1 time: 0.380531 Jul 12 11:51:42.217018 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 394/751] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:41 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1311 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:51:42.404797 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-47401eb8-a1ad-481f-8b75-562b8473f477 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:42.407030 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-47401eb8-a1ad-481f-8b75-562b8473f477 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:42.437232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cec84f38-0923-407e-a172-a6328ea911ac tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:42.438581 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cec84f38-0923-407e-a172-a6328ea911ac tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] [instance: 4bf4618e-3af1-46a8-9712-60af0f29a71f] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:42.446127 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47401eb8-a1ad-481f-8b75-562b8473f477 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:42.451016 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47401eb8-a1ad-481f-8b75-562b8473f477 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:42.455707 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47401eb8-a1ad-481f-8b75-562b8473f477 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:42.460283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47401eb8-a1ad-481f-8b75-562b8473f477 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:42.482551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cec84f38-0923-407e-a172-a6328ea911ac tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:42.483810 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cec84f38-0923-407e-a172-a6328ea911ac tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:42.484701 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cec84f38-0923-407e-a172-a6328ea911ac tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:42.485158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cec84f38-0923-407e-a172-a6328ea911ac tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:42.527988 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-cec84f38-0923-407e-a172-a6328ea911ac tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] HTTP exception thrown: Instance 4bf4618e-3af1-46a8-9712-60af0f29a71f could not be found. Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cec84f38-0923-407e-a172-a6328ea911ac tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Request method failure captured: Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f HTTP/1.1 Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWApbVQSLQN1jBUrrd08XuvWP1VrQPYVUteXqAgFoX8Le3MhpV0ViSn15umtRhNwYjUyS66CiPF2Uu7iOOPRsO41koiW3wlXK9vqoLq3PBRirTWMe694WSL9bSB2D-nUrhjTqVJc41973BRb5S16qih9hSngY-2jLYCddwPr0rCE5-Q Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 05d6bb5e5dc44aaa9571c7f9c8de0c4b Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-TenantUsagesTestJSON-156964871 Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/05d6bb5e5dc44aaa9571c7f9c8de0c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/05d6bb5e5dc44aaa9571c7f9c8de0c4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/05d6bb5e5dc44aaa9571c7f9c8de0c4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_05d6bb5e5dc44aaa9571c7f9c8de0c4b", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-TenantUsagesTestJSON-156964871 Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 05d6bb5e5dc44aaa9571c7f9c8de0c4b Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-TenantUsagesTestJSON-156964871 Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-TenantUsagesTestJSON-156964871-project Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 3ff397e55cd0463ca550882a0907fa3f Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-TenantUsagesTestJSON-156964871-project Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 4bf4618e-3af1-46a8-9712-60af0f29a71f could not be found. Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '4bf4618e-3af1-46a8-9712-60af0f29a71f'} Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bf4618e-3af1-46a8-9712-60af0f29a71f could not be found. Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bf4618e-3af1-46a8-9712-60af0f29a71f could not be found. Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:42.530046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:42.534696 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:42.534696 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:42.534696 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:42.534696 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:51:42.534696 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:51:42.534696 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bf4618e-3af1-46a8-9712-60af0f29a71f could not be found. Jul 12 11:51:42.534696 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:42.535918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cec84f38-0923-407e-a172-a6328ea911ac tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] Returning 404 to user: Instance 4bf4618e-3af1-46a8-9712-60af0f29a71f could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:51:42.536980 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cec84f38-0923-407e-a172-a6328ea911ac tempest-TenantUsagesTestJSON-156964871 tempest-TenantUsagesTestJSON-156964871-project] 10.222.0.50 "GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f" status: 404 len: 111 microversion: 2.1 time: 0.110596 Jul 12 11:51:42.541631 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 395/752] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:42 2022] GET /compute/v2.1/servers/4bf4618e-3af1-46a8-9712-60af0f29a71f => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:51:42.609718 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6205a064-d060-46ee-b1cd-17df200a45e5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:42.610353 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6205a064-d060-46ee-b1cd-17df200a45e5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:42.642189 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6205a064-d060-46ee-b1cd-17df200a45e5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:42.642651 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6205a064-d060-46ee-b1cd-17df200a45e5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:42.644520 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6205a064-d060-46ee-b1cd-17df200a45e5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:42.645202 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6205a064-d060-46ee-b1cd-17df200a45e5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:42.754651 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6205a064-d060-46ee-b1cd-17df200a45e5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:42.777490 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6205a064-d060-46ee-b1cd-17df200a45e5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1276 microversion: 2.1 time: 0.175648 Jul 12 11:51:42.779020 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 396/753] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:42 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:42.808098 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-16eb93c8-b92b-4c87-b56b-6294660055c6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:42.809077 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-16eb93c8-b92b-4c87-b56b-6294660055c6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:42.824012 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-16eb93c8-b92b-4c87-b56b-6294660055c6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:42.827411 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-16eb93c8-b92b-4c87-b56b-6294660055c6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:42.829971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-16eb93c8-b92b-4c87-b56b-6294660055c6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:42.830572 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-16eb93c8-b92b-4c87-b56b-6294660055c6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:43.103385 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-16eb93c8-b92b-4c87-b56b-6294660055c6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:43.118590 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-16eb93c8-b92b-4c87-b56b-6294660055c6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1368 microversion: 2.1 time: 0.338203 Jul 12 11:51:43.121613 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 397/754] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:42 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1368 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:43.134953 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a2356fab-9a92-4e84-acb0-800f43e73de1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:43.135766 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a2356fab-9a92-4e84-acb0-800f43e73de1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:43.145320 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a2356fab-9a92-4e84-acb0-800f43e73de1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:43.146004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a2356fab-9a92-4e84-acb0-800f43e73de1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:43.146955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a2356fab-9a92-4e84-acb0-800f43e73de1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:43.148449 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a2356fab-9a92-4e84-acb0-800f43e73de1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:43.309379 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a2356fab-9a92-4e84-acb0-800f43e73de1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:43.314067 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a2356fab-9a92-4e84-acb0-800f43e73de1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:43.315122 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-a2356fab-9a92-4e84-acb0-800f43e73de1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lazy-loading 'fault' on Instance uuid da438037-1861-4a92-8be3-267aa902bcfa {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:51:43.325980 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:43.503281 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a2356fab-9a92-4e84-acb0-800f43e73de1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4c711ca1f44a2ca6c08ee99931cdcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff158fbe4b47d6a0c50888c251e8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:43.523835 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a2356fab-9a92-4e84-acb0-800f43e73de1 tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 200 len: 1308 microversion: 2.1 time: 0.395532 Jul 12 11:51:43.526970 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 398/755] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:43 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:43.547757 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-522a6f2b-3b5c-4143-8048-daddc8fd46c2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:43.555438 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-522a6f2b-3b5c-4143-8048-daddc8fd46c2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:43.592391 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-522a6f2b-3b5c-4143-8048-daddc8fd46c2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:43.594242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-522a6f2b-3b5c-4143-8048-daddc8fd46c2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:43.598181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-522a6f2b-3b5c-4143-8048-daddc8fd46c2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:43.600639 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-522a6f2b-3b5c-4143-8048-daddc8fd46c2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:43.723338 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-47401eb8-a1ad-481f-8b75-562b8473f477 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:43.731581 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-47401eb8-a1ad-481f-8b75-562b8473f477 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1476 microversion: 2.1 time: 1.331715 Jul 12 11:51:43.732833 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 358/756] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:42 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1476 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:43.795972 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f7c328ae-1963-4cd9-9dcb-ddcd67792700 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:43.796625 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f7c328ae-1963-4cd9-9dcb-ddcd67792700 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:43.803722 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f7c328ae-1963-4cd9-9dcb-ddcd67792700 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:43.804827 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f7c328ae-1963-4cd9-9dcb-ddcd67792700 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:43.805795 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f7c328ae-1963-4cd9-9dcb-ddcd67792700 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:43.806245 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f7c328ae-1963-4cd9-9dcb-ddcd67792700 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:43.905264 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-522a6f2b-3b5c-4143-8048-daddc8fd46c2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:43.915636 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-522a6f2b-3b5c-4143-8048-daddc8fd46c2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1311 microversion: 2.1 time: 0.382284 Jul 12 11:51:43.916645 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f7c328ae-1963-4cd9-9dcb-ddcd67792700 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:43.928412 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f7c328ae-1963-4cd9-9dcb-ddcd67792700 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1276 microversion: 2.1 time: 0.137300 Jul 12 11:51:43.929382 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 359/757] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:43 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:51:43.931490 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 399/758] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:43 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1311 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:44.139781 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-66039b8a-d808-4121-b65c-3798fc07a296 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:44.140657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-66039b8a-d808-4121-b65c-3798fc07a296 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:44.152937 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66039b8a-d808-4121-b65c-3798fc07a296 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:44.153859 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66039b8a-d808-4121-b65c-3798fc07a296 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:44.163283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66039b8a-d808-4121-b65c-3798fc07a296 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:44.164227 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66039b8a-d808-4121-b65c-3798fc07a296 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:44.546025 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6256bbfe-396b-4553-a9a3-322e42c37bdf tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:44.547927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6256bbfe-396b-4553-a9a3-322e42c37bdf tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] [instance: da438037-1861-4a92-8be3-267aa902bcfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:44.561359 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6256bbfe-396b-4553-a9a3-322e42c37bdf tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:44.563762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6256bbfe-396b-4553-a9a3-322e42c37bdf tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:44.568071 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6256bbfe-396b-4553-a9a3-322e42c37bdf tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:44.568554 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6256bbfe-396b-4553-a9a3-322e42c37bdf tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:44.599540 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-6256bbfe-396b-4553-a9a3-322e42c37bdf tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] HTTP exception thrown: Instance da438037-1861-4a92-8be3-267aa902bcfa could not be found. Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6256bbfe-396b-4553-a9a3-322e42c37bdf tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Request method failure captured: Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa HTTP/1.1 Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_5NvUlRvk-trcxE-X0Q1QaDm4OXYppq9prNBjNkiv3GXKYF3xjozkeNFO1ANKj4ca2zm7RXd24evbhgnvBEqXnt2noXFDzMbvnukCrHE4EUJHobXXLwfLKzhQ1pKD6qpaGSkqoDzDPDDrf8zEP7a24G3S4cv0RO9WTaz-XV5MEbkA Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 8fff158fbe4b47d6a0c50888c251e8e7 Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-LiveMigrationNegativeTest-1372712352 Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fff158fbe4b47d6a0c50888c251e8e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fff158fbe4b47d6a0c50888c251e8e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8fff158fbe4b47d6a0c50888c251e8e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8fff158fbe4b47d6a0c50888c251e8e7", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-LiveMigrationNegativeTest-1372712352 Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 8fff158fbe4b47d6a0c50888c251e8e7 Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1372712352 Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-LiveMigrationNegativeTest-1372712352-project Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 7f4c711ca1f44a2ca6c08ee99931cdcc Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-LiveMigrationNegativeTest-1372712352-project Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance da438037-1861-4a92-8be3-267aa902bcfa could not be found. Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'da438037-1861-4a92-8be3-267aa902bcfa'} Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da438037-1861-4a92-8be3-267aa902bcfa could not be found. Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da438037-1861-4a92-8be3-267aa902bcfa could not be found. Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:51:44.602004 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:44.606510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:51:44.606510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:51:44.606510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:51:44.606510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:51:44.606510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:51:44.606510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da438037-1861-4a92-8be3-267aa902bcfa could not be found. Jul 12 11:51:44.606510 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:51:44.606510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6256bbfe-396b-4553-a9a3-322e42c37bdf tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] Returning 404 to user: Instance da438037-1861-4a92-8be3-267aa902bcfa could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:51:44.606510 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6256bbfe-396b-4553-a9a3-322e42c37bdf tempest-LiveMigrationNegativeTest-1372712352 tempest-LiveMigrationNegativeTest-1372712352-project] 10.222.0.50 "GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa" status: 404 len: 111 microversion: 2.1 time: 0.064001 Jul 12 11:51:44.607722 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 400/759] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:44 2022] GET /compute/v2.1/servers/da438037-1861-4a92-8be3-267aa902bcfa => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:51:44.753353 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-75680339-243b-427d-bc13-273dcf30a97a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:44.754256 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-75680339-243b-427d-bc13-273dcf30a97a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:44.792214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-75680339-243b-427d-bc13-273dcf30a97a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:44.793222 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-75680339-243b-427d-bc13-273dcf30a97a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:44.797975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-75680339-243b-427d-bc13-273dcf30a97a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:44.800353 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-75680339-243b-427d-bc13-273dcf30a97a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:45.144071 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-66039b8a-d808-4121-b65c-3798fc07a296 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:45.159980 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-66039b8a-d808-4121-b65c-3798fc07a296 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1368 microversion: 2.1 time: 1.025104 Jul 12 11:51:45.165746 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 360/760] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:44 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1368 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:45.179695 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-05602dce-c88c-45ce-8f58-7ba9ec0e75bb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:45.184291 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-75680339-243b-427d-bc13-273dcf30a97a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:45.194652 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-75680339-243b-427d-bc13-273dcf30a97a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1476 microversion: 2.1 time: 0.448838 Jul 12 11:51:45.195834 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 401/761] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:44 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1476 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:51:45.196154 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-05602dce-c88c-45ce-8f58-7ba9ec0e75bb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:45.202783 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-624a3fa9-db34-4cab-9a60-00720bae915b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:45.203407 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-624a3fa9-db34-4cab-9a60-00720bae915b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:45.212332 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-624a3fa9-db34-4cab-9a60-00720bae915b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:45.213466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-624a3fa9-db34-4cab-9a60-00720bae915b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:45.214270 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-624a3fa9-db34-4cab-9a60-00720bae915b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:45.215086 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-624a3fa9-db34-4cab-9a60-00720bae915b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:45.235741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-05602dce-c88c-45ce-8f58-7ba9ec0e75bb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:45.236786 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-05602dce-c88c-45ce-8f58-7ba9ec0e75bb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:45.240199 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-05602dce-c88c-45ce-8f58-7ba9ec0e75bb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:45.240843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-05602dce-c88c-45ce-8f58-7ba9ec0e75bb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:45.653374 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-624a3fa9-db34-4cab-9a60-00720bae915b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:45.662883 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-624a3fa9-db34-4cab-9a60-00720bae915b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1318 microversion: 2.1 time: 0.466045 Jul 12 11:51:45.666652 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 402/762] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:45 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:46.043296 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-05602dce-c88c-45ce-8f58-7ba9ec0e75bb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:46.055266 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-05602dce-c88c-45ce-8f58-7ba9ec0e75bb tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1311 microversion: 2.1 time: 0.882171 Jul 12 11:51:46.056065 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 361/763] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:45 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1311 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:46.182591 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ac908a31-177f-4b3a-ab4f-b196793e0813 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:46.183214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ac908a31-177f-4b3a-ab4f-b196793e0813 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:46.201249 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac908a31-177f-4b3a-ab4f-b196793e0813 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:46.201746 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac908a31-177f-4b3a-ab4f-b196793e0813 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:46.202549 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac908a31-177f-4b3a-ab4f-b196793e0813 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:46.202992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac908a31-177f-4b3a-ab4f-b196793e0813 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:46.213489 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-10a7e18c-6cea-4f5f-afac-752f071c0320 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:46.214105 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-10a7e18c-6cea-4f5f-afac-752f071c0320 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:46.225312 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-10a7e18c-6cea-4f5f-afac-752f071c0320 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:46.226060 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-10a7e18c-6cea-4f5f-afac-752f071c0320 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:46.247555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-10a7e18c-6cea-4f5f-afac-752f071c0320 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:46.248357 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-10a7e18c-6cea-4f5f-afac-752f071c0320 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:46.866110 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-10a7e18c-6cea-4f5f-afac-752f071c0320 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:46.878793 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-10a7e18c-6cea-4f5f-afac-752f071c0320 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1476 microversion: 2.1 time: 0.666502 Jul 12 11:51:46.880339 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 362/764] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:46 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1476 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:46.896937 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-e592b807-1648-400a-abbb-9318d5e56176 req-40e8609b-324d-4739-8fda-ba3495e614e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1556ea71-32c0-43d8-9a28-e364d25cc8e1", "name": "network-vif-plugged", "status": "completed", "tag": "42102276-b5d3-4916-a3fb-5ba8439f5c7f"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:46.918811 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-e592b807-1648-400a-abbb-9318d5e56176 req-40e8609b-324d-4739-8fda-ba3495e614e4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:46.922756 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-e592b807-1648-400a-abbb-9318d5e56176 req-40e8609b-324d-4739-8fda-ba3495e614e4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:46.950344 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-e592b807-1648-400a-abbb-9318d5e56176 req-40e8609b-324d-4739-8fda-ba3495e614e4 service nova] Creating event network-vif-plugged:42102276-b5d3-4916-a3fb-5ba8439f5c7f for instance 1556ea71-32c0-43d8-9a28-e364d25cc8e1 on n-h2-849104-4 Jul 12 11:51:46.962645 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-e592b807-1648-400a-abbb-9318d5e56176 req-40e8609b-324d-4739-8fda-ba3495e614e4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078352 Jul 12 11:51:46.966145 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 363/765] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:46.976695 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2583d0d9-93d9-40e3-a4e7-a3cc2595afcd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:46.978626 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2583d0d9-93d9-40e3-a4e7-a3cc2595afcd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:46.999280 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2583d0d9-93d9-40e3-a4e7-a3cc2595afcd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:47.001127 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2583d0d9-93d9-40e3-a4e7-a3cc2595afcd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:47.007423 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2583d0d9-93d9-40e3-a4e7-a3cc2595afcd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:47.008318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2583d0d9-93d9-40e3-a4e7-a3cc2595afcd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:47.209389 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:47.318230 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ac908a31-177f-4b3a-ab4f-b196793e0813 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:47.340210 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ac908a31-177f-4b3a-ab4f-b196793e0813 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1368 microversion: 2.1 time: 1.160990 Jul 12 11:51:47.342693 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 403/766] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:46 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1368 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:51:47.350685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-92b92db4-3ea3-406e-9c54-11c09eafa0e0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:47.351866 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-92b92db4-3ea3-406e-9c54-11c09eafa0e0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:47.362761 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-92b92db4-3ea3-406e-9c54-11c09eafa0e0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:47.363405 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-92b92db4-3ea3-406e-9c54-11c09eafa0e0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:47.364558 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-92b92db4-3ea3-406e-9c54-11c09eafa0e0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:47.365510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-92b92db4-3ea3-406e-9c54-11c09eafa0e0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:47.592254 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2583d0d9-93d9-40e3-a4e7-a3cc2595afcd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:47.605714 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2583d0d9-93d9-40e3-a4e7-a3cc2595afcd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1318 microversion: 2.1 time: 0.636766 Jul 12 11:51:47.610337 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 364/767] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:46 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:47.628653 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-41a9e4ea-bde3-4ffd-8ee1-a0596ba90710 req-c270e665-8208-4cf9-92a5-75e75b041b26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb218c5-ad4e-4287-b44f-1c77481559cb", "tag": "2af0933a-21e0-442c-8972-dc8f2b026a8f"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:47.651635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-41a9e4ea-bde3-4ffd-8ee1-a0596ba90710 req-c270e665-8208-4cf9-92a5-75e75b041b26 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:47.652779 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-41a9e4ea-bde3-4ffd-8ee1-a0596ba90710 req-c270e665-8208-4cf9-92a5-75e75b041b26 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:47.680647 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-41a9e4ea-bde3-4ffd-8ee1-a0596ba90710 req-c270e665-8208-4cf9-92a5-75e75b041b26 service nova] Creating event network-changed:2af0933a-21e0-442c-8972-dc8f2b026a8f for instance bdb218c5-ad4e-4287-b44f-1c77481559cb on n-h2-849104-4 Jul 12 11:51:47.699412 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-41a9e4ea-bde3-4ffd-8ee1-a0596ba90710 req-c270e665-8208-4cf9-92a5-75e75b041b26 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081386 Jul 12 11:51:47.700725 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 365/768] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:47.898650 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0668da87-9150-4c0b-acbb-ec09070f0e91 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:47.899378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0668da87-9150-4c0b-acbb-ec09070f0e91 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:47.915270 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0668da87-9150-4c0b-acbb-ec09070f0e91 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:47.915884 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0668da87-9150-4c0b-acbb-ec09070f0e91 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:47.916776 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0668da87-9150-4c0b-acbb-ec09070f0e91 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:47.917745 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0668da87-9150-4c0b-acbb-ec09070f0e91 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:48.344173 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0668da87-9150-4c0b-acbb-ec09070f0e91 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:48.355495 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0668da87-9150-4c0b-acbb-ec09070f0e91 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1476 microversion: 2.1 time: 0.461818 Jul 12 11:51:48.361986 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 366/769] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:47 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1476 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:51:48.373960 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d76546a1-1016-4fa7-bbd8-55aeb6c8d1ea tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:48.375566 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d76546a1-1016-4fa7-bbd8-55aeb6c8d1ea tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:48.397332 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d76546a1-1016-4fa7-bbd8-55aeb6c8d1ea tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:48.398684 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d76546a1-1016-4fa7-bbd8-55aeb6c8d1ea tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:48.401198 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d76546a1-1016-4fa7-bbd8-55aeb6c8d1ea tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:48.404683 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d76546a1-1016-4fa7-bbd8-55aeb6c8d1ea tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:48.437422 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:48.518597 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-92b92db4-3ea3-406e-9c54-11c09eafa0e0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:48.531335 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-92b92db4-3ea3-406e-9c54-11c09eafa0e0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1311 microversion: 2.1 time: 1.186757 Jul 12 11:51:48.537847 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 404/770] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:47 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1311 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:48.627621 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1845adab-0a7f-4277-b85a-18a6bd678b54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:48.629016 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1845adab-0a7f-4277-b85a-18a6bd678b54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:48.641958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1845adab-0a7f-4277-b85a-18a6bd678b54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:48.642961 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1845adab-0a7f-4277-b85a-18a6bd678b54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:48.644103 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1845adab-0a7f-4277-b85a-18a6bd678b54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:48.644878 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1845adab-0a7f-4277-b85a-18a6bd678b54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:49.025686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=63 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:49.421651 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1845adab-0a7f-4277-b85a-18a6bd678b54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:49.453745 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1845adab-0a7f-4277-b85a-18a6bd678b54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1318 microversion: 2.1 time: 0.832600 Jul 12 11:51:49.456279 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 405/771] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:48 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1318 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:49.466118 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2dc5bf3f-1aa4-476d-94ee-a42207300710 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:49.468487 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2dc5bf3f-1aa4-476d-94ee-a42207300710 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:49.483222 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2dc5bf3f-1aa4-476d-94ee-a42207300710 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:49.484723 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2dc5bf3f-1aa4-476d-94ee-a42207300710 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:49.486480 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2dc5bf3f-1aa4-476d-94ee-a42207300710 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:49.487472 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2dc5bf3f-1aa4-476d-94ee-a42207300710 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:49.494840 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d76546a1-1016-4fa7-bbd8-55aeb6c8d1ea tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:49.503187 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=16 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:49.521563 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d76546a1-1016-4fa7-bbd8-55aeb6c8d1ea tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1368 microversion: 2.1 time: 1.157650 Jul 12 11:51:49.524823 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 367/772] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:48 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1368 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:49.557500 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-35bcb73f-cad1-4857-8b7b-0a1cbf81258f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:49.558404 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-35bcb73f-cad1-4857-8b7b-0a1cbf81258f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:49.570071 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35bcb73f-cad1-4857-8b7b-0a1cbf81258f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:49.570797 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35bcb73f-cad1-4857-8b7b-0a1cbf81258f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:49.572215 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35bcb73f-cad1-4857-8b7b-0a1cbf81258f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:49.573009 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35bcb73f-cad1-4857-8b7b-0a1cbf81258f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:50.007498 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2dc5bf3f-1aa4-476d-94ee-a42207300710 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:50.016756 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2dc5bf3f-1aa4-476d-94ee-a42207300710 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1475 microversion: 2.1 time: 0.558699 Jul 12 11:51:50.023120 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 406/773] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:49 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1475 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:50.057205 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-35bcb73f-cad1-4857-8b7b-0a1cbf81258f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:50.066016 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-35bcb73f-cad1-4857-8b7b-0a1cbf81258f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1493 microversion: 2.1 time: 0.512938 Jul 12 11:51:50.077337 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 368/774] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:49 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1493 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:50.094385 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-65446fe7-3355-4b8c-95b4-7db527d526c3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:50.095230 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-65446fe7-3355-4b8c-95b4-7db527d526c3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:50.102745 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65446fe7-3355-4b8c-95b4-7db527d526c3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:50.104349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65446fe7-3355-4b8c-95b4-7db527d526c3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:50.109926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65446fe7-3355-4b8c-95b4-7db527d526c3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:50.110711 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65446fe7-3355-4b8c-95b4-7db527d526c3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:50.148243 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=31 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:50.321604 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-138036b5-42a7-44c0-ad95-8bd0940470a6 req-8aa010a0-28b0-464d-bb09-fe7ec7944fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1104fd7-f466-4f7c-a7a4-522be44fac3e", "tag": "73149cc5-5444-4d32-ae0a-bfbf4a70e8f3"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:50.344205 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-138036b5-42a7-44c0-ad95-8bd0940470a6 req-8aa010a0-28b0-464d-bb09-fe7ec7944fee service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:50.344891 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-138036b5-42a7-44c0-ad95-8bd0940470a6 req-8aa010a0-28b0-464d-bb09-fe7ec7944fee service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:50.364389 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-138036b5-42a7-44c0-ad95-8bd0940470a6 req-8aa010a0-28b0-464d-bb09-fe7ec7944fee service nova] Creating event network-changed:73149cc5-5444-4d32-ae0a-bfbf4a70e8f3 for instance e1104fd7-f466-4f7c-a7a4-522be44fac3e on n-h1-849104-4 Jul 12 11:51:50.375407 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-138036b5-42a7-44c0-ad95-8bd0940470a6 req-8aa010a0-28b0-464d-bb09-fe7ec7944fee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060978 Jul 12 11:51:50.376699 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 369/775] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:50.474265 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9c9e0f2b-ea4f-43e2-b6f1-7d099e64cbd6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:50.475195 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9c9e0f2b-ea4f-43e2-b6f1-7d099e64cbd6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:50.483717 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9c9e0f2b-ea4f-43e2-b6f1-7d099e64cbd6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:50.484226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9c9e0f2b-ea4f-43e2-b6f1-7d099e64cbd6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:50.486531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9c9e0f2b-ea4f-43e2-b6f1-7d099e64cbd6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:50.488157 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9c9e0f2b-ea4f-43e2-b6f1-7d099e64cbd6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:51.037224 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9c9e0f2b-ea4f-43e2-b6f1-7d099e64cbd6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:51.051559 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9c9e0f2b-ea4f-43e2-b6f1-7d099e64cbd6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1318 microversion: 2.1 time: 0.582892 Jul 12 11:51:51.056357 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 370/776] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:50 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:51:51.062209 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c2f812e3-a4e8-404e-8973-f17eb649d84f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:51.063485 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c2f812e3-a4e8-404e-8973-f17eb649d84f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:51.071076 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2f812e3-a4e8-404e-8973-f17eb649d84f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:51.072025 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2f812e3-a4e8-404e-8973-f17eb649d84f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:51.074378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2f812e3-a4e8-404e-8973-f17eb649d84f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:51.075013 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2f812e3-a4e8-404e-8973-f17eb649d84f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:51.090199 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-65446fe7-3355-4b8c-95b4-7db527d526c3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1644 microversion: 2.1 time: 0.999568 Jul 12 11:51:51.094006 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 407/777] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:50 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1644 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:51.121352 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3f1866a5-7a37-467f-95c2-ff0b019430cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:51.122874 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3f1866a5-7a37-467f-95c2-ff0b019430cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:51.165273 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f1866a5-7a37-467f-95c2-ff0b019430cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:51.167173 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f1866a5-7a37-467f-95c2-ff0b019430cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:51.169551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f1866a5-7a37-467f-95c2-ff0b019430cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:51.170703 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f1866a5-7a37-467f-95c2-ff0b019430cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:51.403698 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c2f812e3-a4e8-404e-8973-f17eb649d84f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:51.411621 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c2f812e3-a4e8-404e-8973-f17eb649d84f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1368 microversion: 2.1 time: 0.353699 Jul 12 11:51:51.415360 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 371/778] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:51 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1368 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:51.422905 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e84896ac-2055-4c1c-8012-daedda3521e8 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:51.426384 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e84896ac-2055-4c1c-8012-daedda3521e8 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:51.454098 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e84896ac-2055-4c1c-8012-daedda3521e8 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:51.456577 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e84896ac-2055-4c1c-8012-daedda3521e8 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:51.457735 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e84896ac-2055-4c1c-8012-daedda3521e8 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:51.458400 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e84896ac-2055-4c1c-8012-daedda3521e8 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:51.788204 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3f1866a5-7a37-467f-95c2-ff0b019430cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:51.801462 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3f1866a5-7a37-467f-95c2-ff0b019430cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1475 microversion: 2.1 time: 0.705513 Jul 12 11:51:51.802081 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 408/779] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:51 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1475 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:51.819108 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-aa64d449-cb62-481d-a4a2-08f2969b50d8 req-c1fb42f5-0e81-4c24-aa8a-02fa77cccb05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad134105-4265-45f8-8844-8f1ddfbeea10", "name": "network-vif-unplugged", "status": "completed", "tag": "85f8e57f-7584-4612-9d3a-a67d37236dcf"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:51.843060 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-aa64d449-cb62-481d-a4a2-08f2969b50d8 req-c1fb42f5-0e81-4c24-aa8a-02fa77cccb05 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:51.845505 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-aa64d449-cb62-481d-a4a2-08f2969b50d8 req-c1fb42f5-0e81-4c24-aa8a-02fa77cccb05 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:51.848017 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e84896ac-2055-4c1c-8012-daedda3521e8 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1644 microversion: 2.1 time: 0.428980 Jul 12 11:51:51.849972 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 372/780] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:51 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1644 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:51.869733 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0a5cc37c-11fe-4590-b319-4baec5d6081e tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:51.871679 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:51:51.871679 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:51:51.873426 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0a5cc37c-11fe-4590-b319-4baec5d6081e tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:51.874605 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0a5cc37c-11fe-4590-b319-4baec5d6081e tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:51.876420 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0a5cc37c-11fe-4590-b319-4baec5d6081e tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:51.878285 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0a5cc37c-11fe-4590-b319-4baec5d6081e tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:51.898069 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-aa64d449-cb62-481d-a4a2-08f2969b50d8 req-c1fb42f5-0e81-4c24-aa8a-02fa77cccb05 service nova] Creating event network-vif-unplugged:85f8e57f-7584-4612-9d3a-a67d37236dcf for instance ad134105-4265-45f8-8844-8f1ddfbeea10 on n-h1-849104-4 Jul 12 11:51:51.910017 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [req-aa64d449-cb62-481d-a4a2-08f2969b50d8 req-c1fb42f5-0e81-4c24-aa8a-02fa77cccb05 service nova] Instance ad134105-4265-45f8-8844-8f1ddfbeea10 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849104-4'} {{(pid=125984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 12 11:51:51.927558 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-aa64d449-cb62-481d-a4a2-08f2969b50d8 req-c1fb42f5-0e81-4c24-aa8a-02fa77cccb05 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111999 Jul 12 11:51:51.928194 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 409/781] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:51.942763 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:51.967345 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0a5cc37c-11fe-4590-b319-4baec5d6081e tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.101200 Jul 12 11:51:51.983431 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-43039b59-d647-4f09-8fc1-9c65c43260b6 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:51.985056 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-43039b59-d647-4f09-8fc1-9c65c43260b6 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:51.989833 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 373/782] 10.222.0.50 () {58 vars in 1175 bytes} [Tue Jul 12 11:51:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:51:52.006328 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43039b59-d647-4f09-8fc1-9c65c43260b6 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:52.006782 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43039b59-d647-4f09-8fc1-9c65c43260b6 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:52.009418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43039b59-d647-4f09-8fc1-9c65c43260b6 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:52.009418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43039b59-d647-4f09-8fc1-9c65c43260b6 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:52.118873 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-43039b59-d647-4f09-8fc1-9c65c43260b6 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1/action" status: 202 len: 0 microversion: 2.1 time: 0.141787 Jul 12 11:51:52.143049 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 410/783] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:51:51 2022] POST /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:51:52.154760 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b727d27f-f875-4a3d-ba63-0503862b0e4e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:52.158701 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b727d27f-f875-4a3d-ba63-0503862b0e4e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:52.181110 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b727d27f-f875-4a3d-ba63-0503862b0e4e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:52.187887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b727d27f-f875-4a3d-ba63-0503862b0e4e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:52.189161 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b727d27f-f875-4a3d-ba63-0503862b0e4e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:52.189980 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b727d27f-f875-4a3d-ba63-0503862b0e4e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:52.303699 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6ca17e9b-b884-4ec5-95aa-80fee2ad8d34 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Action: 'update', calling method: .version_select at 0x7f5e0b0399d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:52.397275 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ca17e9b-b884-4ec5-95aa-80fee2ad8d34 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:52.398033 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ca17e9b-b884-4ec5-95aa-80fee2ad8d34 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:52.399072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ca17e9b-b884-4ec5-95aa-80fee2ad8d34 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:52.399704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ca17e9b-b884-4ec5-95aa-80fee2ad8d34 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:52.486520 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6ca17e9b-b884-4ec5-95aa-80fee2ad8d34 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/17ca659f4c4748eebae31280d28b2a7f" status: 200 len: 148 microversion: 2.57 time: 0.447435 Jul 12 11:51:52.494471 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 374/784] 10.222.0.50 () {62 vars in 1302 bytes} [Tue Jul 12 11:51:52 2022] PUT /compute/v2.1/os-quota-sets/17ca659f4c4748eebae31280d28b2a7f => generated 148 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 11:51:52.499860 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ce9c8edd-1e0e-48ff-a95d-513aeecb97b3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:52.500951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ce9c8edd-1e0e-48ff-a95d-513aeecb97b3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:52.509505 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce9c8edd-1e0e-48ff-a95d-513aeecb97b3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:52.509872 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce9c8edd-1e0e-48ff-a95d-513aeecb97b3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:52.510871 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce9c8edd-1e0e-48ff-a95d-513aeecb97b3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:52.511318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce9c8edd-1e0e-48ff-a95d-513aeecb97b3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:52.553484 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b727d27f-f875-4a3d-ba63-0503862b0e4e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:52.578919 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b727d27f-f875-4a3d-ba63-0503862b0e4e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1318 microversion: 2.1 time: 0.432974 Jul 12 11:51:52.596307 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 411/785] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:52 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:52.605371 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-61a2aa14-59be-4a34-b194-0f3768e55611 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:52.606017 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-61a2aa14-59be-4a34-b194-0f3768e55611 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:52.614564 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61a2aa14-59be-4a34-b194-0f3768e55611 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:52.615546 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61a2aa14-59be-4a34-b194-0f3768e55611 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:52.616574 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61a2aa14-59be-4a34-b194-0f3768e55611 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:52.617028 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61a2aa14-59be-4a34-b194-0f3768e55611 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:52.916758 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ce9c8edd-1e0e-48ff-a95d-513aeecb97b3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1649 microversion: 2.1 time: 0.420729 Jul 12 11:51:52.918417 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 375/786] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:52 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1649 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:52.926704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5367ae0b-3dfa-4d89-945e-b011376b92c8 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Calling method '.version_select at 0x7f5e0ae78e50>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:53.015413 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-61a2aa14-59be-4a34-b194-0f3768e55611 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:53.050361 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-61a2aa14-59be-4a34-b194-0f3768e55611 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1368 microversion: 2.1 time: 0.439463 Jul 12 11:51:53.051536 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 412/787] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:52 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1368 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:53.069280 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-4618c702-5f20-4994-89af-9eedfbc1be44 req-9300da4e-8f8a-4efd-a86f-47d54ab4984d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7763fa51-4518-440e-a663-f8dac78f536c", "tag": "d73d1c16-b3a0-4956-9a0d-4f206660a263"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:53.078744 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-4618c702-5f20-4994-89af-9eedfbc1be44 req-9300da4e-8f8a-4efd-a86f-47d54ab4984d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:53.079464 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-4618c702-5f20-4994-89af-9eedfbc1be44 req-9300da4e-8f8a-4efd-a86f-47d54ab4984d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:53.093610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5367ae0b-3dfa-4d89-945e-b011376b92c8 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:53.094478 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5367ae0b-3dfa-4d89-945e-b011376b92c8 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:53.096133 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5367ae0b-3dfa-4d89-945e-b011376b92c8 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:53.100361 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5367ae0b-3dfa-4d89-945e-b011376b92c8 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:53.112339 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-4618c702-5f20-4994-89af-9eedfbc1be44 req-9300da4e-8f8a-4efd-a86f-47d54ab4984d service nova] Creating event network-changed:d73d1c16-b3a0-4956-9a0d-4f206660a263 for instance 7763fa51-4518-440e-a663-f8dac78f536c on n-h2-849104-4 Jul 12 11:51:53.127737 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-4618c702-5f20-4994-89af-9eedfbc1be44 req-9300da4e-8f8a-4efd-a86f-47d54ab4984d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062108 Jul 12 11:51:53.130897 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 413/788] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:53.143013 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-af6135af-cc70-4f4f-8290-082bbd79bc3e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:53.155407 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-af6135af-cc70-4f4f-8290-082bbd79bc3e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:53.162030 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5367ae0b-3dfa-4d89-945e-b011376b92c8 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/17ca659f4c4748eebae31280d28b2a7f/detail" status: 200 len: 463 microversion: 2.57 time: 0.239651 Jul 12 11:51:53.185240 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 376/789] 10.222.0.50 () {60 vars in 1303 bytes} [Tue Jul 12 11:51:52 2022] GET /compute/v2.1/os-quota-sets/17ca659f4c4748eebae31280d28b2a7f/detail => generated 463 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:51:53.191972 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af6135af-cc70-4f4f-8290-082bbd79bc3e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:53.192676 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af6135af-cc70-4f4f-8290-082bbd79bc3e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:53.193620 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af6135af-cc70-4f4f-8290-082bbd79bc3e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:53.194183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af6135af-cc70-4f4f-8290-082bbd79bc3e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:53.441699 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fa1f57ef-c2bd-43c4-a434-c3627bb4ced9 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Action: 'update', calling method: .version_select at 0x7f5e0ae91ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:53.552936 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa1f57ef-c2bd-43c4-a434-c3627bb4ced9 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:53.554007 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa1f57ef-c2bd-43c4-a434-c3627bb4ced9 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:53.555661 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa1f57ef-c2bd-43c4-a434-c3627bb4ced9 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:53.556351 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa1f57ef-c2bd-43c4-a434-c3627bb4ced9 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:53.649300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa1f57ef-c2bd-43c4-a434-c3627bb4ced9 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:53.651303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa1f57ef-c2bd-43c4-a434-c3627bb4ced9 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:53.652573 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa1f57ef-c2bd-43c4-a434-c3627bb4ced9 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:53.653236 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa1f57ef-c2bd-43c4-a434-c3627bb4ced9 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:53.728746 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-af6135af-cc70-4f4f-8290-082bbd79bc3e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:53.739404 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-af6135af-cc70-4f4f-8290-082bbd79bc3e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1473 microversion: 2.1 time: 0.607008 Jul 12 11:51:53.740622 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 414/790] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:53 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1473 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:53.759507 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3f6a89b9-6898-44fa-bec2-21f69bcad9e4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:53.760448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3f6a89b9-6898-44fa-bec2-21f69bcad9e4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:53.767409 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f6a89b9-6898-44fa-bec2-21f69bcad9e4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:53.768189 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f6a89b9-6898-44fa-bec2-21f69bcad9e4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:53.769165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f6a89b9-6898-44fa-bec2-21f69bcad9e4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:53.769966 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f6a89b9-6898-44fa-bec2-21f69bcad9e4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:53.798816 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fa1f57ef-c2bd-43c4-a434-c3627bb4ced9 tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/17ca659f4c4748eebae31280d28b2a7f?user_id=b73e434a44be4b4e9e087a55c270f849" status: 200 len: 148 microversion: 2.57 time: 0.363442 Jul 12 11:51:53.808923 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 377/791] 10.222.0.50 () {62 vars in 1383 bytes} [Tue Jul 12 11:51:53 2022] PUT /compute/v2.1/os-quota-sets/17ca659f4c4748eebae31280d28b2a7f?user_id=b73e434a44be4b4e9e087a55c270f849 => generated 148 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 11:51:53.816888 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-21cb421f-11c6-4475-a9ee-7987ce792f4f tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] Calling method '.version_select at 0x7f5e0ae9fe50>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:53.947342 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-21cb421f-11c6-4475-a9ee-7987ce792f4f tempest-QuotasAdminTestV257-990540539 tempest-QuotasAdminTestV257-990540539-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/17ca659f4c4748eebae31280d28b2a7f?user_id=b73e434a44be4b4e9e087a55c270f849" status: 200 len: 190 microversion: 2.57 time: 0.134749 Jul 12 11:51:53.958609 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 378/792] 10.222.0.50 () {60 vars in 1363 bytes} [Tue Jul 12 11:51:53 2022] GET /compute/v2.1/os-quota-sets/17ca659f4c4748eebae31280d28b2a7f?user_id=b73e434a44be4b4e9e087a55c270f849 => generated 190 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:51:53.971193 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e4828678-a4a0-4826-92a7-b1f338e0ce04 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:53.971920 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e4828678-a4a0-4826-92a7-b1f338e0ce04 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:53.994824 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4828678-a4a0-4826-92a7-b1f338e0ce04 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:53.995316 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4828678-a4a0-4826-92a7-b1f338e0ce04 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:53.996945 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4828678-a4a0-4826-92a7-b1f338e0ce04 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:53.997397 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4828678-a4a0-4826-92a7-b1f338e0ce04 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:54.103191 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3f6a89b9-6898-44fa-bec2-21f69bcad9e4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:54.114329 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:54.121744 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3f6a89b9-6898-44fa-bec2-21f69bcad9e4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1318 microversion: 2.1 time: 0.379743 Jul 12 11:51:54.125435 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 415/793] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:53 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:54.137083 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-16797fa8-8b91-494f-901a-d8e281bc7206 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:54.143629 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-16797fa8-8b91-494f-901a-d8e281bc7206 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:54.149520 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:51:54.172820 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-16797fa8-8b91-494f-901a-d8e281bc7206 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:54.179064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-16797fa8-8b91-494f-901a-d8e281bc7206 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:54.180089 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-16797fa8-8b91-494f-901a-d8e281bc7206 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:54.182709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-16797fa8-8b91-494f-901a-d8e281bc7206 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:54.340866 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e4828678-a4a0-4826-92a7-b1f338e0ce04 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1629 microversion: 2.1 time: 0.374474 Jul 12 11:51:54.344504 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 379/794] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:53 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1629 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:54.370409 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a919b0ec-258c-4258-8d92-630ef81ac375 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-849104-4", "block_migration": true, "disk_over_commit": false}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:54.376961 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a919b0ec-258c-4258-8d92-630ef81ac375 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:54.401540 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a919b0ec-258c-4258-8d92-630ef81ac375 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:54.402002 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a919b0ec-258c-4258-8d92-630ef81ac375 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:54.402816 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a919b0ec-258c-4258-8d92-630ef81ac375 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:54.403264 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a919b0ec-258c-4258-8d92-630ef81ac375 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:54.693736 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-16797fa8-8b91-494f-901a-d8e281bc7206 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:54.705345 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-16797fa8-8b91-494f-901a-d8e281bc7206 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1368 microversion: 2.1 time: 0.578660 Jul 12 11:51:54.706000 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 416/795] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:54 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1368 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:54.758839 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-851a686b-46f4-4e0a-a014-a941998e3e52 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:54.759724 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-851a686b-46f4-4e0a-a014-a941998e3e52 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:54.776024 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-851a686b-46f4-4e0a-a014-a941998e3e52 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:54.778723 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-851a686b-46f4-4e0a-a014-a941998e3e52 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:54.782663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-851a686b-46f4-4e0a-a014-a941998e3e52 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:54.784251 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-851a686b-46f4-4e0a-a014-a941998e3e52 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:55.215766 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-a919b0ec-258c-4258-8d92-630ef81ac375 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lazy-loading 'flavor' on Instance uuid 1556ea71-32c0-43d8-9a28-e364d25cc8e1 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:51:55.352743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a919b0ec-258c-4258-8d92-630ef81ac375 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Going to try to live migrate instance to n-h1-849104-4 {{(pid=125983) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 12 11:51:55.519966 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-851a686b-46f4-4e0a-a014-a941998e3e52 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:55.538311 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-851a686b-46f4-4e0a-a014-a941998e3e52 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1473 microversion: 2.1 time: 0.783951 Jul 12 11:51:55.538895 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 417/796] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:54 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1473 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:51:55.550773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4454b1c3-e73d-4358-8268-c1c3904aedb2 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:55.565733 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4454b1c3-e73d-4358-8268-c1c3904aedb2 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:55.583728 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4454b1c3-e73d-4358-8268-c1c3904aedb2 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:55.584155 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4454b1c3-e73d-4358-8268-c1c3904aedb2 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:55.584953 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4454b1c3-e73d-4358-8268-c1c3904aedb2 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:55.585394 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4454b1c3-e73d-4358-8268-c1c3904aedb2 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:55.889089 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4454b1c3-e73d-4358-8268-c1c3904aedb2 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:55.899518 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4454b1c3-e73d-4358-8268-c1c3904aedb2 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1318 microversion: 2.1 time: 0.353160 Jul 12 11:51:55.914931 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 418/797] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:55 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:55.924147 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e9cccbda-e101-4438-9f92-70e370088249 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:55.927569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e9cccbda-e101-4438-9f92-70e370088249 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:55.947458 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9cccbda-e101-4438-9f92-70e370088249 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:55.948150 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9cccbda-e101-4438-9f92-70e370088249 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:55.949018 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9cccbda-e101-4438-9f92-70e370088249 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:55.949527 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9cccbda-e101-4438-9f92-70e370088249 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:56.752196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e9cccbda-e101-4438-9f92-70e370088249 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:56.780474 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e9cccbda-e101-4438-9f92-70e370088249 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1368 microversion: 2.1 time: 0.862753 Jul 12 11:51:56.781201 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 419/798] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:55 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1368 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:56.802236 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c61d6010-1ba8-4658-89a8-e31699bd6ef0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:56.803175 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c61d6010-1ba8-4658-89a8-e31699bd6ef0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:56.822213 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c61d6010-1ba8-4658-89a8-e31699bd6ef0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:56.823088 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c61d6010-1ba8-4658-89a8-e31699bd6ef0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:56.828273 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c61d6010-1ba8-4658-89a8-e31699bd6ef0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:56.828843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c61d6010-1ba8-4658-89a8-e31699bd6ef0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:57.233521 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c61d6010-1ba8-4658-89a8-e31699bd6ef0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:57.246226 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c61d6010-1ba8-4658-89a8-e31699bd6ef0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1470 microversion: 2.1 time: 0.458483 Jul 12 11:51:57.260068 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 420/799] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:56 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1470 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:57.268702 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-26c82fc6-006f-4734-a8de-9946572e3cb7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:57.270453 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-26c82fc6-006f-4734-a8de-9946572e3cb7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:57.277904 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26c82fc6-006f-4734-a8de-9946572e3cb7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:57.278692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26c82fc6-006f-4734-a8de-9946572e3cb7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:57.279805 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26c82fc6-006f-4734-a8de-9946572e3cb7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:57.280718 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26c82fc6-006f-4734-a8de-9946572e3cb7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:57.741011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-26c82fc6-006f-4734-a8de-9946572e3cb7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:57.750910 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-26c82fc6-006f-4734-a8de-9946572e3cb7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1318 microversion: 2.1 time: 0.489378 Jul 12 11:51:57.751537 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 421/800] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:57 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:57.776531 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-d942eef6-77f6-469e-87cd-251d15c18b89 req-a4d55588-b5ec-40cf-b208-477bb27858ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb218c5-ad4e-4287-b44f-1c77481559cb", "name": "network-vif-plugged", "status": "completed", "tag": "2af0933a-21e0-442c-8972-dc8f2b026a8f"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:57.795625 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d942eef6-77f6-469e-87cd-251d15c18b89 req-a4d55588-b5ec-40cf-b208-477bb27858ed service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:57.804898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d942eef6-77f6-469e-87cd-251d15c18b89 req-a4d55588-b5ec-40cf-b208-477bb27858ed service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:57.836337 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-d942eef6-77f6-469e-87cd-251d15c18b89 req-a4d55588-b5ec-40cf-b208-477bb27858ed service nova] Creating event network-vif-plugged:2af0933a-21e0-442c-8972-dc8f2b026a8f for instance bdb218c5-ad4e-4287-b44f-1c77481559cb on n-h2-849104-4 Jul 12 11:51:57.848811 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-d942eef6-77f6-469e-87cd-251d15c18b89 req-a4d55588-b5ec-40cf-b208-477bb27858ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079709 Jul 12 11:51:57.849905 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 422/801] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:57.873605 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-207e26db-7a34-4f99-b2fb-925a0b329fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:57.888463 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-207e26db-7a34-4f99-b2fb-925a0b329fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:57.899880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-207e26db-7a34-4f99-b2fb-925a0b329fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:57.900719 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-207e26db-7a34-4f99-b2fb-925a0b329fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:57.901792 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-207e26db-7a34-4f99-b2fb-925a0b329fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:57.902719 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-207e26db-7a34-4f99-b2fb-925a0b329fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:58.003912 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-207e26db-7a34-4f99-b2fb-925a0b329fe7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "POST /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10/action" status: 204 len: 0 microversion: 2.1 time: 0.150754 Jul 12 11:51:58.004762 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 423/802] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:51:57 2022] POST /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10/action => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:51:58.019482 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fbe1b6a2-5cfd-42d6-9bd9-0a7d20f5c778 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:58.022286 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fbe1b6a2-5cfd-42d6-9bd9-0a7d20f5c778 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:58.039334 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fbe1b6a2-5cfd-42d6-9bd9-0a7d20f5c778 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:58.041021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fbe1b6a2-5cfd-42d6-9bd9-0a7d20f5c778 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:58.042525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fbe1b6a2-5cfd-42d6-9bd9-0a7d20f5c778 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:58.043900 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fbe1b6a2-5cfd-42d6-9bd9-0a7d20f5c778 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:58.606469 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a919b0ec-258c-4258-8d92-630ef81ac375 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1/action" status: 202 len: 0 microversion: 2.1 time: 4.249160 Jul 12 11:51:58.612661 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 380/803] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:51:54 2022] POST /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1/action => generated 0 bytes in 4256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:51:58.622118 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-741b7d8a-d198-4eac-81f5-49fab8d4c051 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:58.626892 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-741b7d8a-d198-4eac-81f5-49fab8d4c051 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:58.646102 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-741b7d8a-d198-4eac-81f5-49fab8d4c051 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:58.649472 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-741b7d8a-d198-4eac-81f5-49fab8d4c051 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:58.650668 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-741b7d8a-d198-4eac-81f5-49fab8d4c051 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:58.651309 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-741b7d8a-d198-4eac-81f5-49fab8d4c051 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:58.795668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fbe1b6a2-5cfd-42d6-9bd9-0a7d20f5c778 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:58.805105 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fbe1b6a2-5cfd-42d6-9bd9-0a7d20f5c778 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1368 microversion: 2.1 time: 0.798784 Jul 12 11:51:58.805714 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 424/804] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:58 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1368 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:59.099546 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6c4bbefd-b35f-49fe-92ec-4468ec4d27db tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Action: 'create', calling method: .version_select at 0x7f5e0a1f5ee0>, body: {"keypair": {"name": "tempest-keypair-1779531043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA96hTJXVxGXO8VrZk9RrU5KpBit5+j6WuDHw7k2rb1KR9Lh8jTmTdKL1z1p2DJ7LA5mmiMNV5MTPQM+3ko1dH8J72EqVqkQgdVpOUjB1aRt3QoGp0H4Ihir8k2QG3L6NQ=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:51:59.143145 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-6c4bbefd-b35f-49fe-92ec-4468ec4d27db tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Getting quotas for project 9a6547cfce324d3c88b883bbfa07d09f. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:51:59.162134 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-6c4bbefd-b35f-49fe-92ec-4468ec4d27db tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Getting quotas for user 03a182b0927742a89093649b1e0968fc and project 9a6547cfce324d3c88b883bbfa07d09f. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:51:59.207259 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6c4bbefd-b35f-49fe-92ec-4468ec4d27db tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.396835 Jul 12 11:51:59.213409 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 425/805] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:51:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:51:59.228566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-efeffc9b-c048-4f38-bd47-5c0159a6c5da tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:59.229667 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-efeffc9b-c048-4f38-bd47-5c0159a6c5da tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:59.239507 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-efeffc9b-c048-4f38-bd47-5c0159a6c5da tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:59.244198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-efeffc9b-c048-4f38-bd47-5c0159a6c5da tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:59.247556 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-efeffc9b-c048-4f38-bd47-5c0159a6c5da tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:59.249395 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-efeffc9b-c048-4f38-bd47-5c0159a6c5da tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:59.543283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-741b7d8a-d198-4eac-81f5-49fab8d4c051 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:59.558729 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-741b7d8a-d198-4eac-81f5-49fab8d4c051 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1470 microversion: 2.1 time: 0.944180 Jul 12 11:51:59.559327 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 381/806] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:58 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1470 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:59.569674 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-efeffc9b-c048-4f38-bd47-5c0159a6c5da tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:51:59.573383 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fe7cd135-4f0d-4984-bc5f-e655de637dad tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:59.574523 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fe7cd135-4f0d-4984-bc5f-e655de637dad tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:59.590575 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe7cd135-4f0d-4984-bc5f-e655de637dad tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:59.591317 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe7cd135-4f0d-4984-bc5f-e655de637dad tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:59.592355 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe7cd135-4f0d-4984-bc5f-e655de637dad tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:59.592975 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe7cd135-4f0d-4984-bc5f-e655de637dad tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:59.593610 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-efeffc9b-c048-4f38-bd47-5c0159a6c5da tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1503 microversion: 2.1 time: 0.377958 Jul 12 11:51:59.596758 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 426/807] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:59 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1503 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:51:59.832946 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-930c672c-6dc9-455a-9756-b277814361a2 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:51:59.835735 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-930c672c-6dc9-455a-9756-b277814361a2 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:51:59.845972 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-930c672c-6dc9-455a-9756-b277814361a2 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:59.847203 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-930c672c-6dc9-455a-9756-b277814361a2 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:51:59.850688 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-930c672c-6dc9-455a-9756-b277814361a2 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:51:59.852121 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-930c672c-6dc9-455a-9756-b277814361a2 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:00.270581 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-930c672c-6dc9-455a-9756-b277814361a2 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:00.303612 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fe7cd135-4f0d-4984-bc5f-e655de637dad tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:00.312290 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-930c672c-6dc9-455a-9756-b277814361a2 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1368 microversion: 2.1 time: 0.459261 Jul 12 11:52:00.313127 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 427/808] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:59 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1368 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:00.316470 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fe7cd135-4f0d-4984-bc5f-e655de637dad tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1318 microversion: 2.1 time: 0.750918 Jul 12 11:52:00.320443 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 382/809] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:51:59 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1318 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:00.578135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-499fa603-95e5-4569-9a5c-4b90e25500ec tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:00.579181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-499fa603-95e5-4569-9a5c-4b90e25500ec tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:00.613124 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-499fa603-95e5-4569-9a5c-4b90e25500ec tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:00.617469 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-499fa603-95e5-4569-9a5c-4b90e25500ec tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:00.623736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f73327b2-dc69-4929-8600-be97c5c562ae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:00.625539 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f73327b2-dc69-4929-8600-be97c5c562ae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:00.626284 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-499fa603-95e5-4569-9a5c-4b90e25500ec tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:00.631195 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-499fa603-95e5-4569-9a5c-4b90e25500ec tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:00.652703 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f73327b2-dc69-4929-8600-be97c5c562ae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:00.653693 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f73327b2-dc69-4929-8600-be97c5c562ae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:00.657122 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f73327b2-dc69-4929-8600-be97c5c562ae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:00.657951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f73327b2-dc69-4929-8600-be97c5c562ae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:01.140469 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f73327b2-dc69-4929-8600-be97c5c562ae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:01.188748 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f73327b2-dc69-4929-8600-be97c5c562ae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1503 microversion: 2.1 time: 0.578949 Jul 12 11:52:01.203546 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 383/810] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:00 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1503 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:01.273172 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-499fa603-95e5-4569-9a5c-4b90e25500ec tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:01.293615 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-499fa603-95e5-4569-9a5c-4b90e25500ec tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1470 microversion: 2.1 time: 0.720535 Jul 12 11:52:01.313432 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 428/811] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:00 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1470 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:01.342711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-83ada4f4-d582-4573-b375-4ac957178803 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:01.344552 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-83ada4f4-d582-4573-b375-4ac957178803 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:01.347902 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e496b2fb-61f8-4df4-bccc-3e1d652c2113 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:01.350124 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e496b2fb-61f8-4df4-bccc-3e1d652c2113 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:01.382014 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-83ada4f4-d582-4573-b375-4ac957178803 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:01.403180 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-83ada4f4-d582-4573-b375-4ac957178803 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:01.412689 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-83ada4f4-d582-4573-b375-4ac957178803 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:01.416470 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-83ada4f4-d582-4573-b375-4ac957178803 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:01.423348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e496b2fb-61f8-4df4-bccc-3e1d652c2113 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:01.424817 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e496b2fb-61f8-4df4-bccc-3e1d652c2113 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:01.429349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e496b2fb-61f8-4df4-bccc-3e1d652c2113 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:01.432321 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e496b2fb-61f8-4df4-bccc-3e1d652c2113 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:01.767813 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-83ada4f4-d582-4573-b375-4ac957178803 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:01.781499 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-83ada4f4-d582-4573-b375-4ac957178803 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1318 microversion: 2.1 time: 0.449901 Jul 12 11:52:01.782112 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 384/812] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:01 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:01.849195 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e496b2fb-61f8-4df4-bccc-3e1d652c2113 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:01.863249 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e496b2fb-61f8-4df4-bccc-3e1d652c2113 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1559 microversion: 2.1 time: 0.526423 Jul 12 11:52:01.866239 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 429/813] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:01 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1559 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:01.895394 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-63a97e0e-6c46-4b10-a160-682ca2c6f991 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:01.896126 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-63a97e0e-6c46-4b10-a160-682ca2c6f991 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:01.906723 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-63a97e0e-6c46-4b10-a160-682ca2c6f991 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:01.907196 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-63a97e0e-6c46-4b10-a160-682ca2c6f991 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:01.908020 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-63a97e0e-6c46-4b10-a160-682ca2c6f991 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:01.913842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-63a97e0e-6c46-4b10-a160-682ca2c6f991 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:02.156527 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-ee84b8dc-f1d8-4d58-8600-2195944e599d req-b437ea09-a57f-4bb8-bb05-082dfbe63958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1556ea71-32c0-43d8-9a28-e364d25cc8e1", "name": "network-vif-unplugged", "status": "completed", "tag": "42102276-b5d3-4916-a3fb-5ba8439f5c7f"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:02.187693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-ee84b8dc-f1d8-4d58-8600-2195944e599d req-b437ea09-a57f-4bb8-bb05-082dfbe63958 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:02.188202 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-ee84b8dc-f1d8-4d58-8600-2195944e599d req-b437ea09-a57f-4bb8-bb05-082dfbe63958 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:02.223956 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-ee84b8dc-f1d8-4d58-8600-2195944e599d req-b437ea09-a57f-4bb8-bb05-082dfbe63958 service nova] Creating event network-vif-unplugged:42102276-b5d3-4916-a3fb-5ba8439f5c7f for instance 1556ea71-32c0-43d8-9a28-e364d25cc8e1 on n-h2-849104-4 Jul 12 11:52:02.231153 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-ee84b8dc-f1d8-4d58-8600-2195944e599d req-b437ea09-a57f-4bb8-bb05-082dfbe63958 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078376 Jul 12 11:52:02.232613 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 430/814] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:52:02.243454 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4cec1836-b006-42f1-bac2-6e75253d38f5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:02.244519 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4cec1836-b006-42f1-bac2-6e75253d38f5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:02.255521 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4cec1836-b006-42f1-bac2-6e75253d38f5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:02.256525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4cec1836-b006-42f1-bac2-6e75253d38f5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:02.257966 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4cec1836-b006-42f1-bac2-6e75253d38f5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:02.258614 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4cec1836-b006-42f1-bac2-6e75253d38f5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:02.285054 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-63a97e0e-6c46-4b10-a160-682ca2c6f991 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.395723 Jul 12 11:52:02.286126 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 385/815] 10.222.0.50 () {58 vars in 1274 bytes} [Tue Jul 12 11:52:01 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-interface => generated 285 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:02.315381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fbf1dcbd-8355-4ba1-a94a-6670bb99488d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:02.316078 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fbf1dcbd-8355-4ba1-a94a-6670bb99488d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:02.323506 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fbf1dcbd-8355-4ba1-a94a-6670bb99488d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:02.323973 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fbf1dcbd-8355-4ba1-a94a-6670bb99488d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:02.329957 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fbf1dcbd-8355-4ba1-a94a-6670bb99488d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:02.330414 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fbf1dcbd-8355-4ba1-a94a-6670bb99488d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:02.369638 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:02.813354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fbf1dcbd-8355-4ba1-a94a-6670bb99488d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:02.838194 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fbf1dcbd-8355-4ba1-a94a-6670bb99488d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1462 microversion: 2.1 time: 0.525779 Jul 12 11:52:02.841022 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 386/816] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:02 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1462 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:02.856310 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-afc75ff4-11a7-4ff2-b6a1-2c257c7e165c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:02.857796 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-afc75ff4-11a7-4ff2-b6a1-2c257c7e165c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:02.866858 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-afc75ff4-11a7-4ff2-b6a1-2c257c7e165c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:02.867321 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-afc75ff4-11a7-4ff2-b6a1-2c257c7e165c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:02.868527 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-afc75ff4-11a7-4ff2-b6a1-2c257c7e165c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:02.868975 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-afc75ff4-11a7-4ff2-b6a1-2c257c7e165c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:03.468091 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-afc75ff4-11a7-4ff2-b6a1-2c257c7e165c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:03.492401 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-afc75ff4-11a7-4ff2-b6a1-2c257c7e165c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1318 microversion: 2.1 time: 0.638698 Jul 12 11:52:03.507982 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 387/817] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:02 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1318 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:03.507982 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3c9cd381-431e-4760-9fbf-9865a619110b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:03.507982 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3c9cd381-431e-4760-9fbf-9865a619110b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:03.521758 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3c9cd381-431e-4760-9fbf-9865a619110b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:03.522210 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3c9cd381-431e-4760-9fbf-9865a619110b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:03.525997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3c9cd381-431e-4760-9fbf-9865a619110b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:03.529619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3c9cd381-431e-4760-9fbf-9865a619110b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:03.678944 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=11 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:03.936783 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=26 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:03.969586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4cec1836-b006-42f1-bac2-6e75253d38f5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:03.980564 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4cec1836-b006-42f1-bac2-6e75253d38f5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1503 microversion: 2.1 time: 1.746494 Jul 12 11:52:03.990064 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 431/818] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:02 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1503 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:04.015873 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-2ea5d7d0-c1b7-4a03-97de-6d3daf5348e0 req-b77f047e-8388-46ee-8155-ca9c44a353e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7763fa51-4518-440e-a663-f8dac78f536c", "name": "network-vif-plugged", "status": "completed", "tag": "d73d1c16-b3a0-4956-9a0d-4f206660a263"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:04.041536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-2ea5d7d0-c1b7-4a03-97de-6d3daf5348e0 req-b77f047e-8388-46ee-8155-ca9c44a353e2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:04.046440 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-2ea5d7d0-c1b7-4a03-97de-6d3daf5348e0 req-b77f047e-8388-46ee-8155-ca9c44a353e2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:04.085349 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-2ea5d7d0-c1b7-4a03-97de-6d3daf5348e0 req-b77f047e-8388-46ee-8155-ca9c44a353e2 service nova] Creating event network-vif-plugged:d73d1c16-b3a0-4956-9a0d-4f206660a263 for instance 7763fa51-4518-440e-a663-f8dac78f536c on n-h2-849104-4 Jul 12 11:52:04.103841 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-2ea5d7d0-c1b7-4a03-97de-6d3daf5348e0 req-b77f047e-8388-46ee-8155-ca9c44a353e2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111554 Jul 12 11:52:04.105592 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 432/819] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:04.414329 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-755719543", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": "none"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:04.497530 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3c9cd381-431e-4760-9fbf-9865a619110b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:04.507295 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:52:04.514211 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:52:04.514926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:52:04.515361 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:52:04.515831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:52:04.519316 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3c9cd381-431e-4760-9fbf-9865a619110b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1462 microversion: 2.1 time: 1.012122 Jul 12 11:52:04.522579 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 388/820] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:03 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1462 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:04.540859 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-1a60c304-fbce-47f4-b2a9-f79874632b38 req-1444b5c1-82ad-4bab-8ab5-b2b296828083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1556ea71-32c0-43d8-9a28-e364d25cc8e1", "tag": "42102276-b5d3-4916-a3fb-5ba8439f5c7f"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:04.541206 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:04.544215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:04.545244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:04.545902 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:04.579179 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-1a60c304-fbce-47f4-b2a9-f79874632b38 req-1444b5c1-82ad-4bab-8ab5-b2b296828083 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:04.580563 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-1a60c304-fbce-47f4-b2a9-f79874632b38 req-1444b5c1-82ad-4bab-8ab5-b2b296828083 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:04.615376 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-1a60c304-fbce-47f4-b2a9-f79874632b38 req-1444b5c1-82ad-4bab-8ab5-b2b296828083 service nova] Creating event network-changed:42102276-b5d3-4916-a3fb-5ba8439f5c7f for instance 1556ea71-32c0-43d8-9a28-e364d25cc8e1 on n-h2-849104-4 Jul 12 11:52:04.639093 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Getting quotas for project 06300144fd974eb3b3003142345c7e07. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:52:04.649854 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-1a60c304-fbce-47f4-b2a9-f79874632b38 req-1444b5c1-82ad-4bab-8ab5-b2b296828083 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125661 Jul 12 11:52:04.653332 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 389/821] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:04.656446 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Getting quotas for user 0b3ae8187fcb48639945e6c72ec89117 and project 06300144fd974eb3b3003142345c7e07. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:52:04.670032 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7a2da751-8270-4b6d-8ad3-448be50795cf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:04.678768 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7a2da751-8270-4b6d-8ad3-448be50795cf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:04.700355 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a2da751-8270-4b6d-8ad3-448be50795cf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:04.703295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a2da751-8270-4b6d-8ad3-448be50795cf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:04.704563 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a2da751-8270-4b6d-8ad3-448be50795cf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:04.705410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a2da751-8270-4b6d-8ad3-448be50795cf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:04.728238 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:52:04.754686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:52:04.878037 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-965a768f-6d34-4a1f-9b78-2684a5e22327 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.768460 Jul 12 11:52:04.889523 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 433/822] 10.222.0.50 () {62 vars in 1187 bytes} [Tue Jul 12 11:52:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 11:52:04.911247 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2682534c-a0b7-41c4-8d0c-cbffa772d809 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Action: 'create', calling method: .version_select at 0x7f5e0a1ecd30>, body: {"keypair": {"name": "tempest-keypair-1487431781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMAi50hNi82sE7+49I7KMFbnuWclKx+fPcHithCdc7oQo4qjZRfvkd98dDa2c5g+UQZZc91XYEjB6f0rjyEhgq8voT0TMkQq+yF6sjE0ddNGarvsHxNDDbSXeslmIfRsQ=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:04.932681 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-2682534c-a0b7-41c4-8d0c-cbffa772d809 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Getting quotas for project 4c6a6e22d13840698ada0866ea3f4913. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:52:04.941187 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-2682534c-a0b7-41c4-8d0c-cbffa772d809 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Getting quotas for user d42140cf6bac4674ba0515ca28531222 and project 4c6a6e22d13840698ada0866ea3f4913. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:52:04.971005 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2682534c-a0b7-41c4-8d0c-cbffa772d809 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079519 Jul 12 11:52:04.981252 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 434/823] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:52:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:04.987984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-055fdcd7-ef8f-4648-86af-6af6e63e0257 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:04.989980 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-055fdcd7-ef8f-4648-86af-6af6e63e0257 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:05.231744 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-055fdcd7-ef8f-4648-86af-6af6e63e0257 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:05.259257 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-055fdcd7-ef8f-4648-86af-6af6e63e0257 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:05.259257 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-055fdcd7-ef8f-4648-86af-6af6e63e0257 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:05.271089 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7a2da751-8270-4b6d-8ad3-448be50795cf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:05.273596 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-055fdcd7-ef8f-4648-86af-6af6e63e0257 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "PUT /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1358 microversion: 2.75 time: 0.290117 Jul 12 11:52:05.291138 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 435/824] 10.222.0.50 () {62 vars in 1296 bytes} [Tue Jul 12 11:52:04 2022] PUT /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1358 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:05.291138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-07440997-8502-471a-b2d6-6b081194eb71 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:05.291138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-07440997-8502-471a-b2d6-6b081194eb71 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:05.291438 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7a2da751-8270-4b6d-8ad3-448be50795cf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1318 microversion: 2.1 time: 0.631189 Jul 12 11:52:05.291438 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 390/825] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:04 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:05.308081 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-07440997-8502-471a-b2d6-6b081194eb71 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:05.311115 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-07440997-8502-471a-b2d6-6b081194eb71 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:05.311945 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-07440997-8502-471a-b2d6-6b081194eb71 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:05.321468 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-07440997-8502-471a-b2d6-6b081194eb71 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:05.325577 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fbf8ec86-ed82-4055-82c6-e60db02076d7 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:05.326248 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fbf8ec86-ed82-4055-82c6-e60db02076d7 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:05.495527 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fbf8ec86-ed82-4055-82c6-e60db02076d7 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:05.510256 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fbf8ec86-ed82-4055-82c6-e60db02076d7 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:05.520408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fbf8ec86-ed82-4055-82c6-e60db02076d7 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:05.546091 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fbf8ec86-ed82-4055-82c6-e60db02076d7 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1358 microversion: 2.75 time: 0.231656 Jul 12 11:52:05.547010 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 391/826] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:05 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:05.571986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-519183208", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ca965c2b-f164-481d-a4ff-46e4f8975b15"}], "security_groups": [{"name": "tempest-securitygroup--1785399954"}], "key_name": "tempest-keypair-1779531043", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:06.037396 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] validate_networks() for [('ca965c2b-f164-481d-a4ff-46e4f8975b15', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:52:06.250670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-07440997-8502-471a-b2d6-6b081194eb71 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:06.267902 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-07440997-8502-471a-b2d6-6b081194eb71 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1503 microversion: 2.1 time: 0.990866 Jul 12 11:52:06.276211 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 436/827] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:05 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1503 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:06.412070 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a7df9dd8-834c-4513-a612-4682f6f97d03 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] Action: 'create', calling method: .version_select at 0x7f5e0ac02160>, body: {"pool": null} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:07.304251 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Getting quotas for project 9a6547cfce324d3c88b883bbfa07d09f. Resources: dict_keys(['metadata_items']) {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:52:07.321923 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Getting quotas for user 03a182b0927742a89093649b1e0968fc and project 9a6547cfce324d3c88b883bbfa07d09f. Resources: dict_keys(['metadata_items']) {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:52:07.350497 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:52:07.351192 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:52:07.351867 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:52:07.352590 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:52:07.353313 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:52:07.369389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:07.370032 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:07.371032 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:07.380410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:07.421961 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:07.437297 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Getting quotas for project 9a6547cfce324d3c88b883bbfa07d09f. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:52:07.457166 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Getting quotas for user 03a182b0927742a89093649b1e0968fc and project 9a6547cfce324d3c88b883bbfa07d09f. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:52:07.487386 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:52:07.490909 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:52:07.606397 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a9c40b45-9ed4-4e1f-a345-10d547d91a0d tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.057659 Jul 12 11:52:07.612252 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 392/828] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:52:05 2022] POST /compute/v2.1/servers => generated 407 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:52:07.624901 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-002321d1-b4cc-42d9-ae49-325b7beb395e req-f7abd6fe-6195-43f2-967d-d467b0855a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1104fd7-f466-4f7c-a7a4-522be44fac3e", "name": "network-vif-plugged", "status": "completed", "tag": "73149cc5-5444-4d32-ae0a-bfbf4a70e8f3"}, {"server_uuid": "ad134105-4265-45f8-8844-8f1ddfbeea10", "name": "network-vif-plugged", "status": "completed", "tag": "85f8e57f-7584-4612-9d3a-a67d37236dcf"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:07.642220 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-002321d1-b4cc-42d9-ae49-325b7beb395e req-f7abd6fe-6195-43f2-967d-d467b0855a80 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:07.642664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-002321d1-b4cc-42d9-ae49-325b7beb395e req-f7abd6fe-6195-43f2-967d-d467b0855a80 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:07.697015 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-002321d1-b4cc-42d9-ae49-325b7beb395e req-f7abd6fe-6195-43f2-967d-d467b0855a80 service nova] Creating event network-vif-plugged:73149cc5-5444-4d32-ae0a-bfbf4a70e8f3 for instance e1104fd7-f466-4f7c-a7a4-522be44fac3e on n-h1-849104-4 Jul 12 11:52:07.697526 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-002321d1-b4cc-42d9-ae49-325b7beb395e req-f7abd6fe-6195-43f2-967d-d467b0855a80 service nova] Creating event network-vif-plugged:85f8e57f-7584-4612-9d3a-a67d37236dcf for instance ad134105-4265-45f8-8844-8f1ddfbeea10 on n-h1-849104-4 Jul 12 11:52:07.723050 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-002321d1-b4cc-42d9-ae49-325b7beb395e req-f7abd6fe-6195-43f2-967d-d467b0855a80 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.108328 Jul 12 11:52:07.724016 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 393/829] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:07.732615 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4ab5b367-6674-4501-90e7-d05d696cd85c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:07.733312 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4ab5b367-6674-4501-90e7-d05d696cd85c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:07.765823 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4ab5b367-6674-4501-90e7-d05d696cd85c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:07.775831 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4ab5b367-6674-4501-90e7-d05d696cd85c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:07.778532 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4ab5b367-6674-4501-90e7-d05d696cd85c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:07.784620 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4ab5b367-6674-4501-90e7-d05d696cd85c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:08.375994 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4ab5b367-6674-4501-90e7-d05d696cd85c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:08.385361 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4ab5b367-6674-4501-90e7-d05d696cd85c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1318 microversion: 2.1 time: 0.660099 Jul 12 11:52:08.385949 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 394/830] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:07 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:08.409004 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-3dfddcaf-cf19-47c3-8abe-fddef3421e2f req-c57f1ef0-305a-476d-9268-c6d92a71bda4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb218c5-ad4e-4287-b44f-1c77481559cb", "tag": "2af0933a-21e0-442c-8972-dc8f2b026a8f"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:08.428462 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-3dfddcaf-cf19-47c3-8abe-fddef3421e2f req-c57f1ef0-305a-476d-9268-c6d92a71bda4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:08.429255 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-3dfddcaf-cf19-47c3-8abe-fddef3421e2f req-c57f1ef0-305a-476d-9268-c6d92a71bda4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:08.453577 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-3dfddcaf-cf19-47c3-8abe-fddef3421e2f req-c57f1ef0-305a-476d-9268-c6d92a71bda4 service nova] Creating event network-changed:2af0933a-21e0-442c-8972-dc8f2b026a8f for instance bdb218c5-ad4e-4287-b44f-1c77481559cb on n-h2-849104-4 Jul 12 11:52:08.473812 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-3dfddcaf-cf19-47c3-8abe-fddef3421e2f req-c57f1ef0-305a-476d-9268-c6d92a71bda4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077473 Jul 12 11:52:08.474680 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 395/831] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:08.498561 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f7950bda-d072-4d51-aeb6-388d07b082dd tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:08.499969 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f7950bda-d072-4d51-aeb6-388d07b082dd tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:08.521906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f7950bda-d072-4d51-aeb6-388d07b082dd tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:08.523044 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f7950bda-d072-4d51-aeb6-388d07b082dd tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:08.524569 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f7950bda-d072-4d51-aeb6-388d07b082dd tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:08.527273 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f7950bda-d072-4d51-aeb6-388d07b082dd tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:08.808907 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f7950bda-d072-4d51-aeb6-388d07b082dd tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:08.819049 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f7950bda-d072-4d51-aeb6-388d07b082dd tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:08.825958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f7950bda-d072-4d51-aeb6-388d07b082dd tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:08.847213 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f7950bda-d072-4d51-aeb6-388d07b082dd tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1416 microversion: 2.75 time: 0.367197 Jul 12 11:52:08.848189 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 396/832] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:08 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1416 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:08.863469 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5014f540-281a-4303-8975-d5e78810432e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:08.865544 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5014f540-281a-4303-8975-d5e78810432e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:08.889837 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5014f540-281a-4303-8975-d5e78810432e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:08.890548 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5014f540-281a-4303-8975-d5e78810432e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:08.898250 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5014f540-281a-4303-8975-d5e78810432e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:08.900843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5014f540-281a-4303-8975-d5e78810432e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:09.313995 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5014f540-281a-4303-8975-d5e78810432e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:09.323747 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5014f540-281a-4303-8975-d5e78810432e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1503 microversion: 2.1 time: 0.474257 Jul 12 11:52:09.335345 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 397/833] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:08 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1503 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:09.341550 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7c664ef6-bc40-4d65-83bd-a218978f4eec tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:09.342357 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7c664ef6-bc40-4d65-83bd-a218978f4eec tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:09.349494 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c664ef6-bc40-4d65-83bd-a218978f4eec tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:09.350169 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c664ef6-bc40-4d65-83bd-a218978f4eec tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:09.351115 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c664ef6-bc40-4d65-83bd-a218978f4eec tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:09.351706 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c664ef6-bc40-4d65-83bd-a218978f4eec tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:09.551996 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7c664ef6-bc40-4d65-83bd-a218978f4eec tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:09.578889 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7c664ef6-bc40-4d65-83bd-a218978f4eec tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1265 microversion: 2.1 time: 0.234428 Jul 12 11:52:09.581147 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 398/834] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:09 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:09.597284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-17af8307-b699-4f14-8374-0a174021f442 req-b0ef0e63-b989-4897-8548-2c4be27f4f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1556ea71-32c0-43d8-9a28-e364d25cc8e1", "name": "network-vif-unplugged", "status": "completed", "tag": "42102276-b5d3-4916-a3fb-5ba8439f5c7f"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:09.615812 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-17af8307-b699-4f14-8374-0a174021f442 req-b0ef0e63-b989-4897-8548-2c4be27f4f0f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:09.617633 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-17af8307-b699-4f14-8374-0a174021f442 req-b0ef0e63-b989-4897-8548-2c4be27f4f0f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:09.663610 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-17af8307-b699-4f14-8374-0a174021f442 req-b0ef0e63-b989-4897-8548-2c4be27f4f0f service nova] Creating event network-vif-unplugged:42102276-b5d3-4916-a3fb-5ba8439f5c7f for instance 1556ea71-32c0-43d8-9a28-e364d25cc8e1 on n-h2-849104-4 Jul 12 11:52:09.678402 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-17af8307-b699-4f14-8374-0a174021f442 req-b0ef0e63-b989-4897-8548-2c4be27f4f0f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094386 Jul 12 11:52:09.679745 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 399/835] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:09.692763 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7186b705-b4d3-416e-a1e8-9f09b4651f54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:09.697041 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7186b705-b4d3-416e-a1e8-9f09b4651f54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:09.716679 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7186b705-b4d3-416e-a1e8-9f09b4651f54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:09.717450 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7186b705-b4d3-416e-a1e8-9f09b4651f54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:09.718881 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7186b705-b4d3-416e-a1e8-9f09b4651f54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:09.719334 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7186b705-b4d3-416e-a1e8-9f09b4651f54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:09.918266 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a7df9dd8-834c-4513-a612-4682f6f97d03 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.640021 Jul 12 11:52:09.918905 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 437/836] 10.222.0.50 () {60 vars in 1169 bytes} [Tue Jul 12 11:52:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:09.932948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8f9225e3-1360-4d70-ac45-46a71baea61a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:09.933572 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8f9225e3-1360-4d70-ac45-46a71baea61a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:09.942492 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8f9225e3-1360-4d70-ac45-46a71baea61a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:09.943255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8f9225e3-1360-4d70-ac45-46a71baea61a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:09.944274 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8f9225e3-1360-4d70-ac45-46a71baea61a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:09.944884 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8f9225e3-1360-4d70-ac45-46a71baea61a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:09.948880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:10.154989 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8f9225e3-1360-4d70-ac45-46a71baea61a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:10.168739 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8f9225e3-1360-4d70-ac45-46a71baea61a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:10.170954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8f9225e3-1360-4d70-ac45-46a71baea61a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:10.179305 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8f9225e3-1360-4d70-ac45-46a71baea61a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1416 microversion: 2.75 time: 0.258454 Jul 12 11:52:10.179967 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 438/837] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:09 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1416 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:10.187016 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-10c90996-7877-41b1-84af-b9875adeb9a7 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] Calling method '.version_select at 0x7f5e0a19b430>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:10.524788 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-10c90996-7877-41b1-84af-b9875adeb9a7 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/751b3ae8-8646-4dc2-9033-16718da10541" status: 200 len: 142 microversion: 2.1 time: 0.342757 Jul 12 11:52:10.526407 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 439/838] 10.222.0.50 () {58 vars in 1259 bytes} [Tue Jul 12 11:52:10 2022] GET /compute/v2.1/os-floating-ips/751b3ae8-8646-4dc2-9033-16718da10541 => generated 142 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:10.533501 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-eaabe4b2-e1a9-4a31-a131-388f24a13614 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:10.534658 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-eaabe4b2-e1a9-4a31-a131-388f24a13614 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:10.547759 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eaabe4b2-e1a9-4a31-a131-388f24a13614 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:10.549297 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eaabe4b2-e1a9-4a31-a131-388f24a13614 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:10.551106 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eaabe4b2-e1a9-4a31-a131-388f24a13614 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:10.552280 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eaabe4b2-e1a9-4a31-a131-388f24a13614 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:10.723706 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7186b705-b4d3-416e-a1e8-9f09b4651f54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:10.748171 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7186b705-b4d3-416e-a1e8-9f09b4651f54 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1318 microversion: 2.1 time: 1.065346 Jul 12 11:52:10.754011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-eaabe4b2-e1a9-4a31-a131-388f24a13614 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:10.760533 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 400/839] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:09 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1318 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:10.769851 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-eaabe4b2-e1a9-4a31-a131-388f24a13614 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1503 microversion: 2.1 time: 0.241774 Jul 12 11:52:10.770302 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-dfd7e349-a5da-4d68-aa70-6a5830da2ee6 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] Calling method '.version_select at 0x7f5e0b100430>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:10.771428 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 440/840] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:10 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:10.784681 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b770fbd9-66bb-4438-8463-42084169f8a5 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:10.786117 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b770fbd9-66bb-4438-8463-42084169f8a5 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:10.798008 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b770fbd9-66bb-4438-8463-42084169f8a5 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:10.798792 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b770fbd9-66bb-4438-8463-42084169f8a5 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:10.800815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b770fbd9-66bb-4438-8463-42084169f8a5 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:10.801810 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b770fbd9-66bb-4438-8463-42084169f8a5 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:10.932753 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b770fbd9-66bb-4438-8463-42084169f8a5 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:10.955757 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b770fbd9-66bb-4438-8463-42084169f8a5 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1327 microversion: 2.1 time: 0.181066 Jul 12 11:52:10.968561 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 441/841] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:10 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1327 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:11.205383 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-eed4144d-56fd-4c12-ade1-114a61b14b77 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:11.206881 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-eed4144d-56fd-4c12-ade1-114a61b14b77 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:11.227979 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eed4144d-56fd-4c12-ade1-114a61b14b77 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:11.229886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eed4144d-56fd-4c12-ade1-114a61b14b77 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:11.232533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eed4144d-56fd-4c12-ade1-114a61b14b77 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:11.233709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eed4144d-56fd-4c12-ade1-114a61b14b77 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:11.440729 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-eed4144d-56fd-4c12-ade1-114a61b14b77 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:11.463188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-eed4144d-56fd-4c12-ade1-114a61b14b77 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:11.469211 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-eed4144d-56fd-4c12-ade1-114a61b14b77 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:11.480934 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-eed4144d-56fd-4c12-ade1-114a61b14b77 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1416 microversion: 2.75 time: 0.282084 Jul 12 11:52:11.482621 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 442/842] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:11 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1416 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:52:11.582336 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-dfd7e349-a5da-4d68-aa70-6a5830da2ee6 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.820009 Jul 12 11:52:11.584416 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 401/843] 10.222.0.50 () {58 vars in 1148 bytes} [Tue Jul 12 11:52:10 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:11.599189 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e26cae26-b7a2-42a6-84b0-f485ba311c9d tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] Calling method '.version_select at 0x7f5e0ac0e280>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:11.780482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-394a1fcc-6021-47ef-a08d-02c2281d41cc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:11.782085 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-394a1fcc-6021-47ef-a08d-02c2281d41cc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:11.794819 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-394a1fcc-6021-47ef-a08d-02c2281d41cc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:11.795968 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-394a1fcc-6021-47ef-a08d-02c2281d41cc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:11.797636 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-394a1fcc-6021-47ef-a08d-02c2281d41cc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:11.798883 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-394a1fcc-6021-47ef-a08d-02c2281d41cc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:12.203709 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-394a1fcc-6021-47ef-a08d-02c2281d41cc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:12.227675 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-394a1fcc-6021-47ef-a08d-02c2281d41cc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1467 microversion: 2.1 time: 0.453254 Jul 12 11:52:12.230461 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 402/844] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:11 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1467 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:12.240446 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-033c20cf-60fc-4fff-bfb4-c6ad63d85972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:12.241911 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-033c20cf-60fc-4fff-bfb4-c6ad63d85972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:12.257962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-033c20cf-60fc-4fff-bfb4-c6ad63d85972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:12.260842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-033c20cf-60fc-4fff-bfb4-c6ad63d85972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:12.264697 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-033c20cf-60fc-4fff-bfb4-c6ad63d85972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:12.267206 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-033c20cf-60fc-4fff-bfb4-c6ad63d85972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:12.693456 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-033c20cf-60fc-4fff-bfb4-c6ad63d85972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:12.708087 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-033c20cf-60fc-4fff-bfb4-c6ad63d85972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1478 microversion: 2.1 time: 0.474807 Jul 12 11:52:12.709709 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 403/845] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:12 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1478 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:12.716277 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6911930d-b987-4011-8810-671cde80fcdf tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Calling method '.version_select at 0x7f5e0b0b2310>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:12.719171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6911930d-b987-4011-8810-671cde80fcdf tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:12.720015 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6911930d-b987-4011-8810-671cde80fcdf tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:12.730776 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6911930d-b987-4011-8810-671cde80fcdf tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.019714 Jul 12 11:52:12.740158 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 404/846] 10.222.0.50 () {58 vars in 1142 bytes} [Tue Jul 12 11:52:12 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:12.759456 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-43bbe6bf-299e-4958-94e3-aa3ba0dbd703 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:12.762686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-43bbe6bf-299e-4958-94e3-aa3ba0dbd703 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:12.780016 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-43bbe6bf-299e-4958-94e3-aa3ba0dbd703 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:12.781749 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-43bbe6bf-299e-4958-94e3-aa3ba0dbd703 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:12.785399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-43bbe6bf-299e-4958-94e3-aa3ba0dbd703 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:12.786257 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-43bbe6bf-299e-4958-94e3-aa3ba0dbd703 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:13.060158 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e26cae26-b7a2-42a6-84b0-f485ba311c9d tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/751b3ae8-8646-4dc2-9033-16718da10541" status: 202 len: 0 microversion: 2.1 time: 1.464298 Jul 12 11:52:13.070513 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 443/847] 10.222.0.50 () {58 vars in 1262 bytes} [Tue Jul 12 11:52:11 2022] DELETE /compute/v2.1/os-floating-ips/751b3ae8-8646-4dc2-9033-16718da10541 => generated 0 bytes in 1476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 11:52:13.079948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-83a06810-07c9-48cc-9a62-46bc40009647 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:13.080737 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-83a06810-07c9-48cc-9a62-46bc40009647 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7763fa51-4518-440e-a663-f8dac78f536c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:13.088800 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83a06810-07c9-48cc-9a62-46bc40009647 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:13.089658 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83a06810-07c9-48cc-9a62-46bc40009647 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:13.090565 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83a06810-07c9-48cc-9a62-46bc40009647 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:13.091665 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83a06810-07c9-48cc-9a62-46bc40009647 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:13.109877 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-43bbe6bf-299e-4958-94e3-aa3ba0dbd703 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:13.123574 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-43bbe6bf-299e-4958-94e3-aa3ba0dbd703 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1395 microversion: 2.1 time: 0.376869 Jul 12 11:52:13.129229 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 405/848] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:12 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1395 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:13.137394 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-094286c8-9b54-4baa-ac5c-e01cefa27fbf tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:13.138303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-094286c8-9b54-4baa-ac5c-e01cefa27fbf tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:13.146208 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-094286c8-9b54-4baa-ac5c-e01cefa27fbf tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:13.146973 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-094286c8-9b54-4baa-ac5c-e01cefa27fbf tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:13.148560 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-094286c8-9b54-4baa-ac5c-e01cefa27fbf tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:13.149459 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-094286c8-9b54-4baa-ac5c-e01cefa27fbf tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:13.262735 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-094286c8-9b54-4baa-ac5c-e01cefa27fbf tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:13.281725 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-094286c8-9b54-4baa-ac5c-e01cefa27fbf tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:13.285331 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-094286c8-9b54-4baa-ac5c-e01cefa27fbf tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:13.295890 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-094286c8-9b54-4baa-ac5c-e01cefa27fbf tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1437 microversion: 2.75 time: 0.169180 Jul 12 11:52:13.308080 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 406/849] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:13 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1437 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:13.308080 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0d31ea86-6e8f-4bdd-9136-f912a7423f0c tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '.version_select at 0x7f5e0b291280>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:13.312352 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0d31ea86-6e8f-4bdd-9136-f912a7423f0c tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:13.313403 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0d31ea86-6e8f-4bdd-9136-f912a7423f0c tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:13.338365 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-83a06810-07c9-48cc-9a62-46bc40009647 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:13.350383 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-83a06810-07c9-48cc-9a62-46bc40009647 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c" status: 200 len: 1468 microversion: 2.1 time: 0.277923 Jul 12 11:52:13.351184 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 444/850] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:13 2022] GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c => generated 1468 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:13.354226 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0d31ea86-6e8f-4bdd-9136-f912a7423f0c tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.054889 Jul 12 11:52:13.358569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1fff9e7a-f533-4982-a4f2-61c3d06a15c5 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:13.361977 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 407/851] 10.222.0.50 () {58 vars in 1142 bytes} [Tue Jul 12 11:52:13 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:13.384680 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1fff9e7a-f533-4982-a4f2-61c3d06a15c5 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030771 Jul 12 11:52:13.384897 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1d249cf4-7006-4590-b62a-f7e8a1ef7ce2 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] Action: 'create', calling method: .version_select at 0x7f5e11b88dc0>, body: {"pool": null} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:13.387337 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 445/852] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:52:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:13.400498 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:13.403228 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:13.409036 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:13.416212 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:13.417038 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:13.418421 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:13.419254 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:13.564938 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:52:13.565672 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:52:13.566533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:52:13.567165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:52:13.567778 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:52:13.665813 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:13.677501 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:13.678340 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:13.679772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:13.681264 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:13.788264 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:13.804336 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:13.808441 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:13.820249 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-27436be9-28d8-4d16-a7b0-a670000664d1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "POST /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724/action" status: 202 len: 1494 microversion: 2.75 time: 0.430250 Jul 12 11:52:13.821391 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 446/853] 10.222.0.50 () {62 vars in 1318 bytes} [Tue Jul 12 11:52:13 2022] POST /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724/action => generated 1494 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 12 11:52:13.833329 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fb6490c4-f9bd-45a5-bf04-6281d95a007b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:13.841407 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fb6490c4-f9bd-45a5-bf04-6281d95a007b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:13.843599 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fb6490c4-f9bd-45a5-bf04-6281d95a007b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Searching by: {'reservation_id': 'r-23yylx90', 'deleted': False, 'project_id': '810246cfc801446599831d243d3a48dd'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 11:52:13.853262 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb6490c4-f9bd-45a5-bf04-6281d95a007b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:13.854410 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb6490c4-f9bd-45a5-bf04-6281d95a007b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:13.856417 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb6490c4-f9bd-45a5-bf04-6281d95a007b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:13.857245 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb6490c4-f9bd-45a5-bf04-6281d95a007b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:14.008210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-fb6490c4-f9bd-45a5-bf04-6281d95a007b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 11:52:14.104807 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fb6490c4-f9bd-45a5-bf04-6281d95a007b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:14.115464 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb6490c4-f9bd-45a5-bf04-6281d95a007b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:14.115956 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb6490c4-f9bd-45a5-bf04-6281d95a007b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:14.310733 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fb6490c4-f9bd-45a5-bf04-6281d95a007b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?reservation_id=r-23yylx90" status: 200 len: 2928 microversion: 2.1 time: 0.486840 Jul 12 11:52:14.311707 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 447/854] 10.222.0.50 () {58 vars in 1196 bytes} [Tue Jul 12 11:52:13 2022] GET /compute/v2.1/servers/detail?reservation_id=r-23yylx90 => generated 2928 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:14.319865 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fae03c9f-b85d-4b08-8376-0afe9e2d4945 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:14.320853 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fae03c9f-b85d-4b08-8376-0afe9e2d4945 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:14.331353 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fae03c9f-b85d-4b08-8376-0afe9e2d4945 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:14.331818 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fae03c9f-b85d-4b08-8376-0afe9e2d4945 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:14.333734 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fae03c9f-b85d-4b08-8376-0afe9e2d4945 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:14.333734 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fae03c9f-b85d-4b08-8376-0afe9e2d4945 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:14.505266 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fae03c9f-b85d-4b08-8376-0afe9e2d4945 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1629 microversion: 2.1 time: 0.192149 Jul 12 11:52:14.516633 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 448/855] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:14 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1629 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:14.516633 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a082b277-abc8-446a-a8d4-bf2b7ed60b2d tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-465761821", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:14.516633 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:52:14.516633 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:52:14.535368 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a082b277-abc8-446a-a8d4-bf2b7ed60b2d tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.028329 Jul 12 11:52:14.536140 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 449/856] 10.222.0.50 () {60 vars in 1145 bytes} [Tue Jul 12 11:52:14 2022] POST /compute/v2.1/flavors => generated 498 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:14.546327 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1f8b9bf1-2eee-40f4-895f-bb9ee8a53176 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:14.546942 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1f8b9bf1-2eee-40f4-895f-bb9ee8a53176 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:14.553240 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1f8b9bf1-2eee-40f4-895f-bb9ee8a53176 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:14.553831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1f8b9bf1-2eee-40f4-895f-bb9ee8a53176 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:14.554747 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1f8b9bf1-2eee-40f4-895f-bb9ee8a53176 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:14.555081 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1f8b9bf1-2eee-40f4-895f-bb9ee8a53176 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:14.632690 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1f8b9bf1-2eee-40f4-895f-bb9ee8a53176 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:14.641299 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1f8b9bf1-2eee-40f4-895f-bb9ee8a53176 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:14.642968 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1f8b9bf1-2eee-40f4-895f-bb9ee8a53176 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:14.648475 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1f8b9bf1-2eee-40f4-895f-bb9ee8a53176 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.106502 Jul 12 11:52:14.649203 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 450/857] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:14 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:14.657048 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d9a2e262-e596-449a-9446-4cec0cf38451 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:14.657048 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d9a2e262-e596-449a-9446-4cec0cf38451 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:14.661508 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9a2e262-e596-449a-9446-4cec0cf38451 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:14.661890 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9a2e262-e596-449a-9446-4cec0cf38451 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:14.662847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9a2e262-e596-449a-9446-4cec0cf38451 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:14.663559 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9a2e262-e596-449a-9446-4cec0cf38451 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:14.818512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d9a2e262-e596-449a-9446-4cec0cf38451 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:14.829353 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d9a2e262-e596-449a-9446-4cec0cf38451 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1395 microversion: 2.1 time: 0.178982 Jul 12 11:52:14.830758 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 451/858] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:14 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1395 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:14.841859 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e305f0ea-6669-4f2b-9d70-3e4a1902a914 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:14.874026 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.compute.server_groups [None req-e305f0ea-6669-4f2b-9d70-3e4a1902a914 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Querying cell dd950407-7fc7-406c-84b0-4304624ff8c8(cell1) for 2 instances {{(pid=125984) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 12 11:52:14.874843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e305f0ea-6669-4f2b-9d70-3e4a1902a914 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:14.875326 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e305f0ea-6669-4f2b-9d70-3e4a1902a914 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:14.931497 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e305f0ea-6669-4f2b-9d70-3e4a1902a914 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/d859ea45-6a4e-4de9-aef3-6a8c9812cb9a" status: 200 len: 270 microversion: 2.1 time: 0.098622 Jul 12 11:52:14.933198 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 452/859] 10.222.0.50 () {58 vars in 1262 bytes} [Tue Jul 12 11:52:14 2022] GET /compute/v2.1/os-server-groups/d859ea45-6a4e-4de9-aef3-6a8c9812cb9a => generated 270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:14.949658 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-69e4e7af-1b34-4630-93fe-bff31b97d882 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Action: 'create', calling method: .version_select at 0x7f5e0a71f430>, body: {"keypair": {"name": "tempest-keypair-332021802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlEd1TEvRv/hvUcx6mezXU6WkmUAq1m7ttTaemD3VPitouuhGA1KRkJYIzWZy6BWMvyF4eMqg4YINngZJEigWZNTCvEqUQjOjtC1AaPGexQNR3ETXNang/p7YNRe9RTUg=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:14.969762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-69e4e7af-1b34-4630-93fe-bff31b97d882 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Getting quotas for project d9393a32f934440e975f62b7d59eed32. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:52:14.975865 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-69e4e7af-1b34-4630-93fe-bff31b97d882 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Getting quotas for user 86ca9c0d2f474f1f9c35aaf5fb9c6064 and project d9393a32f934440e975f62b7d59eed32. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:52:15.003911 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-69e4e7af-1b34-4630-93fe-bff31b97d882 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059603 Jul 12 11:52:15.006153 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 453/860] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:52:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:15.011255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-55e69a9c-e1f5-439b-875c-4abede4ee5fc tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:15.026985 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-55e69a9c-e1f5-439b-875c-4abede4ee5fc tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017888 Jul 12 11:52:15.029597 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 454/861] 10.222.0.50 () {58 vars in 1181 bytes} [Tue Jul 12 11:52:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:52:15.044438 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-15388c18-2fbc-4a13-baca-4867534b59e9 req-67dcd074-2e3b-4375-b8c0-f1f43ff6a8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72", "tag": "827f4044-3788-44c6-9411-c923971bf9c5"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:15.056560 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-15388c18-2fbc-4a13-baca-4867534b59e9 req-67dcd074-2e3b-4375-b8c0-f1f43ff6a8c1 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:15.057091 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-15388c18-2fbc-4a13-baca-4867534b59e9 req-67dcd074-2e3b-4375-b8c0-f1f43ff6a8c1 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:15.072169 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-15388c18-2fbc-4a13-baca-4867534b59e9 req-67dcd074-2e3b-4375-b8c0-f1f43ff6a8c1 service nova] Creating event network-changed:827f4044-3788-44c6-9411-c923971bf9c5 for instance fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 on n-h1-849104-4 Jul 12 11:52:15.079122 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-15388c18-2fbc-4a13-baca-4867534b59e9 req-67dcd074-2e3b-4375-b8c0-f1f43ff6a8c1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047572 Jul 12 11:52:15.080669 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 455/862] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:15.088613 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8db24e97-b63b-4453-96d3-90e11cefe45a tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:15.089322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8db24e97-b63b-4453-96d3-90e11cefe45a tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] [instance: 7763fa51-4518-440e-a663-f8dac78f536c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:15.096559 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8db24e97-b63b-4453-96d3-90e11cefe45a tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:15.097242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8db24e97-b63b-4453-96d3-90e11cefe45a tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:15.098178 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8db24e97-b63b-4453-96d3-90e11cefe45a tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:15.098817 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8db24e97-b63b-4453-96d3-90e11cefe45a tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:15.384729 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8db24e97-b63b-4453-96d3-90e11cefe45a tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c" status: 200 len: 1619 microversion: 2.1 time: 0.302379 Jul 12 11:52:15.399531 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 456/863] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:15 2022] GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c => generated 1619 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:15.399531 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-645556321", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "99584907-24af-440f-aca4-b873a3768d9a"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:15.487621 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] validate_networks() for None {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:52:15.980778 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:52:15.981346 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:52:15.981860 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:52:15.982243 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:52:15.982664 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:52:15.996867 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:15.998054 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:15.998870 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:15.999314 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:16.020356 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Getting quotas for project 4c6a6e22d13840698ada0866ea3f4913. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:52:16.027108 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Getting quotas for user d42140cf6bac4674ba0515ca28531222 and project 4c6a6e22d13840698ada0866ea3f4913. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:52:16.042226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:52:16.044661 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:52:16.097971 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-02001c4b-2680-4a42-9d8b-c9390aace1e9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711180 Jul 12 11:52:16.099475 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 457/864] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:52:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:52:16.114511 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-29bd89d9-37c1-4845-afe0-3c71ad43552c tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:16.117311 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-29bd89d9-37c1-4845-afe0-3c71ad43552c tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:16.132965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-29bd89d9-37c1-4845-afe0-3c71ad43552c tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:16.133932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-29bd89d9-37c1-4845-afe0-3c71ad43552c tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:16.135921 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-29bd89d9-37c1-4845-afe0-3c71ad43552c tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:16.136765 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-29bd89d9-37c1-4845-afe0-3c71ad43552c tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:16.340865 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1d249cf4-7006-4590-b62a-f7e8a1ef7ce2 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.974479 Jul 12 11:52:16.342367 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 408/865] 10.222.0.50 () {60 vars in 1169 bytes} [Tue Jul 12 11:52:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:16.350568 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-18fc3d53-a5a4-4766-ad1b-ada02675de8c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:16.351396 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-18fc3d53-a5a4-4766-ad1b-ada02675de8c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:16.362498 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-18fc3d53-a5a4-4766-ad1b-ada02675de8c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:16.364377 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-18fc3d53-a5a4-4766-ad1b-ada02675de8c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:16.366001 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-18fc3d53-a5a4-4766-ad1b-ada02675de8c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:16.366782 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-18fc3d53-a5a4-4766-ad1b-ada02675de8c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:16.478494 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-18fc3d53-a5a4-4766-ad1b-ada02675de8c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:16.494423 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-18fc3d53-a5a4-4766-ad1b-ada02675de8c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:16.498165 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-18fc3d53-a5a4-4766-ad1b-ada02675de8c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:16.508561 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-18fc3d53-a5a4-4766-ad1b-ada02675de8c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.164432 Jul 12 11:52:16.524795 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 409/866] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:16 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:16.536869 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-29bd89d9-37c1-4845-afe0-3c71ad43552c tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 200 len: 1618 microversion: 2.1 time: 0.435387 Jul 12 11:52:16.542612 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9f042fa5-1cd5-4c5d-9718-145fd5abd716 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:16.543771 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9f042fa5-1cd5-4c5d-9718-145fd5abd716 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:16.548255 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 458/867] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:16 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 1618 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:16.558652 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9f042fa5-1cd5-4c5d-9718-145fd5abd716 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:16.561107 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9f042fa5-1cd5-4c5d-9718-145fd5abd716 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:16.562551 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9f042fa5-1cd5-4c5d-9718-145fd5abd716 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:16.563362 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9f042fa5-1cd5-4c5d-9718-145fd5abd716 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:16.580166 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-adb92e3a-146e-4efb-93e6-92d29564ec25 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:16.585049 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-adb92e3a-146e-4efb-93e6-92d29564ec25 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:16.846843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9f042fa5-1cd5-4c5d-9718-145fd5abd716 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:16.851139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:16.862753 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9f042fa5-1cd5-4c5d-9718-145fd5abd716 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1395 microversion: 2.1 time: 0.336037 Jul 12 11:52:16.864153 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 410/868] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:16 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1395 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:16.874315 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ffb9e8b9-f1b2-48b6-af16-3e842ffe6521 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] Calling method '.version_select at 0x7f5e0b0599d0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:16.960772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-adb92e3a-146e-4efb-93e6-92d29564ec25 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:16.978264 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-adb92e3a-146e-4efb-93e6-92d29564ec25 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1278 microversion: 2.1 time: 0.428092 Jul 12 11:52:16.980842 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 459/869] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:16 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1278 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:17.000015 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a8016a41-5c68-4353-b741-7f103f178b18 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:17.001111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a8016a41-5c68-4353-b741-7f103f178b18 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:17.014681 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a8016a41-5c68-4353-b741-7f103f178b18 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:17.015527 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a8016a41-5c68-4353-b741-7f103f178b18 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:17.017113 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a8016a41-5c68-4353-b741-7f103f178b18 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:17.017810 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a8016a41-5c68-4353-b741-7f103f178b18 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:17.047068 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:17.071692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a8016a41-5c68-4353-b741-7f103f178b18 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:52:17.227227 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a8016a41-5c68-4353-b741-7f103f178b18 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 204 len: 0 microversion: 2.1 time: 0.242912 Jul 12 11:52:17.236173 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 460/870] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:52:16 2022] DELETE /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:52:17.248721 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1629980565", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "df49a9f0-90aa-4bd7-91c8-1df741ab59a3"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:17.379404 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] validate_networks() for None {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:52:17.409661 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:17.471545 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=12 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:17.874250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:52:17.878188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:52:17.879636 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:52:17.880114 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:52:17.881091 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:52:17.899461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:17.900375 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:17.901722 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:17.902851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:17.929028 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:52:17.940988 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:52:17.954926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:52:17.957355 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:52:18.027536 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a3f4ed47-026e-4045-8037-b0b21eccf7c7 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788440 Jul 12 11:52:18.029136 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 461/871] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:52:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:52:18.036606 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1530609022", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "1512588295", "adminPass": "***", "networks": [{"uuid": "98e42d9e-f92f-4dc1-a841-97dff5f12b22"}], "security_groups": [{"name": "tempest-securitygroup--554754351"}], "key_name": "tempest-keypair-1689767150", "user_data": "}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:18.176850 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] validate_networks() for [('98e42d9e-f92f-4dc1-a841-97dff5f12b22', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:52:18.515379 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ffb9e8b9-f1b2-48b6-af16-3e842ffe6521 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e" status: 202 len: 0 microversion: 2.1 time: 1.649297 Jul 12 11:52:18.516131 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 411/872] 10.222.0.50 () {58 vars in 1262 bytes} [Tue Jul 12 11:52:16 2022] DELETE /compute/v2.1/os-floating-ips/ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e => generated 0 bytes in 1651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:52:18.521042 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-12fa517e-b745-41e7-b6a8-9593f0b8f943 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:18.521665 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-12fa517e-b745-41e7-b6a8-9593f0b8f943 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:18.531031 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-12fa517e-b745-41e7-b6a8-9593f0b8f943 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:18.531491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-12fa517e-b745-41e7-b6a8-9593f0b8f943 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:18.532533 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-12fa517e-b745-41e7-b6a8-9593f0b8f943 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:18.532975 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-12fa517e-b745-41e7-b6a8-9593f0b8f943 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:18.626345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-12fa517e-b745-41e7-b6a8-9593f0b8f943 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:18.639851 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-12fa517e-b745-41e7-b6a8-9593f0b8f943 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:18.642665 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-12fa517e-b745-41e7-b6a8-9593f0b8f943 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:18.653933 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-12fa517e-b745-41e7-b6a8-9593f0b8f943 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.136843 Jul 12 11:52:18.655606 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 412/873] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:18 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:18.659680 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b46b140c-3ec8-4c0e-ae66-83ed686a55ee tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:18.660383 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b46b140c-3ec8-4c0e-ae66-83ed686a55ee tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:18.666482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b46b140c-3ec8-4c0e-ae66-83ed686a55ee tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:18.667146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b46b140c-3ec8-4c0e-ae66-83ed686a55ee tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:18.668113 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b46b140c-3ec8-4c0e-ae66-83ed686a55ee tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:18.668742 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b46b140c-3ec8-4c0e-ae66-83ed686a55ee tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:18.687021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:52:18.688269 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:52:18.689093 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:52:18.689607 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:52:18.690685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:52:18.701743 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:18.702199 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:18.703016 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:18.703460 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:18.722445 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Getting quotas for project 1394824ad6fd4ef686fafb5fb3c0b4e1. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:52:18.724982 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:18.729505 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Getting quotas for user 02fcbf37964b49dfb597a4a1e95a299c and project 1394824ad6fd4ef686fafb5fb3c0b4e1. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:52:18.751183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:52:18.754693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:52:18.807162 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c8525efe-2b2d-4eb9-aac3-21b360ef5738 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.776229 Jul 12 11:52:18.812791 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 462/874] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:52:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:52:18.813023 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fc3af334-9380-4ccf-bc94-aa2dbedd0968 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:18.813610 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fc3af334-9380-4ccf-bc94-aa2dbedd0968 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:18.823579 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc3af334-9380-4ccf-bc94-aa2dbedd0968 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:18.824766 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc3af334-9380-4ccf-bc94-aa2dbedd0968 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:18.826476 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc3af334-9380-4ccf-bc94-aa2dbedd0968 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:18.827279 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc3af334-9380-4ccf-bc94-aa2dbedd0968 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:18.851410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b46b140c-3ec8-4c0e-ae66-83ed686a55ee tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:18.860800 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b46b140c-3ec8-4c0e-ae66-83ed686a55ee tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1395 microversion: 2.1 time: 0.204394 Jul 12 11:52:18.861595 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 413/875] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:18 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1395 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:18.866744 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7b91b0fe-d8ae-47a8-9282-83ec066c0c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:18.867416 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7b91b0fe-d8ae-47a8-9282-83ec066c0c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:18.876426 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7b91b0fe-d8ae-47a8-9282-83ec066c0c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:18.876875 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7b91b0fe-d8ae-47a8-9282-83ec066c0c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:18.877664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7b91b0fe-d8ae-47a8-9282-83ec066c0c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:18.878106 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7b91b0fe-d8ae-47a8-9282-83ec066c0c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:18.918543 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fc3af334-9380-4ccf-bc94-aa2dbedd0968 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:18.935771 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fc3af334-9380-4ccf-bc94-aa2dbedd0968 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1338 microversion: 2.1 time: 0.126781 Jul 12 11:52:18.937297 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 463/876] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:18 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1338 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:18.951306 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2002732258", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "d3804aae-e5e6-40af-a993-2653361ea3e0"}], "security_groups": [{"name": "tempest-securitygroup--1980279036"}], "key_name": "tempest-keypair-332021802", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:18.964582 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7b91b0fe-d8ae-47a8-9282-83ec066c0c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:18.977313 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7b91b0fe-d8ae-47a8-9282-83ec066c0c39 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1221 microversion: 2.1 time: 0.114466 Jul 12 11:52:18.978128 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 414/877] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:18 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:18.984959 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fcfb8255-062c-48b2-b692-6eaa6464e5a3 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] Calling method '.version_select at 0x7f5e0b2914c0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:19.034841 n-d-849104-4 devstack@n-api.service[125983]: DEBUG neutronclient.v2_0.client [None req-fcfb8255-062c-48b2-b692-6eaa6464e5a3 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e could not be found", "detail": ""}} {{(pid=125983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 12 11:52:19.036208 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-fcfb8255-062c-48b2-b692-6eaa6464e5a3 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] HTTP exception thrown: Floating IP not found for ID ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fcfb8255-062c-48b2-b692-6eaa6464e5a3 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] Request method failure captured: Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-floating-ips/ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e HTTP/1.1 Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWBlmN_ls8teCiue49mH2wiz_UKdahXxAxnWeJHCy9Aq9_Sep1lq41uRZ70C95qWsSY1TBN7h2EnpsV_YOjfHRmKAcDNe3nm9jHB5RO_f1VLl2CqKNLJT9ZmT-8rS-qztt0zs7bBPnLmYClnTPak2v9C24SnXmkmKozgSsubhIvKKNA Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 3046c9710f774dedbebcddd4735e252a Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-FloatingIPsTestJSON-960628895 Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3046c9710f774dedbebcddd4735e252a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3046c9710f774dedbebcddd4735e252a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3046c9710f774dedbebcddd4735e252a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3046c9710f774dedbebcddd4735e252a", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-FloatingIPsTestJSON-960628895 Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 3046c9710f774dedbebcddd4735e252a Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-FloatingIPsTestJSON-960628895 Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-FloatingIPsTestJSON-960628895-project Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: dd226cb8d30b4a1b91765aed73457b74 Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-FloatingIPsTestJSON-960628895-project Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: exception: Floating IP not found for ID ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e'} Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e could not be found Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d8b13ce-db79-4a90-a811-7f80cd976c49'] Jul 12 11:52:19.049264 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e. Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fcfb8255-062c-48b2-b692-6eaa6464e5a3 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] Returning 404 to user: Floating IP not found for ID ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fcfb8255-062c-48b2-b692-6eaa6464e5a3 tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e" status: 404 len: 111 microversion: 2.1 time: 0.071375 Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 415/878] 10.222.0.50 () {58 vars in 1259 bytes} [Tue Jul 12 11:52:18 2022] GET /compute/v2.1/os-floating-ips/ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-50848d3c-3d30-4756-986a-3b75604e47c9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:19.065630 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-50848d3c-3d30-4756-986a-3b75604e47c9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:19.104652 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] validate_networks() for [('d3804aae-e5e6-40af-a993-2653361ea3e0', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:52:19.120143 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-50848d3c-3d30-4756-986a-3b75604e47c9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:19.135826 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-50848d3c-3d30-4756-986a-3b75604e47c9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1265 microversion: 2.1 time: 0.083313 Jul 12 11:52:19.136804 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 416/879] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:19 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:19.158522 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cce59055-e380-4998-832f-a36ecb3b5a0a tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] Calling method '.version_select at 0x7f5e0b059dc0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:19.277306 n-d-849104-4 devstack@n-api.service[125983]: DEBUG neutronclient.v2_0.client [None req-cce59055-e380-4998-832f-a36ecb3b5a0a tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e could not be found", "detail": ""}} {{(pid=125983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 12 11:52:19.278600 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-cce59055-e380-4998-832f-a36ecb3b5a0a tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] HTTP exception thrown: Floating IP not found for ID ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cce59055-e380-4998-832f-a36ecb3b5a0a tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] Request method failure captured: Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/os-floating-ips/ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e HTTP/1.1 Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWBlmN_ls8teCiue49mH2wiz_UKdahXxAxnWeJHCy9Aq9_Sep1lq41uRZ70C95qWsSY1TBN7h2EnpsV_YOjfHRmKAcDNe3nm9jHB5RO_f1VLl2CqKNLJT9ZmT-8rS-qztt0zs7bBPnLmYClnTPak2v9C24SnXmkmKozgSsubhIvKKNA Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 3046c9710f774dedbebcddd4735e252a Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-FloatingIPsTestJSON-960628895 Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3046c9710f774dedbebcddd4735e252a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3046c9710f774dedbebcddd4735e252a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3046c9710f774dedbebcddd4735e252a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3046c9710f774dedbebcddd4735e252a", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-FloatingIPsTestJSON-960628895 Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 3046c9710f774dedbebcddd4735e252a Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-FloatingIPsTestJSON-960628895 Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-FloatingIPsTestJSON-960628895-project Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: dd226cb8d30b4a1b91765aed73457b74 Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-FloatingIPsTestJSON-960628895-project Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: exception: Floating IP not found for ID ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e'} Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e could not be found Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-787e9a2a-1d84-4329-9dcb-c38cdfdc8fec'] Jul 12 11:52:19.281904 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e. Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e Jul 12 11:52:19.288767 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:19.296132 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cce59055-e380-4998-832f-a36ecb3b5a0a tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] Returning 404 to user: Floating IP not found for ID ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:52:19.299964 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cce59055-e380-4998-832f-a36ecb3b5a0a tempest-FloatingIPsTestJSON-960628895 tempest-FloatingIPsTestJSON-960628895-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e" status: 404 len: 111 microversion: 2.1 time: 0.160713 Jul 12 11:52:19.301832 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 417/880] 10.222.0.50 () {58 vars in 1262 bytes} [Tue Jul 12 11:52:19 2022] DELETE /compute/v2.1/os-floating-ips/ba0c607c-5ffd-47dd-b9fc-aed8a341ad5e => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:52:19.682429 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d27b4939-42c7-44fe-b1e1-e1baf629bd1f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:19.683412 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d27b4939-42c7-44fe-b1e1-e1baf629bd1f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:19.712079 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d27b4939-42c7-44fe-b1e1-e1baf629bd1f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:19.712934 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d27b4939-42c7-44fe-b1e1-e1baf629bd1f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:19.714386 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d27b4939-42c7-44fe-b1e1-e1baf629bd1f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:19.715080 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d27b4939-42c7-44fe-b1e1-e1baf629bd1f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:19.810643 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:52:19.811063 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:52:19.811538 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:52:19.811948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:52:19.812998 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:52:19.825980 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:19.826581 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:19.827432 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:19.827873 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:19.846624 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Getting quotas for project d9393a32f934440e975f62b7d59eed32. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:52:19.853540 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Getting quotas for user 86ca9c0d2f474f1f9c35aaf5fb9c6064 and project d9393a32f934440e975f62b7d59eed32. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:52:19.871844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:52:19.875459 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:52:19.932626 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f39086e6-000c-45fd-918e-2bb2d672ed63 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.991302 Jul 12 11:52:19.933663 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 464/881] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:52:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:52:19.941009 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5399535b-728f-41c3-825f-e4ceea84c3d7 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:19.941627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5399535b-728f-41c3-825f-e4ceea84c3d7 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:19.957009 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5399535b-728f-41c3-825f-e4ceea84c3d7 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:19.957835 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5399535b-728f-41c3-825f-e4ceea84c3d7 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:19.958990 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5399535b-728f-41c3-825f-e4ceea84c3d7 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:19.959701 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5399535b-728f-41c3-825f-e4ceea84c3d7 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:20.279850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d27b4939-42c7-44fe-b1e1-e1baf629bd1f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:20.292652 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d27b4939-42c7-44fe-b1e1-e1baf629bd1f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:20.295272 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d27b4939-42c7-44fe-b1e1-e1baf629bd1f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:20.308141 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d27b4939-42c7-44fe-b1e1-e1baf629bd1f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.632452 Jul 12 11:52:20.315951 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 418/882] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:19 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:20.328575 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8cd3edf1-65db-44bd-8db8-6921e428e37b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:20.329553 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8cd3edf1-65db-44bd-8db8-6921e428e37b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:20.374608 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5399535b-728f-41c3-825f-e4ceea84c3d7 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:20.403655 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5399535b-728f-41c3-825f-e4ceea84c3d7 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1395 microversion: 2.1 time: 0.468864 Jul 12 11:52:20.412956 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 465/883] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:19 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1395 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:20.412956 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-820f2656-05c3-4883-8137-6a970fd36dcb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:20.412956 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-820f2656-05c3-4883-8137-6a970fd36dcb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:20.424574 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-820f2656-05c3-4883-8137-6a970fd36dcb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:20.426230 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-820f2656-05c3-4883-8137-6a970fd36dcb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:20.428911 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-820f2656-05c3-4883-8137-6a970fd36dcb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:20.429675 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-820f2656-05c3-4883-8137-6a970fd36dcb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:20.550573 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8cd3edf1-65db-44bd-8db8-6921e428e37b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:20.563390 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8cd3edf1-65db-44bd-8db8-6921e428e37b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1234 microversion: 2.1 time: 0.245173 Jul 12 11:52:20.567738 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 419/884] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:20 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1234 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:20.579880 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c2d40caf-379c-48d3-b4d0-2b40a4c9f419 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:20.580626 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c2d40caf-379c-48d3-b4d0-2b40a4c9f419 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:20.596726 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2d40caf-379c-48d3-b4d0-2b40a4c9f419 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:20.597594 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2d40caf-379c-48d3-b4d0-2b40a4c9f419 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:20.598812 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2d40caf-379c-48d3-b4d0-2b40a4c9f419 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:20.599493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2d40caf-379c-48d3-b4d0-2b40a4c9f419 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:20.618996 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-820f2656-05c3-4883-8137-6a970fd36dcb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:20.636675 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-820f2656-05c3-4883-8137-6a970fd36dcb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1336 microversion: 2.1 time: 0.226327 Jul 12 11:52:20.637447 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 466/885] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:20 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1336 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:20.651417 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-00a5af65-44e9-4546-8871-46f27becd078 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:20.656807 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-00a5af65-44e9-4546-8871-46f27becd078 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:20.664885 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-00a5af65-44e9-4546-8871-46f27becd078 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:20.665341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-00a5af65-44e9-4546-8871-46f27becd078 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:20.666131 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-00a5af65-44e9-4546-8871-46f27becd078 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:20.666750 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-00a5af65-44e9-4546-8871-46f27becd078 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:20.771278 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-00a5af65-44e9-4546-8871-46f27becd078 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:20.786353 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-00a5af65-44e9-4546-8871-46f27becd078 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1317 microversion: 2.1 time: 0.144557 Jul 12 11:52:20.787766 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 467/886] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:20 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:20.805399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c2d40caf-379c-48d3-b4d0-2b40a4c9f419 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:20.817173 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c2d40caf-379c-48d3-b4d0-2b40a4c9f419 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1275 microversion: 2.1 time: 0.244920 Jul 12 11:52:20.818577 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 420/887] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:20 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1275 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:21.336153 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8def70be-7ddf-435c-a3fd-a86b0fbb450b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:21.336982 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8def70be-7ddf-435c-a3fd-a86b0fbb450b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:21.344301 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8def70be-7ddf-435c-a3fd-a86b0fbb450b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:21.344932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8def70be-7ddf-435c-a3fd-a86b0fbb450b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:21.346021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8def70be-7ddf-435c-a3fd-a86b0fbb450b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:21.346635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8def70be-7ddf-435c-a3fd-a86b0fbb450b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:21.428751 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-18404ba5-d6ad-4bd2-aefa-2e77c9cb8350 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:21.429852 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-18404ba5-d6ad-4bd2-aefa-2e77c9cb8350 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:21.437886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8def70be-7ddf-435c-a3fd-a86b0fbb450b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:21.448857 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-18404ba5-d6ad-4bd2-aefa-2e77c9cb8350 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:21.449505 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-18404ba5-d6ad-4bd2-aefa-2e77c9cb8350 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:21.451205 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-18404ba5-d6ad-4bd2-aefa-2e77c9cb8350 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:21.451889 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-18404ba5-d6ad-4bd2-aefa-2e77c9cb8350 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:21.458168 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8def70be-7ddf-435c-a3fd-a86b0fbb450b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:21.459944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8def70be-7ddf-435c-a3fd-a86b0fbb450b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:21.476216 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8def70be-7ddf-435c-a3fd-a86b0fbb450b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.143346 Jul 12 11:52:21.476216 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 468/888] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:21 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:52:21.588327 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a4cbf175-a795-461f-85c0-f0b8b0d914d3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:21.588857 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a4cbf175-a795-461f-85c0-f0b8b0d914d3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:21.604721 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a4cbf175-a795-461f-85c0-f0b8b0d914d3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:21.605480 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a4cbf175-a795-461f-85c0-f0b8b0d914d3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:21.614006 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a4cbf175-a795-461f-85c0-f0b8b0d914d3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:21.614711 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a4cbf175-a795-461f-85c0-f0b8b0d914d3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:21.756600 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a4cbf175-a795-461f-85c0-f0b8b0d914d3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:21.766644 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a4cbf175-a795-461f-85c0-f0b8b0d914d3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1294 microversion: 2.1 time: 0.182575 Jul 12 11:52:21.767526 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 469/889] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:21 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1294 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:21.773495 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0d3eb93b-464e-431f-941f-e505546a16dc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:21.775167 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0d3eb93b-464e-431f-941f-e505546a16dc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:21.791502 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0d3eb93b-464e-431f-941f-e505546a16dc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:21.792249 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0d3eb93b-464e-431f-941f-e505546a16dc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:21.793373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0d3eb93b-464e-431f-941f-e505546a16dc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:21.795401 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0d3eb93b-464e-431f-941f-e505546a16dc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:22.011292 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0d3eb93b-464e-431f-941f-e505546a16dc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:22.032020 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0d3eb93b-464e-431f-941f-e505546a16dc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1336 microversion: 2.1 time: 0.261716 Jul 12 11:52:22.033463 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 470/890] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:21 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1336 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:22.043486 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-aeaee79b-83c5-4661-9acd-7610445fb45a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:22.050531 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-aeaee79b-83c5-4661-9acd-7610445fb45a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:22.052568 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-aeaee79b-83c5-4661-9acd-7610445fb45a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:22.053115 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-aeaee79b-83c5-4661-9acd-7610445fb45a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:22.054097 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-aeaee79b-83c5-4661-9acd-7610445fb45a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:22.054702 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-aeaee79b-83c5-4661-9acd-7610445fb45a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:22.163909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-aeaee79b-83c5-4661-9acd-7610445fb45a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:22.181017 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-aeaee79b-83c5-4661-9acd-7610445fb45a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1323 microversion: 2.1 time: 0.144754 Jul 12 11:52:22.181764 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 471/891] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:22 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1323 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:22.187244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-209cafb5-eb6d-4f84-bf1b-2d4a30221139 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:22.188215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-209cafb5-eb6d-4f84-bf1b-2d4a30221139 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:22.195645 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-209cafb5-eb6d-4f84-bf1b-2d4a30221139 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:22.196545 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-209cafb5-eb6d-4f84-bf1b-2d4a30221139 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:22.198104 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-209cafb5-eb6d-4f84-bf1b-2d4a30221139 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:22.198847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-209cafb5-eb6d-4f84-bf1b-2d4a30221139 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:22.237135 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-18404ba5-d6ad-4bd2-aefa-2e77c9cb8350 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:22.256598 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-18404ba5-d6ad-4bd2-aefa-2e77c9cb8350 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1395 microversion: 2.1 time: 0.832471 Jul 12 11:52:22.273377 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 421/892] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:21 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1395 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:22.286230 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-fc7574f6-3310-4555-8f4d-30dfa7cef483 req-1c292e2f-549a-4f19-a660-f55a4eedf4ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72", "name": "network-vif-plugged", "status": "completed", "tag": "827f4044-3788-44c6-9411-c923971bf9c5"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:22.301613 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-fc7574f6-3310-4555-8f4d-30dfa7cef483 req-1c292e2f-549a-4f19-a660-f55a4eedf4ed service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:22.303564 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-fc7574f6-3310-4555-8f4d-30dfa7cef483 req-1c292e2f-549a-4f19-a660-f55a4eedf4ed service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:22.314864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-209cafb5-eb6d-4f84-bf1b-2d4a30221139 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:22.327697 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-fc7574f6-3310-4555-8f4d-30dfa7cef483 req-1c292e2f-549a-4f19-a660-f55a4eedf4ed service nova] Creating event network-vif-plugged:827f4044-3788-44c6-9411-c923971bf9c5 for instance fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 on n-h1-849104-4 Jul 12 11:52:22.334988 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-209cafb5-eb6d-4f84-bf1b-2d4a30221139 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1275 microversion: 2.1 time: 0.150535 Jul 12 11:52:22.338236 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-fc7574f6-3310-4555-8f4d-30dfa7cef483 req-1c292e2f-549a-4f19-a660-f55a4eedf4ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062158 Jul 12 11:52:22.344222 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 422/893] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:22.345475 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 472/894] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:22 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:22.511405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-77eca100-1568-46c1-ab42-3212460ae2b6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:22.512345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-77eca100-1568-46c1-ab42-3212460ae2b6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:22.519929 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77eca100-1568-46c1-ab42-3212460ae2b6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:22.520742 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77eca100-1568-46c1-ab42-3212460ae2b6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:22.521709 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77eca100-1568-46c1-ab42-3212460ae2b6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:22.522642 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77eca100-1568-46c1-ab42-3212460ae2b6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:22.793264 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-032fb6ce-5c16-45c4-b600-7d568402e49a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:22.794185 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-032fb6ce-5c16-45c4-b600-7d568402e49a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:22.814039 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-032fb6ce-5c16-45c4-b600-7d568402e49a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:22.814493 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-032fb6ce-5c16-45c4-b600-7d568402e49a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:22.815282 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-032fb6ce-5c16-45c4-b600-7d568402e49a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:22.815720 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-032fb6ce-5c16-45c4-b600-7d568402e49a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:22.942997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-77eca100-1568-46c1-ab42-3212460ae2b6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:22.955316 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-77eca100-1568-46c1-ab42-3212460ae2b6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:22.959053 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-77eca100-1568-46c1-ab42-3212460ae2b6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:22.975360 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-77eca100-1568-46c1-ab42-3212460ae2b6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.468441 Jul 12 11:52:22.977884 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 423/895] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:22 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:52:23.052591 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-af9d4d5c-1829-401b-b888-da3958f1773b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:23.053242 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-af9d4d5c-1829-401b-b888-da3958f1773b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:23.061226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-af9d4d5c-1829-401b-b888-da3958f1773b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:23.061681 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-af9d4d5c-1829-401b-b888-da3958f1773b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:23.062534 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-af9d4d5c-1829-401b-b888-da3958f1773b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:23.063189 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-af9d4d5c-1829-401b-b888-da3958f1773b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:23.849448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-032fb6ce-5c16-45c4-b600-7d568402e49a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:23.850561 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-af9d4d5c-1829-401b-b888-da3958f1773b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:23.866121 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-032fb6ce-5c16-45c4-b600-7d568402e49a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1360 microversion: 2.1 time: 1.077401 Jul 12 11:52:23.867110 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 473/896] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:22 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1360 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:23.875675 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6c479dfb-825e-48b3-acd6-f65c06614ffa tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:23.878399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6c479dfb-825e-48b3-acd6-f65c06614ffa tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:23.882261 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-af9d4d5c-1829-401b-b888-da3958f1773b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1378 microversion: 2.1 time: 0.835218 Jul 12 11:52:23.894527 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 424/897] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:23 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1378 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:23.897221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c479dfb-825e-48b3-acd6-f65c06614ffa tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:23.897978 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c479dfb-825e-48b3-acd6-f65c06614ffa tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:23.898961 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c479dfb-825e-48b3-acd6-f65c06614ffa tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:23.899492 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ca9e7218-a071-4fba-925c-6f77a4a17638 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:23.899743 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c479dfb-825e-48b3-acd6-f65c06614ffa tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:23.900986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ca9e7218-a071-4fba-925c-6f77a4a17638 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:23.917590 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca9e7218-a071-4fba-925c-6f77a4a17638 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:23.918091 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca9e7218-a071-4fba-925c-6f77a4a17638 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:23.919720 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca9e7218-a071-4fba-925c-6f77a4a17638 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:23.920382 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca9e7218-a071-4fba-925c-6f77a4a17638 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:24.072346 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6c479dfb-825e-48b3-acd6-f65c06614ffa tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:24.094759 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6c479dfb-825e-48b3-acd6-f65c06614ffa tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1323 microversion: 2.1 time: 0.225540 Jul 12 11:52:24.108530 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 474/898] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:23 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1323 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:24.119256 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7e7f7291-d8a9-4cf2-a7d7-d551d258065f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:24.124098 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7e7f7291-d8a9-4cf2-a7d7-d551d258065f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:24.139364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7e7f7291-d8a9-4cf2-a7d7-d551d258065f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:24.140815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7e7f7291-d8a9-4cf2-a7d7-d551d258065f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:24.142540 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7e7f7291-d8a9-4cf2-a7d7-d551d258065f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:24.149751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7e7f7291-d8a9-4cf2-a7d7-d551d258065f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:24.555377 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ca9e7218-a071-4fba-925c-6f77a4a17638 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:24.572800 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ca9e7218-a071-4fba-925c-6f77a4a17638 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1395 microversion: 2.1 time: 0.688551 Jul 12 11:52:24.573397 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 425/899] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:23 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1395 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:24.578265 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a060fe4a-3b44-4090-85b4-3fd911af4083 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:24.578886 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a060fe4a-3b44-4090-85b4-3fd911af4083 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:24.598610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a060fe4a-3b44-4090-85b4-3fd911af4083 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:24.599303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a060fe4a-3b44-4090-85b4-3fd911af4083 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:24.604842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a060fe4a-3b44-4090-85b4-3fd911af4083 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:24.610539 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a060fe4a-3b44-4090-85b4-3fd911af4083 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:24.928303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a060fe4a-3b44-4090-85b4-3fd911af4083 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:24.945909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7e7f7291-d8a9-4cf2-a7d7-d551d258065f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:24.952520 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a060fe4a-3b44-4090-85b4-3fd911af4083 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:24.959725 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7e7f7291-d8a9-4cf2-a7d7-d551d258065f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1317 microversion: 2.1 time: 0.849569 Jul 12 11:52:24.960351 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 475/900] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:24 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1317 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:24.969546 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a060fe4a-3b44-4090-85b4-3fd911af4083 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:24.975931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1db87fb2-629f-45a7-8ec7-8f91d6c58afd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:24.980944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1db87fb2-629f-45a7-8ec7-8f91d6c58afd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:24.985081 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a060fe4a-3b44-4090-85b4-3fd911af4083 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.410549 Jul 12 11:52:24.986096 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 426/901] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:24 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:24.994831 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2b48426b-645d-4e4f-b7c7-b09f77d28566 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:24.995525 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2b48426b-645d-4e4f-b7c7-b09f77d28566 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:25.002705 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1db87fb2-629f-45a7-8ec7-8f91d6c58afd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:25.003422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1db87fb2-629f-45a7-8ec7-8f91d6c58afd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:25.004423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1db87fb2-629f-45a7-8ec7-8f91d6c58afd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:25.005024 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1db87fb2-629f-45a7-8ec7-8f91d6c58afd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:25.011330 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2b48426b-645d-4e4f-b7c7-b09f77d28566 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:25.011796 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2b48426b-645d-4e4f-b7c7-b09f77d28566 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:25.020903 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2b48426b-645d-4e4f-b7c7-b09f77d28566 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:25.023423 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2b48426b-645d-4e4f-b7c7-b09f77d28566 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:25.347958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1db87fb2-629f-45a7-8ec7-8f91d6c58afd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:25.362446 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1db87fb2-629f-45a7-8ec7-8f91d6c58afd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1360 microversion: 2.1 time: 0.390194 Jul 12 11:52:25.364338 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 476/902] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:24 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1360 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:25.372404 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-77da7ec5-6d14-49c6-ab3c-91e734e5c34c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:25.373235 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-77da7ec5-6d14-49c6-ab3c-91e734e5c34c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:25.380525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-77da7ec5-6d14-49c6-ab3c-91e734e5c34c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:25.381226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-77da7ec5-6d14-49c6-ab3c-91e734e5c34c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:25.382351 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-77da7ec5-6d14-49c6-ab3c-91e734e5c34c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:25.382965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-77da7ec5-6d14-49c6-ab3c-91e734e5c34c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:25.402450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:25.531314 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-77da7ec5-6d14-49c6-ab3c-91e734e5c34c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:25.554171 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-77da7ec5-6d14-49c6-ab3c-91e734e5c34c tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1323 microversion: 2.1 time: 0.187428 Jul 12 11:52:25.558883 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 477/903] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:25 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1323 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:25.580969 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-bc311822-146d-4305-a97b-b4e130dc64a3 req-fa9e304d-046f-46b4-8280-2ba7b0facb33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c809d104-cbc0-4f60-bd08-d9b669685f5e", "name": "network-vif-deleted", "tag": "2218e552-6bd9-4914-b419-9c29009d158d"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:25.613020 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-bc311822-146d-4305-a97b-b4e130dc64a3 req-fa9e304d-046f-46b4-8280-2ba7b0facb33 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:25.615855 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-bc311822-146d-4305-a97b-b4e130dc64a3 req-fa9e304d-046f-46b4-8280-2ba7b0facb33 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:25.654635 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-bc311822-146d-4305-a97b-b4e130dc64a3 req-fa9e304d-046f-46b4-8280-2ba7b0facb33 service nova] Creating event network-vif-deleted:2218e552-6bd9-4914-b419-9c29009d158d for instance c809d104-cbc0-4f60-bd08-d9b669685f5e on n-h2-849104-4 Jul 12 11:52:25.663966 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-bc311822-146d-4305-a97b-b4e130dc64a3 req-fa9e304d-046f-46b4-8280-2ba7b0facb33 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090354 Jul 12 11:52:25.666067 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 478/904] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:25.676247 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0f99c8c3-acf1-43a9-a14d-728523a60062 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:25.679581 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0f99c8c3-acf1-43a9-a14d-728523a60062 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:25.693273 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f99c8c3-acf1-43a9-a14d-728523a60062 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:25.694434 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f99c8c3-acf1-43a9-a14d-728523a60062 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:25.702923 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f99c8c3-acf1-43a9-a14d-728523a60062 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:25.704163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f99c8c3-acf1-43a9-a14d-728523a60062 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:26.458387 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2b48426b-645d-4e4f-b7c7-b09f77d28566 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:26.497868 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2b48426b-645d-4e4f-b7c7-b09f77d28566 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1378 microversion: 2.1 time: 1.507562 Jul 12 11:52:26.502515 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 427/905] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:24 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1378 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:26.545774 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e63577e4-226f-47b6-b29d-9a9f393f9112 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:26.552471 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e63577e4-226f-47b6-b29d-9a9f393f9112 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:26.587060 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e63577e4-226f-47b6-b29d-9a9f393f9112 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:26.589409 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e63577e4-226f-47b6-b29d-9a9f393f9112 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:26.591745 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e63577e4-226f-47b6-b29d-9a9f393f9112 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:26.598261 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e63577e4-226f-47b6-b29d-9a9f393f9112 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:26.665733 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0f99c8c3-acf1-43a9-a14d-728523a60062 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:26.690094 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0f99c8c3-acf1-43a9-a14d-728523a60062 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1576 microversion: 2.1 time: 1.015557 Jul 12 11:52:26.695282 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 479/906] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:25 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1576 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:26.720396 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6d52ebff-db99-4695-afc5-2d1581da9344 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:26.721910 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6d52ebff-db99-4695-afc5-2d1581da9344 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:26.739678 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d52ebff-db99-4695-afc5-2d1581da9344 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:26.740847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d52ebff-db99-4695-afc5-2d1581da9344 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:26.742093 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d52ebff-db99-4695-afc5-2d1581da9344 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:26.748567 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d52ebff-db99-4695-afc5-2d1581da9344 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:27.012393 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6d52ebff-db99-4695-afc5-2d1581da9344 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:27.027895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6d52ebff-db99-4695-afc5-2d1581da9344 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:27.033826 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6d52ebff-db99-4695-afc5-2d1581da9344 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:27.047179 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6d52ebff-db99-4695-afc5-2d1581da9344 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.348592 Jul 12 11:52:27.047839 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 480/907] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:26 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:27.084515 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-8253931e-6b52-4687-be08-0dbb65f077cc req-987d1d82-883d-4ca3-85fa-2ed7e2f089cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec6989c-9a01-4cd9-a91b-421af9130b46", "tag": "694302fc-4796-4f12-bc02-b17c9376ebbb"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:27.131326 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-8253931e-6b52-4687-be08-0dbb65f077cc req-987d1d82-883d-4ca3-85fa-2ed7e2f089cc service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:27.132909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-8253931e-6b52-4687-be08-0dbb65f077cc req-987d1d82-883d-4ca3-85fa-2ed7e2f089cc service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:27.158662 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-8253931e-6b52-4687-be08-0dbb65f077cc req-987d1d82-883d-4ca3-85fa-2ed7e2f089cc service nova] Creating event network-changed:694302fc-4796-4f12-bc02-b17c9376ebbb for instance dec6989c-9a01-4cd9-a91b-421af9130b46 on n-h2-849104-4 Jul 12 11:52:27.181835 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-8253931e-6b52-4687-be08-0dbb65f077cc req-987d1d82-883d-4ca3-85fa-2ed7e2f089cc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116559 Jul 12 11:52:27.188752 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 481/908] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:27.204707 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-166c2579-d04d-48f6-9aaf-da57bcd93add tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:27.205869 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-166c2579-d04d-48f6-9aaf-da57bcd93add tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:27.213644 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-166c2579-d04d-48f6-9aaf-da57bcd93add tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:27.214352 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-166c2579-d04d-48f6-9aaf-da57bcd93add tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:27.215347 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-166c2579-d04d-48f6-9aaf-da57bcd93add tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:27.216581 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-166c2579-d04d-48f6-9aaf-da57bcd93add tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:27.775611 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-166c2579-d04d-48f6-9aaf-da57bcd93add tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:27.796569 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-166c2579-d04d-48f6-9aaf-da57bcd93add tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1360 microversion: 2.1 time: 0.604808 Jul 12 11:52:27.797839 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 482/909] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:27 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1360 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:27.806172 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-25baa497-9f49-4245-ae6f-ef92efab6a12 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:27.807715 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-25baa497-9f49-4245-ae6f-ef92efab6a12 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:27.817182 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-25baa497-9f49-4245-ae6f-ef92efab6a12 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:27.818072 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-25baa497-9f49-4245-ae6f-ef92efab6a12 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:27.819358 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-25baa497-9f49-4245-ae6f-ef92efab6a12 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:27.820329 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-25baa497-9f49-4245-ae6f-ef92efab6a12 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:27.904555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e63577e4-226f-47b6-b29d-9a9f393f9112 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:27.919579 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e63577e4-226f-47b6-b29d-9a9f393f9112 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1317 microversion: 2.1 time: 1.413520 Jul 12 11:52:27.920946 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 428/910] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:26 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1317 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:27.928303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-56acf06b-a17c-43d9-930f-104c48e75d5c tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:27.929281 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-56acf06b-a17c-43d9-930f-104c48e75d5c tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:27.938715 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56acf06b-a17c-43d9-930f-104c48e75d5c tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:27.939618 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56acf06b-a17c-43d9-930f-104c48e75d5c tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:27.941284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56acf06b-a17c-43d9-930f-104c48e75d5c tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:27.942061 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56acf06b-a17c-43d9-930f-104c48e75d5c tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:28.044462 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-25baa497-9f49-4245-ae6f-ef92efab6a12 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:28.055600 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-25baa497-9f49-4245-ae6f-ef92efab6a12 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1390 microversion: 2.1 time: 0.256388 Jul 12 11:52:28.064547 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 483/911] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:27 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1390 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:28.075950 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-449060d7-2402-4eff-922d-8272ab466596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:28.079051 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-449060d7-2402-4eff-922d-8272ab466596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:28.088423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-449060d7-2402-4eff-922d-8272ab466596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:28.089601 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-449060d7-2402-4eff-922d-8272ab466596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:28.090307 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-449060d7-2402-4eff-922d-8272ab466596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:28.091606 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-449060d7-2402-4eff-922d-8272ab466596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:28.273812 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-449060d7-2402-4eff-922d-8272ab466596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:28.284595 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-449060d7-2402-4eff-922d-8272ab466596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1378 microversion: 2.1 time: 0.218021 Jul 12 11:52:28.285733 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 484/912] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:28 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1378 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:28.291197 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fbf59fe5-973d-49e0-94ec-45c7edb20980 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:28.292081 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fbf59fe5-973d-49e0-94ec-45c7edb20980 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:28.299389 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fbf59fe5-973d-49e0-94ec-45c7edb20980 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:28.300207 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fbf59fe5-973d-49e0-94ec-45c7edb20980 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:28.301366 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fbf59fe5-973d-49e0-94ec-45c7edb20980 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:28.301810 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fbf59fe5-973d-49e0-94ec-45c7edb20980 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:28.373086 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-56acf06b-a17c-43d9-930f-104c48e75d5c tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.450644 Jul 12 11:52:28.373912 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 429/913] 10.222.0.50 () {58 vars in 1274 bytes} [Tue Jul 12 11:52:27 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72/os-interface => generated 284 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:28.418690 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fbf59fe5-973d-49e0-94ec-45c7edb20980 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:28.431747 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fbf59fe5-973d-49e0-94ec-45c7edb20980 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:28.434873 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fbf59fe5-973d-49e0-94ec-45c7edb20980 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:28.443471 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fbf59fe5-973d-49e0-94ec-45c7edb20980 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.156101 Jul 12 11:52:28.444417 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 485/914] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:28 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:28.827438 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-eec95394-9f89-437c-9cf9-2189da7037e3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:28.828462 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-eec95394-9f89-437c-9cf9-2189da7037e3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:28.837467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eec95394-9f89-437c-9cf9-2189da7037e3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:28.837923 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eec95394-9f89-437c-9cf9-2189da7037e3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:28.838715 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eec95394-9f89-437c-9cf9-2189da7037e3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:28.839840 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eec95394-9f89-437c-9cf9-2189da7037e3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:28.942368 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4ffd9e6a-f566-4b9d-b80b-bb7f43b978c4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:28.943189 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4ffd9e6a-f566-4b9d-b80b-bb7f43b978c4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:28.953247 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4ffd9e6a-f566-4b9d-b80b-bb7f43b978c4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:28.953837 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4ffd9e6a-f566-4b9d-b80b-bb7f43b978c4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:28.954706 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4ffd9e6a-f566-4b9d-b80b-bb7f43b978c4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:28.955220 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4ffd9e6a-f566-4b9d-b80b-bb7f43b978c4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:29.183764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4ffd9e6a-f566-4b9d-b80b-bb7f43b978c4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:29.194842 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4ffd9e6a-f566-4b9d-b80b-bb7f43b978c4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1317 microversion: 2.1 time: 0.261187 Jul 12 11:52:29.195755 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 486/915] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:28 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:29.201368 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c879cd50-5a87-4c79-9f73-83d6b2aa393a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:29.202312 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c879cd50-5a87-4c79-9f73-83d6b2aa393a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:29.209266 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c879cd50-5a87-4c79-9f73-83d6b2aa393a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:29.209826 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c879cd50-5a87-4c79-9f73-83d6b2aa393a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:29.210564 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c879cd50-5a87-4c79-9f73-83d6b2aa393a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:29.212257 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c879cd50-5a87-4c79-9f73-83d6b2aa393a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:29.629166 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c879cd50-5a87-4c79-9f73-83d6b2aa393a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:29.654697 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c879cd50-5a87-4c79-9f73-83d6b2aa393a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1390 microversion: 2.1 time: 0.457519 Jul 12 11:52:29.672860 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 487/916] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:29 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1390 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:29.678163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-4bde4a52-b35e-4b82-8bfd-7571af836d26 req-59223194-78e2-4dfc-b950-f8b280c2276e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e523720-c162-4dac-a620-1e2325a63dfa", "tag": "5c3dfca1-7449-46f3-994a-4127c1b004e4"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:29.691803 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-4bde4a52-b35e-4b82-8bfd-7571af836d26 req-59223194-78e2-4dfc-b950-f8b280c2276e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:29.692377 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-4bde4a52-b35e-4b82-8bfd-7571af836d26 req-59223194-78e2-4dfc-b950-f8b280c2276e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:29.715940 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-4bde4a52-b35e-4b82-8bfd-7571af836d26 req-59223194-78e2-4dfc-b950-f8b280c2276e service nova] Creating event network-changed:5c3dfca1-7449-46f3-994a-4127c1b004e4 for instance 7e523720-c162-4dac-a620-1e2325a63dfa on n-h2-849104-4 Jul 12 11:52:29.731531 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-4bde4a52-b35e-4b82-8bfd-7571af836d26 req-59223194-78e2-4dfc-b950-f8b280c2276e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056936 Jul 12 11:52:29.732788 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 488/917] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:29.738361 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9ba2cb8f-5eee-44a8-b055-486c7d1764bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:29.739685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9ba2cb8f-5eee-44a8-b055-486c7d1764bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:29.752996 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9ba2cb8f-5eee-44a8-b055-486c7d1764bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:29.754018 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9ba2cb8f-5eee-44a8-b055-486c7d1764bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:29.755428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9ba2cb8f-5eee-44a8-b055-486c7d1764bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:29.756316 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9ba2cb8f-5eee-44a8-b055-486c7d1764bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:29.771496 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eec95394-9f89-437c-9cf9-2189da7037e3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:29.795288 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-eec95394-9f89-437c-9cf9-2189da7037e3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1360 microversion: 2.1 time: 0.972860 Jul 12 11:52:29.801049 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 430/918] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:28 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1360 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:29.814153 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-5f0e7e00-5344-4367-9a30-5abc1526d989 req-5ef89ec6-761e-42a5-b3f9-a1c98b739efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c311469b-29d4-4011-b455-8fe3ffd81d3c", "tag": "4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:29.826860 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-5f0e7e00-5344-4367-9a30-5abc1526d989 req-5ef89ec6-761e-42a5-b3f9-a1c98b739efe service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:29.827951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-5f0e7e00-5344-4367-9a30-5abc1526d989 req-5ef89ec6-761e-42a5-b3f9-a1c98b739efe service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:29.837095 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=12 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:29.859874 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-5f0e7e00-5344-4367-9a30-5abc1526d989 req-5ef89ec6-761e-42a5-b3f9-a1c98b739efe service nova] Creating event network-changed:4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec for instance c311469b-29d4-4011-b455-8fe3ffd81d3c on n-h2-849104-4 Jul 12 11:52:29.864199 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=48 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:29.872928 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-5f0e7e00-5344-4367-9a30-5abc1526d989 req-5ef89ec6-761e-42a5-b3f9-a1c98b739efe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067541 Jul 12 11:52:29.876912 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 431/919] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:29.886681 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-eb8bf461-9537-4eff-8a90-37951239b92d tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:29.887446 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-eb8bf461-9537-4eff-8a90-37951239b92d tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:29.897152 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb8bf461-9537-4eff-8a90-37951239b92d tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:29.897897 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb8bf461-9537-4eff-8a90-37951239b92d tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:29.898947 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb8bf461-9537-4eff-8a90-37951239b92d tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:29.899706 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb8bf461-9537-4eff-8a90-37951239b92d tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:30.077064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9ba2cb8f-5eee-44a8-b055-486c7d1764bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:30.085610 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9ba2cb8f-5eee-44a8-b055-486c7d1764bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1378 microversion: 2.1 time: 0.351671 Jul 12 11:52:30.086252 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 489/920] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:29 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1378 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:30.223673 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0e4ef3c0-d873-4bda-b1a2-e35656138784 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:30.224781 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0e4ef3c0-d873-4bda-b1a2-e35656138784 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:30.240389 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0e4ef3c0-d873-4bda-b1a2-e35656138784 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:30.241184 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0e4ef3c0-d873-4bda-b1a2-e35656138784 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:30.242580 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0e4ef3c0-d873-4bda-b1a2-e35656138784 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:30.243651 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0e4ef3c0-d873-4bda-b1a2-e35656138784 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:30.340946 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eb8bf461-9537-4eff-8a90-37951239b92d tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:30.378130 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eb8bf461-9537-4eff-8a90-37951239b92d tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:30.382736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eb8bf461-9537-4eff-8a90-37951239b92d tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:30.393199 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-eb8bf461-9537-4eff-8a90-37951239b92d tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.513573 Jul 12 11:52:30.394644 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 432/921] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:29 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:30.431181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0e4ef3c0-d873-4bda-b1a2-e35656138784 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:30.441534 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0e4ef3c0-d873-4bda-b1a2-e35656138784 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1317 microversion: 2.1 time: 0.225938 Jul 12 11:52:30.442462 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 490/922] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:30 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:30.691653 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f682852e-5a55-4052-a1cf-1b73d71f8915 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:30.692853 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f682852e-5a55-4052-a1cf-1b73d71f8915 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:30.696238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=4 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:30.705784 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f682852e-5a55-4052-a1cf-1b73d71f8915 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:30.706392 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f682852e-5a55-4052-a1cf-1b73d71f8915 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:30.707385 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f682852e-5a55-4052-a1cf-1b73d71f8915 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:30.707932 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f682852e-5a55-4052-a1cf-1b73d71f8915 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:30.829309 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-55bb42a5-43f9-49d9-a27e-0b7add2f1010 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:30.830710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-55bb42a5-43f9-49d9-a27e-0b7add2f1010 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:30.839931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-55bb42a5-43f9-49d9-a27e-0b7add2f1010 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:30.841359 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-55bb42a5-43f9-49d9-a27e-0b7add2f1010 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:30.842710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-55bb42a5-43f9-49d9-a27e-0b7add2f1010 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:30.843273 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-55bb42a5-43f9-49d9-a27e-0b7add2f1010 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:31.024170 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-55bb42a5-43f9-49d9-a27e-0b7add2f1010 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:31.034462 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-55bb42a5-43f9-49d9-a27e-0b7add2f1010 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1360 microversion: 2.1 time: 0.212577 Jul 12 11:52:31.035656 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 491/923] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:30 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1360 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:31.108150 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-85d61016-6264-42b3-9a74-d017abb063aa tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:31.109239 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-85d61016-6264-42b3-9a74-d017abb063aa tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:31.119275 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-85d61016-6264-42b3-9a74-d017abb063aa tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:31.120082 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-85d61016-6264-42b3-9a74-d017abb063aa tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:31.121783 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-85d61016-6264-42b3-9a74-d017abb063aa tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:31.122835 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-85d61016-6264-42b3-9a74-d017abb063aa tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:31.185886 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f682852e-5a55-4052-a1cf-1b73d71f8915 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:31.225851 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f682852e-5a55-4052-a1cf-1b73d71f8915 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1390 microversion: 2.1 time: 0.539715 Jul 12 11:52:31.226458 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 433/924] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:30 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1390 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:31.362004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-85d61016-6264-42b3-9a74-d017abb063aa tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:31.372728 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-85d61016-6264-42b3-9a74-d017abb063aa tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1378 microversion: 2.1 time: 0.270911 Jul 12 11:52:31.374122 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 492/925] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:31 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1378 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:31.425286 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-aee65e0f-5a56-4eb9-8fef-6ec6381a0936 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:31.426183 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-aee65e0f-5a56-4eb9-8fef-6ec6381a0936 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:31.435572 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:31.437873 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aee65e0f-5a56-4eb9-8fef-6ec6381a0936 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:31.445451 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aee65e0f-5a56-4eb9-8fef-6ec6381a0936 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:31.446613 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aee65e0f-5a56-4eb9-8fef-6ec6381a0936 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:31.447277 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aee65e0f-5a56-4eb9-8fef-6ec6381a0936 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:31.466783 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-04b7f432-33bb-452c-90e6-7132e7279009 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:31.468188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-04b7f432-33bb-452c-90e6-7132e7279009 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:31.484729 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:31.495304 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04b7f432-33bb-452c-90e6-7132e7279009 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:31.496106 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04b7f432-33bb-452c-90e6-7132e7279009 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:31.497546 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04b7f432-33bb-452c-90e6-7132e7279009 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:31.498318 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04b7f432-33bb-452c-90e6-7132e7279009 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:31.713231 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-aee65e0f-5a56-4eb9-8fef-6ec6381a0936 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:31.736519 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-aee65e0f-5a56-4eb9-8fef-6ec6381a0936 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:31.740645 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-aee65e0f-5a56-4eb9-8fef-6ec6381a0936 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:31.750716 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-aee65e0f-5a56-4eb9-8fef-6ec6381a0936 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.329669 Jul 12 11:52:31.753088 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 434/926] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:31 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:32.059377 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d484bd10-e4d7-4308-aee2-1b82198c6f9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:32.060850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d484bd10-e4d7-4308-aee2-1b82198c6f9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:32.069844 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d484bd10-e4d7-4308-aee2-1b82198c6f9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:32.070546 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d484bd10-e4d7-4308-aee2-1b82198c6f9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:32.071604 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d484bd10-e4d7-4308-aee2-1b82198c6f9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:32.072374 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d484bd10-e4d7-4308-aee2-1b82198c6f9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:32.143208 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-04b7f432-33bb-452c-90e6-7132e7279009 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:32.157474 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-04b7f432-33bb-452c-90e6-7132e7279009 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1317 microversion: 2.1 time: 0.695215 Jul 12 11:52:32.158521 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 493/927] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:31 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1317 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:32.247762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2b95db1a-3c08-4d3f-a507-aa1f5bf86030 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:32.249370 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2b95db1a-3c08-4d3f-a507-aa1f5bf86030 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:32.263429 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2b95db1a-3c08-4d3f-a507-aa1f5bf86030 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:32.264814 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2b95db1a-3c08-4d3f-a507-aa1f5bf86030 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:32.266602 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2b95db1a-3c08-4d3f-a507-aa1f5bf86030 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:32.267595 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2b95db1a-3c08-4d3f-a507-aa1f5bf86030 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:32.858760 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d484bd10-e4d7-4308-aee2-1b82198c6f9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:32.873178 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d484bd10-e4d7-4308-aee2-1b82198c6f9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1360 microversion: 2.1 time: 0.817681 Jul 12 11:52:32.875006 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 435/928] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:32 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1360 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:32.890720 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2f98a812-352a-43f2-901e-10165179d383 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:32.891838 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2f98a812-352a-43f2-901e-10165179d383 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:32.902137 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2f98a812-352a-43f2-901e-10165179d383 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:32.904678 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2f98a812-352a-43f2-901e-10165179d383 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:32.906277 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2f98a812-352a-43f2-901e-10165179d383 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:32.907518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2f98a812-352a-43f2-901e-10165179d383 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:32.933543 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2b95db1a-3c08-4d3f-a507-aa1f5bf86030 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:32.953010 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2b95db1a-3c08-4d3f-a507-aa1f5bf86030 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1390 microversion: 2.1 time: 0.713216 Jul 12 11:52:32.970367 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 494/929] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:32 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1390 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:32.979140 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-d3e6d79b-2758-47cc-806d-0188a03c98c2 req-c6dddc25-af49-4773-bc52-a1ba754c94b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46032186-539a-44ea-83fd-fd87925589d9", "tag": "8260de2a-72b7-4bc9-a2c3-b6cf940c5fa7"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:32.992123 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d3e6d79b-2758-47cc-806d-0188a03c98c2 req-c6dddc25-af49-4773-bc52-a1ba754c94b2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:32.993364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d3e6d79b-2758-47cc-806d-0188a03c98c2 req-c6dddc25-af49-4773-bc52-a1ba754c94b2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:33.019668 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-d3e6d79b-2758-47cc-806d-0188a03c98c2 req-c6dddc25-af49-4773-bc52-a1ba754c94b2 service nova] Creating event network-changed:8260de2a-72b7-4bc9-a2c3-b6cf940c5fa7 for instance 46032186-539a-44ea-83fd-fd87925589d9 on n-h2-849104-4 Jul 12 11:52:33.036337 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-d3e6d79b-2758-47cc-806d-0188a03c98c2 req-c6dddc25-af49-4773-bc52-a1ba754c94b2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061132 Jul 12 11:52:33.039800 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 495/930] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:33.052079 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d59d978a-868e-428e-b8c8-4798ac9aeca1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:33.054551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d59d978a-868e-428e-b8c8-4798ac9aeca1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:33.070945 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d59d978a-868e-428e-b8c8-4798ac9aeca1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:33.071420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d59d978a-868e-428e-b8c8-4798ac9aeca1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:33.073193 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d59d978a-868e-428e-b8c8-4798ac9aeca1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:33.073662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d59d978a-868e-428e-b8c8-4798ac9aeca1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:33.193682 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2f98a812-352a-43f2-901e-10165179d383 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:33.211002 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2f98a812-352a-43f2-901e-10165179d383 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1378 microversion: 2.1 time: 0.322812 Jul 12 11:52:33.222710 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 436/931] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:32 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1378 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:33.227871 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-27bfac93-f2e4-4806-bbc5-8ce54189e99e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:33.228768 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-27bfac93-f2e4-4806-bbc5-8ce54189e99e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:33.243503 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27bfac93-f2e4-4806-bbc5-8ce54189e99e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:33.243503 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27bfac93-f2e4-4806-bbc5-8ce54189e99e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:33.243503 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27bfac93-f2e4-4806-bbc5-8ce54189e99e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:33.243503 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27bfac93-f2e4-4806-bbc5-8ce54189e99e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:33.291508 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d59d978a-868e-428e-b8c8-4798ac9aeca1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:33.312523 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:33.324308 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d59d978a-868e-428e-b8c8-4798ac9aeca1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:33.327009 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d59d978a-868e-428e-b8c8-4798ac9aeca1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:33.352329 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:33.356525 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d59d978a-868e-428e-b8c8-4798ac9aeca1 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.314702 Jul 12 11:52:33.357140 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 496/932] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:33 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:33.370217 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0c8fe695-3626-4714-a587-c7498c151e42 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:33.376126 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0c8fe695-3626-4714-a587-c7498c151e42 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:33.399303 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0c8fe695-3626-4714-a587-c7498c151e42 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:33.400332 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0c8fe695-3626-4714-a587-c7498c151e42 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:33.401683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0c8fe695-3626-4714-a587-c7498c151e42 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:33.402425 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0c8fe695-3626-4714-a587-c7498c151e42 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:33.529985 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-27bfac93-f2e4-4806-bbc5-8ce54189e99e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:33.538966 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-27bfac93-f2e4-4806-bbc5-8ce54189e99e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1576 microversion: 2.1 time: 0.315006 Jul 12 11:52:33.554312 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 437/933] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:33 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1576 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:33.679052 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-2ebf3b75-0c8f-490e-9ad3-9865fc12b352 req-1907176c-1434-4ec1-8911-49acd0713af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec6989c-9a01-4cd9-a91b-421af9130b46", "name": "network-vif-plugged", "status": "completed", "tag": "694302fc-4796-4f12-bc02-b17c9376ebbb"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:33.690932 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-2ebf3b75-0c8f-490e-9ad3-9865fc12b352 req-1907176c-1434-4ec1-8911-49acd0713af9 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:33.691744 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-2ebf3b75-0c8f-490e-9ad3-9865fc12b352 req-1907176c-1434-4ec1-8911-49acd0713af9 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:33.712260 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-2ebf3b75-0c8f-490e-9ad3-9865fc12b352 req-1907176c-1434-4ec1-8911-49acd0713af9 service nova] Creating event network-vif-plugged:694302fc-4796-4f12-bc02-b17c9376ebbb for instance dec6989c-9a01-4cd9-a91b-421af9130b46 on n-h2-849104-4 Jul 12 11:52:33.721919 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-2ebf3b75-0c8f-490e-9ad3-9865fc12b352 req-1907176c-1434-4ec1-8911-49acd0713af9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047195 Jul 12 11:52:33.724070 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 438/934] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:33.791425 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0c8fe695-3626-4714-a587-c7498c151e42 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:33.807917 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0c8fe695-3626-4714-a587-c7498c151e42 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1317 microversion: 2.1 time: 0.449571 Jul 12 11:52:33.810048 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 497/935] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:33 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:33.898310 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-04ee3b3b-adf0-4757-b7bb-99c056b2b9f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:33.902228 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-04ee3b3b-adf0-4757-b7bb-99c056b2b9f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:33.919171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-04ee3b3b-adf0-4757-b7bb-99c056b2b9f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:33.920016 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-04ee3b3b-adf0-4757-b7bb-99c056b2b9f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:33.921892 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-04ee3b3b-adf0-4757-b7bb-99c056b2b9f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:33.923199 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-04ee3b3b-adf0-4757-b7bb-99c056b2b9f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:33.981603 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-94b85750-5624-46cb-bb26-c08d7e0263e4 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:33.983220 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-94b85750-5624-46cb-bb26-c08d7e0263e4 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:33.996954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94b85750-5624-46cb-bb26-c08d7e0263e4 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:33.998068 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94b85750-5624-46cb-bb26-c08d7e0263e4 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:33.999515 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94b85750-5624-46cb-bb26-c08d7e0263e4 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:34.000242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94b85750-5624-46cb-bb26-c08d7e0263e4 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:34.178065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-04ee3b3b-adf0-4757-b7bb-99c056b2b9f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:34.200883 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-04ee3b3b-adf0-4757-b7bb-99c056b2b9f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1360 microversion: 2.1 time: 0.309639 Jul 12 11:52:34.201588 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 439/936] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:33 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1360 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:34.233638 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-268465db-4045-450c-9f78-7fd6178ef6cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:34.237292 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-268465db-4045-450c-9f78-7fd6178ef6cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:34.256254 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-268465db-4045-450c-9f78-7fd6178ef6cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:34.257041 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-268465db-4045-450c-9f78-7fd6178ef6cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:34.258674 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-268465db-4045-450c-9f78-7fd6178ef6cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:34.259479 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-268465db-4045-450c-9f78-7fd6178ef6cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:34.414868 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-94b85750-5624-46cb-bb26-c08d7e0263e4 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:34.440338 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-94b85750-5624-46cb-bb26-c08d7e0263e4 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1390 microversion: 2.1 time: 0.465399 Jul 12 11:52:34.443369 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 498/937] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:33 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1390 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:34.449851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c273e1f6-d82f-41a3-ac3f-8e3bba1d8448 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:34.450716 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c273e1f6-d82f-41a3-ac3f-8e3bba1d8448 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:34.465532 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c273e1f6-d82f-41a3-ac3f-8e3bba1d8448 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:34.466137 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c273e1f6-d82f-41a3-ac3f-8e3bba1d8448 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:34.475030 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c273e1f6-d82f-41a3-ac3f-8e3bba1d8448 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:34.476317 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c273e1f6-d82f-41a3-ac3f-8e3bba1d8448 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:34.521501 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-268465db-4045-450c-9f78-7fd6178ef6cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:34.533575 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-268465db-4045-450c-9f78-7fd6178ef6cb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1378 microversion: 2.1 time: 0.306440 Jul 12 11:52:34.539979 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 440/938] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:34 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1378 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:34.659593 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c273e1f6-d82f-41a3-ac3f-8e3bba1d8448 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:34.671525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c273e1f6-d82f-41a3-ac3f-8e3bba1d8448 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:34.673188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c273e1f6-d82f-41a3-ac3f-8e3bba1d8448 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:34.679294 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c273e1f6-d82f-41a3-ac3f-8e3bba1d8448 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.234598 Jul 12 11:52:34.680656 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 499/939] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:34 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:34.828579 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1f14780f-f611-4489-af7f-01b57fd1cc3b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:34.829214 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1f14780f-f611-4489-af7f-01b57fd1cc3b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:34.835722 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f14780f-f611-4489-af7f-01b57fd1cc3b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:34.836343 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f14780f-f611-4489-af7f-01b57fd1cc3b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:34.837338 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f14780f-f611-4489-af7f-01b57fd1cc3b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:34.838108 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f14780f-f611-4489-af7f-01b57fd1cc3b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:35.036072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1f14780f-f611-4489-af7f-01b57fd1cc3b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:35.054177 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1f14780f-f611-4489-af7f-01b57fd1cc3b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1317 microversion: 2.1 time: 0.227102 Jul 12 11:52:35.054177 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 441/940] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:34 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:35.067361 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-235a28f7-3897-495f-a3bb-9f5a197794f9 req-061842c3-7020-4172-aedd-39b15f52c30e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72", "tag": "827f4044-3788-44c6-9411-c923971bf9c5"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:35.090985 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-235a28f7-3897-495f-a3bb-9f5a197794f9 req-061842c3-7020-4172-aedd-39b15f52c30e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:35.091569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-235a28f7-3897-495f-a3bb-9f5a197794f9 req-061842c3-7020-4172-aedd-39b15f52c30e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:35.107303 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-235a28f7-3897-495f-a3bb-9f5a197794f9 req-061842c3-7020-4172-aedd-39b15f52c30e service nova] Creating event network-changed:827f4044-3788-44c6-9411-c923971bf9c5 for instance fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 on n-h1-849104-4 Jul 12 11:52:35.112684 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-235a28f7-3897-495f-a3bb-9f5a197794f9 req-061842c3-7020-4172-aedd-39b15f52c30e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048810 Jul 12 11:52:35.113630 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 500/941] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:35.228506 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1b069f25-59af-4722-b7a1-f87a1c12280a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:35.229577 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1b069f25-59af-4722-b7a1-f87a1c12280a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:35.240990 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1b069f25-59af-4722-b7a1-f87a1c12280a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:35.241764 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1b069f25-59af-4722-b7a1-f87a1c12280a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:35.243349 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1b069f25-59af-4722-b7a1-f87a1c12280a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:35.244018 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1b069f25-59af-4722-b7a1-f87a1c12280a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:35.471737 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b48252b6-941a-4da5-9f2f-8b1045399176 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:35.473514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b48252b6-941a-4da5-9f2f-8b1045399176 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:35.482503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b48252b6-941a-4da5-9f2f-8b1045399176 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:35.482942 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b48252b6-941a-4da5-9f2f-8b1045399176 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:35.483708 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b48252b6-941a-4da5-9f2f-8b1045399176 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:35.484428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b48252b6-941a-4da5-9f2f-8b1045399176 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:35.496627 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1b069f25-59af-4722-b7a1-f87a1c12280a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:35.512704 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1b069f25-59af-4722-b7a1-f87a1c12280a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1360 microversion: 2.1 time: 0.290600 Jul 12 11:52:35.513791 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 442/942] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:35 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1360 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:35.557732 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-04b8ad1c-8cc3-472d-b9b9-078aa508e4cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:35.558352 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-04b8ad1c-8cc3-472d-b9b9-078aa508e4cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:35.567694 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-04b8ad1c-8cc3-472d-b9b9-078aa508e4cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:35.568265 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-04b8ad1c-8cc3-472d-b9b9-078aa508e4cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:35.569049 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-04b8ad1c-8cc3-472d-b9b9-078aa508e4cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:35.569488 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-04b8ad1c-8cc3-472d-b9b9-078aa508e4cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:35.735804 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b48252b6-941a-4da5-9f2f-8b1045399176 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:35.753546 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b48252b6-941a-4da5-9f2f-8b1045399176 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1390 microversion: 2.1 time: 0.287821 Jul 12 11:52:35.755681 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 501/943] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:35 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1390 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:35.767769 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3aa4db61-233f-4fed-9385-1d9fe2919eae tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:35.769555 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3aa4db61-233f-4fed-9385-1d9fe2919eae tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:35.782312 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3aa4db61-233f-4fed-9385-1d9fe2919eae tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:35.783489 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3aa4db61-233f-4fed-9385-1d9fe2919eae tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:35.784658 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3aa4db61-233f-4fed-9385-1d9fe2919eae tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:35.785516 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3aa4db61-233f-4fed-9385-1d9fe2919eae tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:35.889908 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-04b8ad1c-8cc3-472d-b9b9-078aa508e4cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:35.893948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3aa4db61-233f-4fed-9385-1d9fe2919eae tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:35.902213 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-04b8ad1c-8cc3-472d-b9b9-078aa508e4cc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1378 microversion: 2.1 time: 0.348556 Jul 12 11:52:35.904967 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 443/944] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:35 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1378 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:35.907148 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3aa4db61-233f-4fed-9385-1d9fe2919eae tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:35.908885 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3aa4db61-233f-4fed-9385-1d9fe2919eae tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:35.923498 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3aa4db61-233f-4fed-9385-1d9fe2919eae tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.165580 Jul 12 11:52:35.924157 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 502/945] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:35 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:36.070650 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9bfa75a6-4e45-4236-b217-79b78f81bd5b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:36.072686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9bfa75a6-4e45-4236-b217-79b78f81bd5b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:36.082031 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9bfa75a6-4e45-4236-b217-79b78f81bd5b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:36.082609 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9bfa75a6-4e45-4236-b217-79b78f81bd5b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:36.084266 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9bfa75a6-4e45-4236-b217-79b78f81bd5b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:36.084938 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9bfa75a6-4e45-4236-b217-79b78f81bd5b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:36.252709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-51e4a379-c384-472a-b7f9-be6ffa017036 req-cefcd32b-d626-47ae-a160-07cd68b4feaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e523720-c162-4dac-a620-1e2325a63dfa", "name": "network-vif-plugged", "status": "completed", "tag": "5c3dfca1-7449-46f3-994a-4127c1b004e4"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:36.262947 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-51e4a379-c384-472a-b7f9-be6ffa017036 req-cefcd32b-d626-47ae-a160-07cd68b4feaa service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:36.263693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-51e4a379-c384-472a-b7f9-be6ffa017036 req-cefcd32b-d626-47ae-a160-07cd68b4feaa service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:36.277493 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-51e4a379-c384-472a-b7f9-be6ffa017036 req-cefcd32b-d626-47ae-a160-07cd68b4feaa service nova] Creating event network-vif-plugged:5c3dfca1-7449-46f3-994a-4127c1b004e4 for instance 7e523720-c162-4dac-a620-1e2325a63dfa on n-h2-849104-4 Jul 12 11:52:36.285335 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-51e4a379-c384-472a-b7f9-be6ffa017036 req-cefcd32b-d626-47ae-a160-07cd68b4feaa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037345 Jul 12 11:52:36.287416 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 503/946] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:52:36.288644 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9bfa75a6-4e45-4236-b217-79b78f81bd5b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:36.305521 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9bfa75a6-4e45-4236-b217-79b78f81bd5b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1317 microversion: 2.1 time: 0.238872 Jul 12 11:52:36.319571 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 444/947] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:36 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:36.531198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-99f2b9a7-8244-4ec4-b82c-dd38d0f73170 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:36.531916 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-99f2b9a7-8244-4ec4-b82c-dd38d0f73170 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:36.541891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-99f2b9a7-8244-4ec4-b82c-dd38d0f73170 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:36.542653 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-99f2b9a7-8244-4ec4-b82c-dd38d0f73170 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:36.544499 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-99f2b9a7-8244-4ec4-b82c-dd38d0f73170 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:36.545124 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-99f2b9a7-8244-4ec4-b82c-dd38d0f73170 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:36.786687 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2e1a539e-ca21-47a6-9d30-731b2e7b47de tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:36.788270 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2e1a539e-ca21-47a6-9d30-731b2e7b47de tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:36.803647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2e1a539e-ca21-47a6-9d30-731b2e7b47de tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:36.804618 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2e1a539e-ca21-47a6-9d30-731b2e7b47de tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:36.805681 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2e1a539e-ca21-47a6-9d30-731b2e7b47de tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:36.806127 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2e1a539e-ca21-47a6-9d30-731b2e7b47de tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:37.015155 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-99f2b9a7-8244-4ec4-b82c-dd38d0f73170 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:37.031424 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-99f2b9a7-8244-4ec4-b82c-dd38d0f73170 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1360 microversion: 2.1 time: 0.504413 Jul 12 11:52:37.033169 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 504/948] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:36 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1360 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:37.044190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6b55ed4e-3b53-4f97-8e4f-a9319b4a80f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:37.045984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6b55ed4e-3b53-4f97-8e4f-a9319b4a80f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:37.057062 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6b55ed4e-3b53-4f97-8e4f-a9319b4a80f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:37.057697 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6b55ed4e-3b53-4f97-8e4f-a9319b4a80f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:37.059427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6b55ed4e-3b53-4f97-8e4f-a9319b4a80f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:37.060162 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6b55ed4e-3b53-4f97-8e4f-a9319b4a80f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:37.162787 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2e1a539e-ca21-47a6-9d30-731b2e7b47de tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:37.190276 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2e1a539e-ca21-47a6-9d30-731b2e7b47de tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1390 microversion: 2.1 time: 0.411433 Jul 12 11:52:37.204378 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 445/949] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:36 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1390 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:37.211570 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fd46cbde-93a4-4b57-ae2c-c8382179c29b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:37.213493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fd46cbde-93a4-4b57-ae2c-c8382179c29b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:37.221842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd46cbde-93a4-4b57-ae2c-c8382179c29b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:37.222754 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd46cbde-93a4-4b57-ae2c-c8382179c29b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:37.223950 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd46cbde-93a4-4b57-ae2c-c8382179c29b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:37.224611 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd46cbde-93a4-4b57-ae2c-c8382179c29b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:37.323664 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6b55ed4e-3b53-4f97-8e4f-a9319b4a80f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:37.339015 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6b55ed4e-3b53-4f97-8e4f-a9319b4a80f9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1378 microversion: 2.1 time: 0.303200 Jul 12 11:52:37.341556 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 505/950] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:37 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1378 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:37.341805 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fd46cbde-93a4-4b57-ae2c-c8382179c29b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:37.351226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-920008a1-7572-49eb-8739-498f8fbd237b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:37.352846 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-920008a1-7572-49eb-8739-498f8fbd237b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:37.353452 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fd46cbde-93a4-4b57-ae2c-c8382179c29b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:37.356076 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fd46cbde-93a4-4b57-ae2c-c8382179c29b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:37.363664 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fd46cbde-93a4-4b57-ae2c-c8382179c29b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.157586 Jul 12 11:52:37.364634 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 446/951] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:37 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:37.372493 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-920008a1-7572-49eb-8739-498f8fbd237b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:37.373629 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-920008a1-7572-49eb-8739-498f8fbd237b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:37.375080 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-920008a1-7572-49eb-8739-498f8fbd237b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:37.375920 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-920008a1-7572-49eb-8739-498f8fbd237b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:37.582634 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-920008a1-7572-49eb-8739-498f8fbd237b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:37.595650 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-920008a1-7572-49eb-8739-498f8fbd237b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1317 microversion: 2.1 time: 0.251348 Jul 12 11:52:37.601986 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 506/952] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:37 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:38.054010 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-db06aff0-5726-4b43-a31a-bc528c603b0d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:38.055358 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-db06aff0-5726-4b43-a31a-bc528c603b0d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:38.069920 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db06aff0-5726-4b43-a31a-bc528c603b0d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:38.070881 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db06aff0-5726-4b43-a31a-bc528c603b0d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:38.072333 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db06aff0-5726-4b43-a31a-bc528c603b0d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:38.072787 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db06aff0-5726-4b43-a31a-bc528c603b0d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:38.212536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-557983bd-61ae-4585-af5f-62cd5e2e269b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:38.213567 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-557983bd-61ae-4585-af5f-62cd5e2e269b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:38.224791 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-557983bd-61ae-4585-af5f-62cd5e2e269b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:38.225830 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-557983bd-61ae-4585-af5f-62cd5e2e269b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:38.228181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-557983bd-61ae-4585-af5f-62cd5e2e269b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:38.228947 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-557983bd-61ae-4585-af5f-62cd5e2e269b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:38.337854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-db06aff0-5726-4b43-a31a-bc528c603b0d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:38.354150 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-db06aff0-5726-4b43-a31a-bc528c603b0d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1360 microversion: 2.1 time: 0.306667 Jul 12 11:52:38.356274 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 447/953] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:38 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1360 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:38.371136 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-975df5ed-b1cd-4dfc-800a-1e3222d3e3ef tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:38.371795 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-975df5ed-b1cd-4dfc-800a-1e3222d3e3ef tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:38.378405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-975df5ed-b1cd-4dfc-800a-1e3222d3e3ef tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:38.381504 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-975df5ed-b1cd-4dfc-800a-1e3222d3e3ef tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:38.383513 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-975df5ed-b1cd-4dfc-800a-1e3222d3e3ef tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:38.384248 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-975df5ed-b1cd-4dfc-800a-1e3222d3e3ef tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:38.551221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-557983bd-61ae-4585-af5f-62cd5e2e269b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:38.584645 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-557983bd-61ae-4585-af5f-62cd5e2e269b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1390 microversion: 2.1 time: 0.367452 Jul 12 11:52:38.598417 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 507/954] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:38 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1390 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:38.615848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a73520ed-d897-40f2-bba1-e3519fc3d1a9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:38.617560 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a73520ed-d897-40f2-bba1-e3519fc3d1a9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:38.618554 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-975df5ed-b1cd-4dfc-800a-1e3222d3e3ef tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:38.630354 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a73520ed-d897-40f2-bba1-e3519fc3d1a9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:38.631123 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a73520ed-d897-40f2-bba1-e3519fc3d1a9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:38.632589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a73520ed-d897-40f2-bba1-e3519fc3d1a9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:38.633500 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a73520ed-d897-40f2-bba1-e3519fc3d1a9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:38.644150 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-975df5ed-b1cd-4dfc-800a-1e3222d3e3ef tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1378 microversion: 2.1 time: 0.275327 Jul 12 11:52:38.645903 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 448/955] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:38 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1378 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:38.660350 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-bd82d90b-004f-4df0-b776-9b8c3874699c req-7994a462-394d-46aa-ab1e-f17621542a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c311469b-29d4-4011-b455-8fe3ffd81d3c", "name": "network-vif-plugged", "status": "completed", "tag": "4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:38.673027 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-bd82d90b-004f-4df0-b776-9b8c3874699c req-7994a462-394d-46aa-ab1e-f17621542a50 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:38.674136 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-bd82d90b-004f-4df0-b776-9b8c3874699c req-7994a462-394d-46aa-ab1e-f17621542a50 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:38.692161 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-bd82d90b-004f-4df0-b776-9b8c3874699c req-7994a462-394d-46aa-ab1e-f17621542a50 service nova] Creating event network-vif-plugged:4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec for instance c311469b-29d4-4011-b455-8fe3ffd81d3c on n-h2-849104-4 Jul 12 11:52:38.698939 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-bd82d90b-004f-4df0-b776-9b8c3874699c req-7994a462-394d-46aa-ab1e-f17621542a50 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051421 Jul 12 11:52:38.700842 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 449/956] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:38.706602 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2303e369-0c0e-44cf-885d-0366563c24ab tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:38.707732 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2303e369-0c0e-44cf-885d-0366563c24ab tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:38.716002 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2303e369-0c0e-44cf-885d-0366563c24ab tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:38.716493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2303e369-0c0e-44cf-885d-0366563c24ab tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:38.717308 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2303e369-0c0e-44cf-885d-0366563c24ab tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:38.717755 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2303e369-0c0e-44cf-885d-0366563c24ab tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:38.742077 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a73520ed-d897-40f2-bba1-e3519fc3d1a9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:38.759956 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a73520ed-d897-40f2-bba1-e3519fc3d1a9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:38.765261 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a73520ed-d897-40f2-bba1-e3519fc3d1a9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:38.779526 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a73520ed-d897-40f2-bba1-e3519fc3d1a9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.177287 Jul 12 11:52:38.782053 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 508/957] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:38 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:39.052295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2303e369-0c0e-44cf-885d-0366563c24ab tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:39.068484 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2303e369-0c0e-44cf-885d-0366563c24ab tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1317 microversion: 2.1 time: 0.365705 Jul 12 11:52:39.079654 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 450/958] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:38 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:39.378106 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b8b03629-991f-4bc8-a31b-f92d7e3abe2f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:39.378729 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b8b03629-991f-4bc8-a31b-f92d7e3abe2f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:39.398652 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b8b03629-991f-4bc8-a31b-f92d7e3abe2f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:39.399106 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b8b03629-991f-4bc8-a31b-f92d7e3abe2f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:39.404072 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b8b03629-991f-4bc8-a31b-f92d7e3abe2f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:39.404533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b8b03629-991f-4bc8-a31b-f92d7e3abe2f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:39.615506 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-115144ad-7f68-43c5-af80-8d15c400311a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:39.616247 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-115144ad-7f68-43c5-af80-8d15c400311a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:39.630171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-115144ad-7f68-43c5-af80-8d15c400311a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:39.630623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-115144ad-7f68-43c5-af80-8d15c400311a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:39.631459 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-115144ad-7f68-43c5-af80-8d15c400311a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:39.632112 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-115144ad-7f68-43c5-af80-8d15c400311a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:39.872650 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-115144ad-7f68-43c5-af80-8d15c400311a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:39.882050 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-115144ad-7f68-43c5-af80-8d15c400311a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1390 microversion: 2.1 time: 0.271769 Jul 12 11:52:39.882748 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 451/959] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:39 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1390 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:39.887724 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fd833dab-d9c9-4f52-84d0-8ac11f055682 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:39.888481 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fd833dab-d9c9-4f52-84d0-8ac11f055682 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:39.902128 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd833dab-d9c9-4f52-84d0-8ac11f055682 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:39.903125 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd833dab-d9c9-4f52-84d0-8ac11f055682 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:39.903930 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd833dab-d9c9-4f52-84d0-8ac11f055682 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:39.904435 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd833dab-d9c9-4f52-84d0-8ac11f055682 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:39.907637 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:40.126683 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fd833dab-d9c9-4f52-84d0-8ac11f055682 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:40.139270 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fd833dab-d9c9-4f52-84d0-8ac11f055682 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1378 microversion: 2.1 time: 0.255217 Jul 12 11:52:40.143721 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 452/960] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:39 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1378 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:40.155203 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b8b03629-991f-4bc8-a31b-f92d7e3abe2f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:40.156590 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-12f16138-c017-4803-b4be-078aee6035d6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:40.158900 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-12f16138-c017-4803-b4be-078aee6035d6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:40.164530 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b8b03629-991f-4bc8-a31b-f92d7e3abe2f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1360 microversion: 2.1 time: 0.793399 Jul 12 11:52:40.165682 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 509/961] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:39 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1360 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:40.172020 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-57f41ef2-1f87-4432-9d0b-cab7133a3433 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:40.179448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-57f41ef2-1f87-4432-9d0b-cab7133a3433 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:40.187574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-12f16138-c017-4803-b4be-078aee6035d6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:40.188234 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-12f16138-c017-4803-b4be-078aee6035d6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:40.188821 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-57f41ef2-1f87-4432-9d0b-cab7133a3433 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:40.189284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-12f16138-c017-4803-b4be-078aee6035d6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:40.189657 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-57f41ef2-1f87-4432-9d0b-cab7133a3433 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:40.189882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-12f16138-c017-4803-b4be-078aee6035d6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:40.191218 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-57f41ef2-1f87-4432-9d0b-cab7133a3433 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:40.191859 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-57f41ef2-1f87-4432-9d0b-cab7133a3433 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:40.281531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-12f16138-c017-4803-b4be-078aee6035d6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:40.295368 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-12f16138-c017-4803-b4be-078aee6035d6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:40.297514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-12f16138-c017-4803-b4be-078aee6035d6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:40.306183 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-12f16138-c017-4803-b4be-078aee6035d6 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1446 microversion: 2.75 time: 0.159357 Jul 12 11:52:40.307585 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 453/962] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:40 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1446 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:40.478756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-57f41ef2-1f87-4432-9d0b-cab7133a3433 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:40.488409 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-57f41ef2-1f87-4432-9d0b-cab7133a3433 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1466 microversion: 2.1 time: 0.321364 Jul 12 11:52:40.489251 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 510/963] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:40 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1466 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:40.512114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ea38f5c2-0cba-40dd-bbc6-6795128f55bf tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:40.512730 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ea38f5c2-0cba-40dd-bbc6-6795128f55bf tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:40.519929 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ea38f5c2-0cba-40dd-bbc6-6795128f55bf tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:40.520424 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ea38f5c2-0cba-40dd-bbc6-6795128f55bf tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:40.521223 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ea38f5c2-0cba-40dd-bbc6-6795128f55bf tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:40.521664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ea38f5c2-0cba-40dd-bbc6-6795128f55bf tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:40.770075 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ea38f5c2-0cba-40dd-bbc6-6795128f55bf tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1617 microversion: 2.1 time: 0.261629 Jul 12 11:52:40.771676 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 454/964] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:40 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1617 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:40.905766 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-40064bb2-32ab-45d2-8554-4a894856dc85 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:40.906779 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-40064bb2-32ab-45d2-8554-4a894856dc85 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:40.930482 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40064bb2-32ab-45d2-8554-4a894856dc85 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:40.936391 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40064bb2-32ab-45d2-8554-4a894856dc85 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:40.941831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40064bb2-32ab-45d2-8554-4a894856dc85 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:40.945935 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40064bb2-32ab-45d2-8554-4a894856dc85 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:41.004108 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-580230228", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["df49a9f0-90aa-4bd7-91c8-1df741ab59a3"]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:41.089654 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] validate_networks() for None {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:52:41.302371 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-40064bb2-32ab-45d2-8554-4a894856dc85 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:41.317632 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-40064bb2-32ab-45d2-8554-4a894856dc85 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1390 microversion: 2.1 time: 0.419129 Jul 12 11:52:41.318547 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 511/965] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:40 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1390 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:41.331917 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9a030f9a-79e4-49a7-89a5-0556370d3bc7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:41.333860 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9a030f9a-79e4-49a7-89a5-0556370d3bc7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:41.350342 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9a030f9a-79e4-49a7-89a5-0556370d3bc7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:41.353405 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9a030f9a-79e4-49a7-89a5-0556370d3bc7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:41.354790 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9a030f9a-79e4-49a7-89a5-0556370d3bc7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:41.364634 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9a030f9a-79e4-49a7-89a5-0556370d3bc7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:41.631434 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:52:41.631739 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:52:41.632234 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:52:41.632643 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:52:41.633232 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:52:41.659007 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:41.660159 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:41.661376 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:41.662349 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:41.702211 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:52:41.710120 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:52:41.731110 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:52:41.735706 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:52:41.802504 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6322b695-66fb-45fc-b420-62a53ffce822 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800474 Jul 12 11:52:41.809828 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 455/966] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:52:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:52:41.817873 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7035241f-c7c8-40dc-909f-5eb7db0311f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:41.818861 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7035241f-c7c8-40dc-909f-5eb7db0311f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:41.828880 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7035241f-c7c8-40dc-909f-5eb7db0311f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:41.830347 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7035241f-c7c8-40dc-909f-5eb7db0311f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:41.831704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7035241f-c7c8-40dc-909f-5eb7db0311f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:41.832586 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7035241f-c7c8-40dc-909f-5eb7db0311f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:42.001056 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9a030f9a-79e4-49a7-89a5-0556370d3bc7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:42.026047 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7035241f-c7c8-40dc-909f-5eb7db0311f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:42.035946 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7035241f-c7c8-40dc-909f-5eb7db0311f0 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1543 microversion: 2.1 time: 0.224213 Jul 12 11:52:42.050076 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 456/967] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:41 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1543 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:42.050076 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cea01e3c-f1f6-4c2c-8c93-586be6e62d5e tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:42.050076 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cea01e3c-f1f6-4c2c-8c93-586be6e62d5e tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:42.050711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cea01e3c-f1f6-4c2c-8c93-586be6e62d5e tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:42.051099 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cea01e3c-f1f6-4c2c-8c93-586be6e62d5e tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:42.057067 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cea01e3c-f1f6-4c2c-8c93-586be6e62d5e tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:42.057067 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cea01e3c-f1f6-4c2c-8c93-586be6e62d5e tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:42.061561 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9a030f9a-79e4-49a7-89a5-0556370d3bc7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1378 microversion: 2.1 time: 0.738445 Jul 12 11:52:42.073330 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 512/968] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:41 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1378 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:42.079530 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-bda0da8f-2869-4fd8-ae21-77d4d34a87c3 req-4628ef39-2e55-42b8-b698-0151f59a3d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46032186-539a-44ea-83fd-fd87925589d9", "name": "network-vif-plugged", "status": "completed", "tag": "8260de2a-72b7-4bc9-a2c3-b6cf940c5fa7"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:42.103822 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-bda0da8f-2869-4fd8-ae21-77d4d34a87c3 req-4628ef39-2e55-42b8-b698-0151f59a3d16 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:42.104665 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-bda0da8f-2869-4fd8-ae21-77d4d34a87c3 req-4628ef39-2e55-42b8-b698-0151f59a3d16 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:42.163370 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-bda0da8f-2869-4fd8-ae21-77d4d34a87c3 req-4628ef39-2e55-42b8-b698-0151f59a3d16 service nova] Creating event network-vif-plugged:8260de2a-72b7-4bc9-a2c3-b6cf940c5fa7 for instance 46032186-539a-44ea-83fd-fd87925589d9 on n-h2-849104-4 Jul 12 11:52:42.177957 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-cea01e3c-f1f6-4c2c-8c93-586be6e62d5e tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:42.196422 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-cea01e3c-f1f6-4c2c-8c93-586be6e62d5e tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:42.203267 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-cea01e3c-f1f6-4c2c-8c93-586be6e62d5e tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:42.212932 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-bda0da8f-2869-4fd8-ae21-77d4d34a87c3 req-4628ef39-2e55-42b8-b698-0151f59a3d16 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137915 Jul 12 11:52:42.218478 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cea01e3c-f1f6-4c2c-8c93-586be6e62d5e tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1452 microversion: 2.75 time: 0.178937 Jul 12 11:52:42.218623 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 513/969] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:42.220503 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 457/970] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:42 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:42.230658 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4f89058e-5eb1-41a8-8980-eb0cf06bd324 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:42.235580 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4f89058e-5eb1-41a8-8980-eb0cf06bd324 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:42.252277 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4f89058e-5eb1-41a8-8980-eb0cf06bd324 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:42.255660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4f89058e-5eb1-41a8-8980-eb0cf06bd324 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:42.256574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4f89058e-5eb1-41a8-8980-eb0cf06bd324 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:42.257083 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4f89058e-5eb1-41a8-8980-eb0cf06bd324 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:42.264916 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-45e9be79-221f-4d2e-bbce-8bca472cce33 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:42.269016 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-45e9be79-221f-4d2e-bbce-8bca472cce33 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:42.366771 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4f89058e-5eb1-41a8-8980-eb0cf06bd324 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142806 Jul 12 11:52:42.368481 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 458/971] 10.222.0.50 () {58 vars in 1274 bytes} [Tue Jul 12 11:52:42 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:42.374220 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f2d1b5df-c317-4efa-9296-84f75e994dec tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:42.375921 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f2d1b5df-c317-4efa-9296-84f75e994dec tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:42.395890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f2d1b5df-c317-4efa-9296-84f75e994dec tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:42.396624 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f2d1b5df-c317-4efa-9296-84f75e994dec tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:42.397456 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f2d1b5df-c317-4efa-9296-84f75e994dec tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:42.398101 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f2d1b5df-c317-4efa-9296-84f75e994dec tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:42.402647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-45e9be79-221f-4d2e-bbce-8bca472cce33 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:42.410230 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-45e9be79-221f-4d2e-bbce-8bca472cce33 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1216 microversion: 2.1 time: 0.173487 Jul 12 11:52:42.410828 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 514/972] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:42 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1216 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:42.772531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f2d1b5df-c317-4efa-9296-84f75e994dec tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:42.796617 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f2d1b5df-c317-4efa-9296-84f75e994dec tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1390 microversion: 2.1 time: 0.424134 Jul 12 11:52:42.797314 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 459/973] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:42 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1390 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:43.083642 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b5e77f3d-7aca-4404-8b4c-b1963b0fa4bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:43.084309 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b5e77f3d-7aca-4404-8b4c-b1963b0fa4bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:43.100684 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b5e77f3d-7aca-4404-8b4c-b1963b0fa4bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:43.101231 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b5e77f3d-7aca-4404-8b4c-b1963b0fa4bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:43.102038 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b5e77f3d-7aca-4404-8b4c-b1963b0fa4bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:43.102481 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b5e77f3d-7aca-4404-8b4c-b1963b0fa4bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:43.255711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a027bca6-16f3-4210-bfd9-640923e529d5 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:43.256368 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a027bca6-16f3-4210-bfd9-640923e529d5 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:43.279032 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a027bca6-16f3-4210-bfd9-640923e529d5 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:43.279491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a027bca6-16f3-4210-bfd9-640923e529d5 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:43.280339 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a027bca6-16f3-4210-bfd9-640923e529d5 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:43.280787 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a027bca6-16f3-4210-bfd9-640923e529d5 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:43.450977 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a027bca6-16f3-4210-bfd9-640923e529d5 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:43.462414 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a027bca6-16f3-4210-bfd9-640923e529d5 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:43.464585 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a027bca6-16f3-4210-bfd9-640923e529d5 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:43.472955 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a027bca6-16f3-4210-bfd9-640923e529d5 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1452 microversion: 2.75 time: 0.221143 Jul 12 11:52:43.486873 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 460/974] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:43 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1452 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:43.496560 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e69e458d-e9a3-475a-8d30-8d5be0f2246b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:43.498913 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e69e458d-e9a3-475a-8d30-8d5be0f2246b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:43.519606 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e69e458d-e9a3-475a-8d30-8d5be0f2246b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:43.520435 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e69e458d-e9a3-475a-8d30-8d5be0f2246b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:43.524370 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e69e458d-e9a3-475a-8d30-8d5be0f2246b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:43.525171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e69e458d-e9a3-475a-8d30-8d5be0f2246b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:43.535962 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b5e77f3d-7aca-4404-8b4c-b1963b0fa4bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:43.557827 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b5e77f3d-7aca-4404-8b4c-b1963b0fa4bb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1378 microversion: 2.1 time: 0.476508 Jul 12 11:52:43.572063 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 515/975] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:43 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1378 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:43.725220 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e69e458d-e9a3-475a-8d30-8d5be0f2246b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:43.743287 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e69e458d-e9a3-475a-8d30-8d5be0f2246b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1220 microversion: 2.1 time: 0.258499 Jul 12 11:52:43.744900 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 461/976] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:43 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1220 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:43.826468 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-78321622-4ffa-4aa2-adb0-9fbf9d974440 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:43.827633 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-78321622-4ffa-4aa2-adb0-9fbf9d974440 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:43.840867 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78321622-4ffa-4aa2-adb0-9fbf9d974440 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:43.850718 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78321622-4ffa-4aa2-adb0-9fbf9d974440 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:43.853964 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78321622-4ffa-4aa2-adb0-9fbf9d974440 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:43.858706 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78321622-4ffa-4aa2-adb0-9fbf9d974440 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:43.900332 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:44.220936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-78321622-4ffa-4aa2-adb0-9fbf9d974440 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:44.240158 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-78321622-4ffa-4aa2-adb0-9fbf9d974440 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1390 microversion: 2.1 time: 0.425051 Jul 12 11:52:44.252572 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 516/977] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:43 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1390 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:44.497812 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-93ec180d-b84a-4389-94bd-8aa58ad19d5c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:44.506990 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-93ec180d-b84a-4389-94bd-8aa58ad19d5c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:44.528659 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93ec180d-b84a-4389-94bd-8aa58ad19d5c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:44.529978 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93ec180d-b84a-4389-94bd-8aa58ad19d5c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:44.536826 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93ec180d-b84a-4389-94bd-8aa58ad19d5c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:44.538449 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93ec180d-b84a-4389-94bd-8aa58ad19d5c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:44.586515 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-767ed358-be41-4a3f-a677-48dc025d9fc0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:44.587474 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-767ed358-be41-4a3f-a677-48dc025d9fc0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:44.609345 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-767ed358-be41-4a3f-a677-48dc025d9fc0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:44.609801 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-767ed358-be41-4a3f-a677-48dc025d9fc0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:44.610618 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-767ed358-be41-4a3f-a677-48dc025d9fc0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:44.611064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-767ed358-be41-4a3f-a677-48dc025d9fc0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:44.952147 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-93ec180d-b84a-4389-94bd-8aa58ad19d5c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:44.965922 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-93ec180d-b84a-4389-94bd-8aa58ad19d5c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:44.967716 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-93ec180d-b84a-4389-94bd-8aa58ad19d5c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:44.981827 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-93ec180d-b84a-4389-94bd-8aa58ad19d5c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1452 microversion: 2.75 time: 0.490447 Jul 12 11:52:44.987456 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 462/978] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:44 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1452 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:44.995250 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6e562240-104e-464a-b034-d1377fbaffd1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:44.996062 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6e562240-104e-464a-b034-d1377fbaffd1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:45.010253 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e562240-104e-464a-b034-d1377fbaffd1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:45.010731 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e562240-104e-464a-b034-d1377fbaffd1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:45.020075 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e562240-104e-464a-b034-d1377fbaffd1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:45.026901 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e562240-104e-464a-b034-d1377fbaffd1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:45.154646 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6e562240-104e-464a-b034-d1377fbaffd1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:45.176289 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6e562240-104e-464a-b034-d1377fbaffd1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1212 microversion: 2.1 time: 0.187255 Jul 12 11:52:45.179774 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 463/979] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:44 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1212 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:45.191491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-d1dc89a6-c24d-439d-9818-18a75a866f61 req-fa0a66f8-93f8-4514-8386-299183cbe9fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec6989c-9a01-4cd9-a91b-421af9130b46", "tag": "694302fc-4796-4f12-bc02-b17c9376ebbb"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:45.195442 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-767ed358-be41-4a3f-a677-48dc025d9fc0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:45.210172 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-d1dc89a6-c24d-439d-9818-18a75a866f61 req-fa0a66f8-93f8-4514-8386-299183cbe9fe service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:45.210973 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-d1dc89a6-c24d-439d-9818-18a75a866f61 req-fa0a66f8-93f8-4514-8386-299183cbe9fe service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:45.217233 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-767ed358-be41-4a3f-a677-48dc025d9fc0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1378 microversion: 2.1 time: 0.634869 Jul 12 11:52:45.227818 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 517/980] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:44 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1378 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:45.239247 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-d1dc89a6-c24d-439d-9818-18a75a866f61 req-fa0a66f8-93f8-4514-8386-299183cbe9fe service nova] Creating event network-changed:694302fc-4796-4f12-bc02-b17c9376ebbb for instance dec6989c-9a01-4cd9-a91b-421af9130b46 on n-h2-849104-4 Jul 12 11:52:45.250115 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-d1dc89a6-c24d-439d-9818-18a75a866f61 req-fa0a66f8-93f8-4514-8386-299183cbe9fe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065967 Jul 12 11:52:45.252309 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 464/981] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:45.268372 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-009190c6-ed03-4d01-962d-90137d8f9158 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:45.269279 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-009190c6-ed03-4d01-962d-90137d8f9158 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:45.278185 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-009190c6-ed03-4d01-962d-90137d8f9158 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:45.279100 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-009190c6-ed03-4d01-962d-90137d8f9158 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:45.280248 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-009190c6-ed03-4d01-962d-90137d8f9158 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:45.280882 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-009190c6-ed03-4d01-962d-90137d8f9158 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:45.543815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-009190c6-ed03-4d01-962d-90137d8f9158 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:45.566467 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-009190c6-ed03-4d01-962d-90137d8f9158 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1390 microversion: 2.1 time: 0.303209 Jul 12 11:52:45.571938 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 518/982] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:45 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1390 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:45.675472 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-db56fae8-86ac-449c-b466-8607d9fb7a73 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Calling method '.version_select at 0x7f5e0ab5b790>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:45.719000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG neutronclient.v2_0.client [None req-db56fae8-86ac-449c-b466-8607d9fb7a73 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bc1dafce-7989-479b-9784-2f0ad7d75681 does not exist", "detail": ""}} {{(pid=125983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 12 11:52:45.720117 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.security_group_api [None req-db56fae8-86ac-449c-b466-8607d9fb7a73 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Neutron security group bc1dafce-7989-479b-9784-2f0ad7d75681 not found {{(pid=125983) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 12 11:52:45.721555 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-db56fae8-86ac-449c-b466-8607d9fb7a73 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] HTTP exception thrown: Security group bc1dafce-7989-479b-9784-2f0ad7d75681 does not exist Jul 12 11:52:45.721555 n-d-849104-4 devstack@n-api.service[125983]: Neutron server returns request_ids: ['req-bcca6661-b1bd-4e07-910f-a99efab7660d'] Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-db56fae8-86ac-449c-b466-8607d9fb7a73 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Request method failure captured: Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/os-security-groups/bc1dafce-7989-479b-9784-2f0ad7d75681 HTTP/1.1 Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWCN_dgVZ7xXG1XBFE6FcR4GL0bLwhM0LTeMMqSfYf4ju2gS67ZsdjD28KY9O2hcOCcZt1dT0w7-VcPYQja5v3Z09-TbFF2TTYJl_wp3sMSF9ba6CgLRgZMht4UfYxwvDpRDKPdT0VVKoaS7hawutmmWncrJJC49o0PCCcLeXvkUfJE Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: ffdd9876971d4a67ad64b0c7366d4e20 Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1423513109 Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ffdd9876971d4a67ad64b0c7366d4e20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ffdd9876971d4a67ad64b0c7366d4e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ffdd9876971d4a67ad64b0c7366d4e20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ffdd9876971d4a67ad64b0c7366d4e20", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1423513109 Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: ffdd9876971d4a67ad64b0c7366d4e20 Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1423513109 Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-SecurityGroupsNegativeTestJSON-1423513109-project Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: ec9ae52a7ea348b0838af719bad0f093 Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1423513109-project Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: exception: Security group bc1dafce-7989-479b-9784-2f0ad7d75681 does not exist Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: Neutron server returns request_ids: ['req-bcca6661-b1bd-4e07-910f-a99efab7660d'] Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'bc1dafce-7989-479b-9784-2f0ad7d75681'} Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 12 11:52:45.726298 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bc1dafce-7989-479b-9784-2f0ad7d75681 does not exist Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcca6661-b1bd-4e07-910f-a99efab7660d'] Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bc1dafce-7989-479b-9784-2f0ad7d75681 does not exist Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcca6661-b1bd-4e07-910f-a99efab7660d'] Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bc1dafce-7989-479b-9784-2f0ad7d75681 does not exist Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcca6661-b1bd-4e07-910f-a99efab7660d'] Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bc1dafce-7989-479b-9784-2f0ad7d75681 does not exist Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcca6661-b1bd-4e07-910f-a99efab7660d'] Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-db56fae8-86ac-449c-b466-8607d9fb7a73 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Returning 404 to user: Security group bc1dafce-7989-479b-9784-2f0ad7d75681 does not exist Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: Neutron server returns request_ids: ['req-bcca6661-b1bd-4e07-910f-a99efab7660d'] {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-db56fae8-86ac-449c-b466-8607d9fb7a73 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/bc1dafce-7989-479b-9784-2f0ad7d75681" status: 404 len: 194 microversion: 2.1 time: 0.362387 Jul 12 11:52:45.734235 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 465/983] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:52:45 2022] DELETE /compute/v2.1/os-security-groups/bc1dafce-7989-479b-9784-2f0ad7d75681 => generated 194 bytes in 365 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 11:52:45.749101 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-16d14711-7f44-4452-816f-c539426810ec tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.006981 Jul 12 11:52:45.749101 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 519/984] 10.222.0.50 () {58 vars in 1163 bytes} [Tue Jul 12 11:52:45 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 11:52:45.765284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ba8f6d31-f015-467b-b955-d5f26fd45a35 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Calling method '.version_select at 0x7f5e0ac5f940>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:46.017703 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ba8f6d31-f015-467b-b955-d5f26fd45a35 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.260541 Jul 12 11:52:46.018449 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 466/985] 10.222.0.50 () {58 vars in 1157 bytes} [Tue Jul 12 11:52:45 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:46.032019 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9eb5cb97-d337-46e6-afaa-8eceaf07eb3f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:46.033028 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9eb5cb97-d337-46e6-afaa-8eceaf07eb3f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:46.036983 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-94588cd9-f1b0-4b7f-a98c-6c49cf0393b2 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Calling method '.version_select at 0x7f5e0ac5fa60>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:46.043742 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9eb5cb97-d337-46e6-afaa-8eceaf07eb3f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:46.044704 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9eb5cb97-d337-46e6-afaa-8eceaf07eb3f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:46.046001 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9eb5cb97-d337-46e6-afaa-8eceaf07eb3f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:46.046846 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9eb5cb97-d337-46e6-afaa-8eceaf07eb3f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:46.172481 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9eb5cb97-d337-46e6-afaa-8eceaf07eb3f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:46.196995 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9eb5cb97-d337-46e6-afaa-8eceaf07eb3f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:46.200372 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9eb5cb97-d337-46e6-afaa-8eceaf07eb3f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:46.210431 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9eb5cb97-d337-46e6-afaa-8eceaf07eb3f tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1452 microversion: 2.75 time: 0.193959 Jul 12 11:52:46.212320 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 520/986] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:46 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1452 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:46.222604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-01ab5420-ee1b-4a6b-b49f-975eec556711 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:46.228649 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-01ab5420-ee1b-4a6b-b49f-975eec556711 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:46.258976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-01ab5420-ee1b-4a6b-b49f-975eec556711 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:46.267528 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-01ab5420-ee1b-4a6b-b49f-975eec556711 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:46.269486 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-01ab5420-ee1b-4a6b-b49f-975eec556711 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:46.272753 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-01ab5420-ee1b-4a6b-b49f-975eec556711 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:46.326429 n-d-849104-4 devstack@n-api.service[125983]: DEBUG neutronclient.v2_0.client [None req-94588cd9-f1b0-4b7f-a98c-6c49cf0393b2 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=125983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 12 11:52:46.327886 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-94588cd9-f1b0-4b7f-a98c-6c49cf0393b2 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 12 11:52:46.327886 n-d-849104-4 devstack@n-api.service[125983]: Neutron server returns request_ids: ['req-9e3b21f7-ca16-4cb8-b4f1-2af1cd857994'] Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-94588cd9-f1b0-4b7f-a98c-6c49cf0393b2 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Request method failure captured: Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/os-security-groups/d7c1b22e-0b5d-4c0a-afb0-415eaa8c156d HTTP/1.1 Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWCN_dgVZ7xXG1XBFE6FcR4GL0bLwhM0LTeMMqSfYf4ju2gS67ZsdjD28KY9O2hcOCcZt1dT0w7-VcPYQja5v3Z09-TbFF2TTYJl_wp3sMSF9ba6CgLRgZMht4UfYxwvDpRDKPdT0VVKoaS7hawutmmWncrJJC49o0PCCcLeXvkUfJE Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: ffdd9876971d4a67ad64b0c7366d4e20 Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1423513109 Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ffdd9876971d4a67ad64b0c7366d4e20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ffdd9876971d4a67ad64b0c7366d4e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ffdd9876971d4a67ad64b0c7366d4e20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ffdd9876971d4a67ad64b0c7366d4e20", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1423513109 Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: ffdd9876971d4a67ad64b0c7366d4e20 Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1423513109 Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-SecurityGroupsNegativeTestJSON-1423513109-project Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: ec9ae52a7ea348b0838af719bad0f093 Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1423513109-project Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: exception: Insufficient rights for removing default security group. Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: Neutron server returns request_ids: ['req-9e3b21f7-ca16-4cb8-b4f1-2af1cd857994'] Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'd7c1b22e-0b5d-4c0a-afb0-415eaa8c156d'} Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 12 11:52:46.334339 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e3b21f7-ca16-4cb8-b4f1-2af1cd857994'] Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e3b21f7-ca16-4cb8-b4f1-2af1cd857994'] Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e3b21f7-ca16-4cb8-b4f1-2af1cd857994'] Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e3b21f7-ca16-4cb8-b4f1-2af1cd857994'] Jul 12 11:52:46.342662 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.350537 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-94588cd9-f1b0-4b7f-a98c-6c49cf0393b2 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 12 11:52:46.350537 n-d-849104-4 devstack@n-api.service[125983]: Neutron server returns request_ids: ['req-9e3b21f7-ca16-4cb8-b4f1-2af1cd857994'] {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:52:46.352838 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-94588cd9-f1b0-4b7f-a98c-6c49cf0393b2 tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/d7c1b22e-0b5d-4c0a-afb0-415eaa8c156d" status: 400 len: 182 microversion: 2.1 time: 0.323115 Jul 12 11:52:46.354197 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 467/987] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:52:46 2022] DELETE /compute/v2.1/os-security-groups/d7c1b22e-0b5d-4c0a-afb0-415eaa8c156d => generated 182 bytes in 326 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 11:52:46.386580 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-acd0a51e-2761-4853-b0ff-50fbe475dbb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:46.388016 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-acd0a51e-2761-4853-b0ff-50fbe475dbb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:46.410229 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-01ab5420-ee1b-4a6b-b49f-975eec556711 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:46.418507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-acd0a51e-2761-4853-b0ff-50fbe475dbb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:46.419309 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-acd0a51e-2761-4853-b0ff-50fbe475dbb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:46.419974 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-01ab5420-ee1b-4a6b-b49f-975eec556711 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1268 microversion: 2.1 time: 0.205800 Jul 12 11:52:46.420850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-acd0a51e-2761-4853-b0ff-50fbe475dbb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:46.421223 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 521/988] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:46 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1268 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:46.421496 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-acd0a51e-2761-4853-b0ff-50fbe475dbb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:46.426503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a7654218-e7ad-4540-8e34-41cf2273d63a tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Calling method '.version_select at 0x7f5e0a0243a0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:46.453694 n-d-849104-4 devstack@n-api.service[125984]: DEBUG neutronclient.v2_0.client [None req-a7654218-e7ad-4540-8e34-41cf2273d63a tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ea09e481-cc4e-432a-a6ce-1d3fc77abe11 does not exist", "detail": ""}} {{(pid=125984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 12 11:52:46.455323 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.security_group_api [None req-a7654218-e7ad-4540-8e34-41cf2273d63a tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Neutron security group ea09e481-cc4e-432a-a6ce-1d3fc77abe11 not found {{(pid=125984) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 12 11:52:46.458272 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-a7654218-e7ad-4540-8e34-41cf2273d63a tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] HTTP exception thrown: Security group ea09e481-cc4e-432a-a6ce-1d3fc77abe11 does not exist Jul 12 11:52:46.458272 n-d-849104-4 devstack@n-api.service[125984]: Neutron server returns request_ids: ['req-c4aa05c5-e12b-4eb1-bf43-523e6cf84670'] Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a7654218-e7ad-4540-8e34-41cf2273d63a tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Request method failure captured: Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/os-security-groups/ea09e481-cc4e-432a-a6ce-1d3fc77abe11 HTTP/1.1 Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWCN_dgVZ7xXG1XBFE6FcR4GL0bLwhM0LTeMMqSfYf4ju2gS67ZsdjD28KY9O2hcOCcZt1dT0w7-VcPYQja5v3Z09-TbFF2TTYJl_wp3sMSF9ba6CgLRgZMht4UfYxwvDpRDKPdT0VVKoaS7hawutmmWncrJJC49o0PCCcLeXvkUfJE Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: ffdd9876971d4a67ad64b0c7366d4e20 Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1423513109 Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ffdd9876971d4a67ad64b0c7366d4e20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ffdd9876971d4a67ad64b0c7366d4e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ffdd9876971d4a67ad64b0c7366d4e20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ffdd9876971d4a67ad64b0c7366d4e20", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1423513109 Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: ffdd9876971d4a67ad64b0c7366d4e20 Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1423513109 Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-SecurityGroupsNegativeTestJSON-1423513109-project Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: ec9ae52a7ea348b0838af719bad0f093 Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1423513109-project Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: exception: Security group ea09e481-cc4e-432a-a6ce-1d3fc77abe11 does not exist Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: Neutron server returns request_ids: ['req-c4aa05c5-e12b-4eb1-bf43-523e6cf84670'] Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'ea09e481-cc4e-432a-a6ce-1d3fc77abe11'} Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 12 11:52:46.469756 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ea09e481-cc4e-432a-a6ce-1d3fc77abe11 does not exist Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4aa05c5-e12b-4eb1-bf43-523e6cf84670'] Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ea09e481-cc4e-432a-a6ce-1d3fc77abe11 does not exist Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4aa05c5-e12b-4eb1-bf43-523e6cf84670'] Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ea09e481-cc4e-432a-a6ce-1d3fc77abe11 does not exist Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4aa05c5-e12b-4eb1-bf43-523e6cf84670'] Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ea09e481-cc4e-432a-a6ce-1d3fc77abe11 does not exist Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4aa05c5-e12b-4eb1-bf43-523e6cf84670'] Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a7654218-e7ad-4540-8e34-41cf2273d63a tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Returning 404 to user: Security group ea09e481-cc4e-432a-a6ce-1d3fc77abe11 does not exist Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: Neutron server returns request_ids: ['req-c4aa05c5-e12b-4eb1-bf43-523e6cf84670'] {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a7654218-e7ad-4540-8e34-41cf2273d63a tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/ea09e481-cc4e-432a-a6ce-1d3fc77abe11" status: 404 len: 194 microversion: 2.1 time: 0.049572 Jul 12 11:52:46.477883 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 522/989] 10.222.0.50 () {58 vars in 1268 bytes} [Tue Jul 12 11:52:46 2022] GET /compute/v2.1/os-security-groups/ea09e481-cc4e-432a-a6ce-1d3fc77abe11 => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:52:46.498317 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8df3150e-d403-47ca-8cbf-fd826ada8cee tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Action: 'update', calling method: .version_select at 0x7f5e09e974c0>, body: {"security_group": {"name": "tempest-sg-1795771369", "description": "tempest-description-840791120"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:46.550562 n-d-849104-4 devstack@n-api.service[125984]: DEBUG neutronclient.v2_0.client [None req-8df3150e-d403-47ca-8cbf-fd826ada8cee tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a4ec6ed7-b390-4c4c-8edb-0b228373320b does not exist", "detail": ""}} {{(pid=125984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 12 11:52:46.552367 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.security_group_api [None req-8df3150e-d403-47ca-8cbf-fd826ada8cee tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Neutron security group a4ec6ed7-b390-4c4c-8edb-0b228373320b not found {{(pid=125984) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 12 11:52:46.553296 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-8df3150e-d403-47ca-8cbf-fd826ada8cee tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] HTTP exception thrown: Security group a4ec6ed7-b390-4c4c-8edb-0b228373320b does not exist Jul 12 11:52:46.553296 n-d-849104-4 devstack@n-api.service[125984]: Neutron server returns request_ids: ['req-37604505-83ed-4775-b394-926bc10e804a'] Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8df3150e-d403-47ca-8cbf-fd826ada8cee tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Request method failure captured: Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: request: PUT /compute/v2.1/os-security-groups/a4ec6ed7-b390-4c4c-8edb-0b228373320b HTTP/1.1 Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 101 Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWCN_dgVZ7xXG1XBFE6FcR4GL0bLwhM0LTeMMqSfYf4ju2gS67ZsdjD28KY9O2hcOCcZt1dT0w7-VcPYQja5v3Z09-TbFF2TTYJl_wp3sMSF9ba6CgLRgZMht4UfYxwvDpRDKPdT0VVKoaS7hawutmmWncrJJC49o0PCCcLeXvkUfJE Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: ffdd9876971d4a67ad64b0c7366d4e20 Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1423513109 Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ffdd9876971d4a67ad64b0c7366d4e20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ffdd9876971d4a67ad64b0c7366d4e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ffdd9876971d4a67ad64b0c7366d4e20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ffdd9876971d4a67ad64b0c7366d4e20", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1423513109 Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: ffdd9876971d4a67ad64b0c7366d4e20 Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1423513109 Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-SecurityGroupsNegativeTestJSON-1423513109-project Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: ec9ae52a7ea348b0838af719bad0f093 Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1423513109-project Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: {"security_group": {"name": "tempest-sg-1795771369", "description": "tempest-description-840791120"}} Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: exception: Security group a4ec6ed7-b390-4c4c-8edb-0b228373320b does not exist Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: Neutron server returns request_ids: ['req-37604505-83ed-4775-b394-926bc10e804a'] Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'a4ec6ed7-b390-4c4c-8edb-0b228373320b', 'body': {'security_group': {'name': 'tempest-sg-1795771369', 'description': 'tempest-description-840791120'}}} Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 12 11:52:46.559497 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a4ec6ed7-b390-4c4c-8edb-0b228373320b does not exist Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-37604505-83ed-4775-b394-926bc10e804a'] Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a4ec6ed7-b390-4c4c-8edb-0b228373320b does not exist Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-37604505-83ed-4775-b394-926bc10e804a'] Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a4ec6ed7-b390-4c4c-8edb-0b228373320b does not exist Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-37604505-83ed-4775-b394-926bc10e804a'] Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a4ec6ed7-b390-4c4c-8edb-0b228373320b does not exist Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-37604505-83ed-4775-b394-926bc10e804a'] Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8df3150e-d403-47ca-8cbf-fd826ada8cee tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] Returning 404 to user: Security group a4ec6ed7-b390-4c4c-8edb-0b228373320b does not exist Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: Neutron server returns request_ids: ['req-37604505-83ed-4775-b394-926bc10e804a'] {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:52:46.565810 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8df3150e-d403-47ca-8cbf-fd826ada8cee tempest-SecurityGroupsNegativeTestJSON-1423513109 tempest-SecurityGroupsNegativeTestJSON-1423513109-project] 10.222.0.50 "PUT /compute/v2.1/os-security-groups/a4ec6ed7-b390-4c4c-8edb-0b228373320b" status: 404 len: 194 microversion: 2.1 time: 0.082134 Jul 12 11:52:46.583337 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 523/990] 10.222.0.50 () {60 vars in 1289 bytes} [Tue Jul 12 11:52:46 2022] PUT /compute/v2.1/os-security-groups/a4ec6ed7-b390-4c4c-8edb-0b228373320b => generated 194 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:52:46.604836 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d59fc38b-f6d5-457f-9a3a-aa8b2ed980f3 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:46.605984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d59fc38b-f6d5-457f-9a3a-aa8b2ed980f3 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:46.638000 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d59fc38b-f6d5-457f-9a3a-aa8b2ed980f3 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:46.638604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d59fc38b-f6d5-457f-9a3a-aa8b2ed980f3 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:46.641188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d59fc38b-f6d5-457f-9a3a-aa8b2ed980f3 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:46.641188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d59fc38b-f6d5-457f-9a3a-aa8b2ed980f3 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:46.821031 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-acd0a51e-2761-4853-b0ff-50fbe475dbb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:46.857658 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-acd0a51e-2761-4853-b0ff-50fbe475dbb2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1528 microversion: 2.1 time: 0.500819 Jul 12 11:52:46.859160 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 468/991] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:46 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1528 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:46.881665 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-99feeb6b-e720-463c-92b0-78d2e6cbf060 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:46.882712 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-99feeb6b-e720-463c-92b0-78d2e6cbf060 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:46.895370 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99feeb6b-e720-463c-92b0-78d2e6cbf060 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:46.905345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99feeb6b-e720-463c-92b0-78d2e6cbf060 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:46.907558 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99feeb6b-e720-463c-92b0-78d2e6cbf060 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:46.909515 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99feeb6b-e720-463c-92b0-78d2e6cbf060 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:47.290907 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-99feeb6b-e720-463c-92b0-78d2e6cbf060 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:47.320512 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-99feeb6b-e720-463c-92b0-78d2e6cbf060 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1528 microversion: 2.1 time: 0.430762 Jul 12 11:52:47.320512 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 469/992] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:46 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1528 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:47.320512 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-48a9964c-ded0-4a9b-ba55-123d205cd51c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:47.326730 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-48a9964c-ded0-4a9b-ba55-123d205cd51c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:47.348793 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-48a9964c-ded0-4a9b-ba55-123d205cd51c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:47.349444 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-48a9964c-ded0-4a9b-ba55-123d205cd51c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:47.350503 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-48a9964c-ded0-4a9b-ba55-123d205cd51c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:47.351098 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-48a9964c-ded0-4a9b-ba55-123d205cd51c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:47.543776 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-48a9964c-ded0-4a9b-ba55-123d205cd51c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:47.558146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-48a9964c-ded0-4a9b-ba55-123d205cd51c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:47.566304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-48a9964c-ded0-4a9b-ba55-123d205cd51c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:47.576075 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-48a9964c-ded0-4a9b-ba55-123d205cd51c tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1452 microversion: 2.75 time: 0.269517 Jul 12 11:52:47.576726 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 470/993] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:47 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1452 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:47.589143 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5016424d-c990-41a5-be83-d14a262c22ea tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:47.592986 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:52:47.592986 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:52:47.612575 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d59fc38b-f6d5-457f-9a3a-aa8b2ed980f3 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:47.626123 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d59fc38b-f6d5-457f-9a3a-aa8b2ed980f3 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1390 microversion: 2.1 time: 1.029309 Jul 12 11:52:47.626897 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:47.630761 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 524/994] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:46 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1390 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:47.647328 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c03ca028-a328-40e1-a879-f7ed5075e352 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:47.648477 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c03ca028-a328-40e1-a879-f7ed5075e352 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:47.662931 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5016424d-c990-41a5-be83-d14a262c22ea tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/99584907-24af-440f-aca4-b873a3768d9a" status: 202 len: 0 microversion: 2.1 time: 0.084483 Jul 12 11:52:47.668686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c03ca028-a328-40e1-a879-f7ed5075e352 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:47.669973 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 471/995] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:52:47 2022] DELETE /compute/v2.1/flavors/99584907-24af-440f-aca4-b873a3768d9a => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:52:47.670205 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c03ca028-a328-40e1-a879-f7ed5075e352 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:47.670955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c03ca028-a328-40e1-a879-f7ed5075e352 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:47.671399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c03ca028-a328-40e1-a879-f7ed5075e352 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:47.680770 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ec006b8d-3c8c-41a5-9aaf-ff1d5d01cdcb tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:47.722448 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ec006b8d-3c8c-41a5-9aaf-ff1d5d01cdcb tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.049590 Jul 12 11:52:47.726158 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 472/996] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:52:47 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:47.760866 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-02aa4b21-4f27-4459-bc7a-5f74cc6b732a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:47.764250 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-02aa4b21-4f27-4459-bc7a-5f74cc6b732a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:47.775369 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02aa4b21-4f27-4459-bc7a-5f74cc6b732a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:47.776432 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02aa4b21-4f27-4459-bc7a-5f74cc6b732a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:47.778930 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02aa4b21-4f27-4459-bc7a-5f74cc6b732a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:47.780073 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02aa4b21-4f27-4459-bc7a-5f74cc6b732a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:47.791151 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c03ca028-a328-40e1-a879-f7ed5075e352 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:47.800644 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c03ca028-a328-40e1-a879-f7ed5075e352 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1268 microversion: 2.1 time: 0.168294 Jul 12 11:52:47.814222 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 525/997] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:47 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:48.022648 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-02aa4b21-4f27-4459-bc7a-5f74cc6b732a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:48.046013 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-02aa4b21-4f27-4459-bc7a-5f74cc6b732a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Old instance type tempest-test_resize_flavor_-465761821, new instance type m1.heat {{(pid=125983) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 12 11:52:48.069178 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-02aa4b21-4f27-4459-bc7a-5f74cc6b732a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:52:48.069686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-02aa4b21-4f27-4459-bc7a-5f74cc6b732a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:52:48.070381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-02aa4b21-4f27-4459-bc7a-5f74cc6b732a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:52:48.070861 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-02aa4b21-4f27-4459-bc7a-5f74cc6b732a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:52:48.071636 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-02aa4b21-4f27-4459-bc7a-5f74cc6b732a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:52:48.362159 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-02aa4b21-4f27-4459-bc7a-5f74cc6b732a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "POST /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c/action" status: 202 len: 0 microversion: 2.1 time: 0.621705 Jul 12 11:52:48.366791 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 473/998] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:52:47 2022] POST /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:52:48.377147 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-58ab8cff-8fb2-42cf-ae57-d9bfb9d6f45e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:48.378582 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-58ab8cff-8fb2-42cf-ae57-d9bfb9d6f45e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:48.398555 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58ab8cff-8fb2-42cf-ae57-d9bfb9d6f45e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:48.399435 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58ab8cff-8fb2-42cf-ae57-d9bfb9d6f45e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:48.400504 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58ab8cff-8fb2-42cf-ae57-d9bfb9d6f45e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:48.401235 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58ab8cff-8fb2-42cf-ae57-d9bfb9d6f45e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:48.612845 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b7936566-e1e7-4213-9786-88d51f43c9db tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:48.613569 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b7936566-e1e7-4213-9786-88d51f43c9db tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:48.628090 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b7936566-e1e7-4213-9786-88d51f43c9db tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:48.628569 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b7936566-e1e7-4213-9786-88d51f43c9db tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:48.629461 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b7936566-e1e7-4213-9786-88d51f43c9db tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:48.638566 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b7936566-e1e7-4213-9786-88d51f43c9db tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:48.685995 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:48.838998 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-58ab8cff-8fb2-42cf-ae57-d9bfb9d6f45e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:48.854638 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-58ab8cff-8fb2-42cf-ae57-d9bfb9d6f45e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1537 microversion: 2.1 time: 0.486110 Jul 12 11:52:48.875383 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 526/999] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:48 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1537 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:48.884803 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-65243f09-787d-461a-91e8-ad309e6efda6 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:48.886491 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-65243f09-787d-461a-91e8-ad309e6efda6 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:48.899563 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65243f09-787d-461a-91e8-ad309e6efda6 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:48.900832 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65243f09-787d-461a-91e8-ad309e6efda6 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:48.901745 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b7936566-e1e7-4213-9786-88d51f43c9db tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:48.903171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65243f09-787d-461a-91e8-ad309e6efda6 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:48.904261 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65243f09-787d-461a-91e8-ad309e6efda6 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:48.920514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b7936566-e1e7-4213-9786-88d51f43c9db tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:48.958755 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b7936566-e1e7-4213-9786-88d51f43c9db tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:48.979915 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b7936566-e1e7-4213-9786-88d51f43c9db tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1452 microversion: 2.75 time: 0.372905 Jul 12 11:52:48.985116 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 474/1000] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:48 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1452 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:52:48.990859 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-061a2895-0630-4e69-894d-04c4acc3f47a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:48.991607 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-061a2895-0630-4e69-894d-04c4acc3f47a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:49.001619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-061a2895-0630-4e69-894d-04c4acc3f47a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:49.002574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-061a2895-0630-4e69-894d-04c4acc3f47a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:49.003955 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-061a2895-0630-4e69-894d-04c4acc3f47a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:49.004714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-061a2895-0630-4e69-894d-04c4acc3f47a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:49.182243 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-061a2895-0630-4e69-894d-04c4acc3f47a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:49.231954 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-061a2895-0630-4e69-894d-04c4acc3f47a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1276 microversion: 2.1 time: 0.239447 Jul 12 11:52:49.236455 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 475/1001] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:48 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1276 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:49.768069 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-65243f09-787d-461a-91e8-ad309e6efda6 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:49.797108 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-65243f09-787d-461a-91e8-ad309e6efda6 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1590 microversion: 2.1 time: 0.919784 Jul 12 11:52:49.798140 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 527/1002] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:48 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1590 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:49.820917 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-466f9ce2-7a3c-48ca-9fec-cb60d18f0cb8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:49.821640 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-466f9ce2-7a3c-48ca-9fec-cb60d18f0cb8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:49.832979 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-466f9ce2-7a3c-48ca-9fec-cb60d18f0cb8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:49.834166 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-466f9ce2-7a3c-48ca-9fec-cb60d18f0cb8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:49.836623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-466f9ce2-7a3c-48ca-9fec-cb60d18f0cb8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:49.838054 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-466f9ce2-7a3c-48ca-9fec-cb60d18f0cb8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:49.889858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fde24c4b-5717-474a-9bb4-73273d5ed1cd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:49.893361 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fde24c4b-5717-474a-9bb4-73273d5ed1cd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:49.908288 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fde24c4b-5717-474a-9bb4-73273d5ed1cd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:49.909286 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fde24c4b-5717-474a-9bb4-73273d5ed1cd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:49.915415 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fde24c4b-5717-474a-9bb4-73273d5ed1cd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:49.916386 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fde24c4b-5717-474a-9bb4-73273d5ed1cd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:50.012672 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-466f9ce2-7a3c-48ca-9fec-cb60d18f0cb8 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194943 Jul 12 11:52:50.014857 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 476/1003] 10.222.0.50 () {58 vars in 1274 bytes} [Tue Jul 12 11:52:49 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:50.034934 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c57623f7-4f7e-4b6c-8211-7f239797d80b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:50.036922 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c57623f7-4f7e-4b6c-8211-7f239797d80b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:50.056784 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c57623f7-4f7e-4b6c-8211-7f239797d80b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:50.057493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c57623f7-4f7e-4b6c-8211-7f239797d80b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:50.058991 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c57623f7-4f7e-4b6c-8211-7f239797d80b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:50.060672 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c57623f7-4f7e-4b6c-8211-7f239797d80b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:50.305500 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c57623f7-4f7e-4b6c-8211-7f239797d80b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:50.336378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c57623f7-4f7e-4b6c-8211-7f239797d80b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:50.343220 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c57623f7-4f7e-4b6c-8211-7f239797d80b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:50.361122 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c57623f7-4f7e-4b6c-8211-7f239797d80b tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1437 microversion: 2.75 time: 0.343698 Jul 12 11:52:50.362165 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 477/1004] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:50 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1437 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:50.383649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a5105c1b-a165-4f9b-8455-5c0240e65afb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:50.384647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a5105c1b-a165-4f9b-8455-5c0240e65afb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:50.401865 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5105c1b-a165-4f9b-8455-5c0240e65afb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:50.404272 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5105c1b-a165-4f9b-8455-5c0240e65afb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:50.405486 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5105c1b-a165-4f9b-8455-5c0240e65afb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:50.406040 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5105c1b-a165-4f9b-8455-5c0240e65afb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:50.533290 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a5105c1b-a165-4f9b-8455-5c0240e65afb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:50.548234 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a5105c1b-a165-4f9b-8455-5c0240e65afb tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1274 microversion: 2.1 time: 0.177433 Jul 12 11:52:50.549417 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 478/1005] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:50 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1274 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:50.966526 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:50.978771 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:51.005683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fde24c4b-5717-474a-9bb4-73273d5ed1cd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:51.025670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:51.027722 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:51.029503 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:51.031115 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:51.053127 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fde24c4b-5717-474a-9bb4-73273d5ed1cd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1537 microversion: 2.1 time: 1.173228 Jul 12 11:52:51.072075 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 528/1006] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:49 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1537 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:51.346075 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:52:51.346928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:52:51.358070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:52:51.359071 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:52:51.359657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:52:51.445255 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:51.452254 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:51.452866 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:51.453573 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:51.454018 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:51.574713 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f2455d0b-3f06-467e-b1ec-ca32117594bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:51.575325 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f2455d0b-3f06-467e-b1ec-ca32117594bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:51.585877 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f2455d0b-3f06-467e-b1ec-ca32117594bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:51.586940 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f2455d0b-3f06-467e-b1ec-ca32117594bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:51.588905 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f2455d0b-3f06-467e-b1ec-ca32117594bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:51.600771 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f2455d0b-3f06-467e-b1ec-ca32117594bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:51.679908 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:51.724127 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=6 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:51.733946 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:52:51.744861 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f2455d0b-3f06-467e-b1ec-ca32117594bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:51.783281 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f2455d0b-3f06-467e-b1ec-ca32117594bf tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1274 microversion: 2.1 time: 0.211904 Jul 12 11:52:51.785208 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 529/1007] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:51 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:51.942596 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e50dfac4-3fcc-4e2d-9163-dea7b84b6484 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724/action" status: 202 len: 1940 microversion: 2.75 time: 1.373915 Jul 12 11:52:51.944087 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 479/1008] 10.222.0.50 () {62 vars in 1318 bytes} [Tue Jul 12 11:52:50 2022] POST /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724/action => generated 1940 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 12 11:52:51.973098 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-442db6bb-97b4-4f06-96d3-4c4300b83841 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:51.973991 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-442db6bb-97b4-4f06-96d3-4c4300b83841 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:51.985463 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-442db6bb-97b4-4f06-96d3-4c4300b83841 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:51.986181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-442db6bb-97b4-4f06-96d3-4c4300b83841 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:51.987322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-442db6bb-97b4-4f06-96d3-4c4300b83841 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:51.988073 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-442db6bb-97b4-4f06-96d3-4c4300b83841 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:52.098850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e6670cb2-d83e-4986-9547-759fddecada5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:52.108989 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e6670cb2-d83e-4986-9547-759fddecada5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:52.131973 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e6670cb2-d83e-4986-9547-759fddecada5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:52.137156 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e6670cb2-d83e-4986-9547-759fddecada5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:52.141106 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e6670cb2-d83e-4986-9547-759fddecada5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:52.144419 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e6670cb2-d83e-4986-9547-759fddecada5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:52.396747 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e6670cb2-d83e-4986-9547-759fddecada5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:52.409839 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:52.415708 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e6670cb2-d83e-4986-9547-759fddecada5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1537 microversion: 2.1 time: 0.326589 Jul 12 11:52:52.417032 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 480/1009] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:52 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1537 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:52.464284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4c51e03b-5b3a-4a14-8ddb-b677b5b6d271 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:52.466349 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4c51e03b-5b3a-4a14-8ddb-b677b5b6d271 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:52.482780 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4c51e03b-5b3a-4a14-8ddb-b677b5b6d271 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:52.483448 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4c51e03b-5b3a-4a14-8ddb-b677b5b6d271 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:52.484828 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4c51e03b-5b3a-4a14-8ddb-b677b5b6d271 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:52.485795 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4c51e03b-5b3a-4a14-8ddb-b677b5b6d271 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:52.716904 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4c51e03b-5b3a-4a14-8ddb-b677b5b6d271 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:52.736319 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-442db6bb-97b4-4f06-96d3-4c4300b83841 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:52:52.747209 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4c51e03b-5b3a-4a14-8ddb-b677b5b6d271 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1590 microversion: 2.1 time: 0.277020 Jul 12 11:52:52.760129 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 481/1010] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:52 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1590 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:52.760129 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-784ae476-e61f-4fad-b8f1-a567e0e12fb0 req-aa59b0eb-d82b-441e-b291-27428e417e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46032186-539a-44ea-83fd-fd87925589d9", "tag": "8260de2a-72b7-4bc9-a2c3-b6cf940c5fa7"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:52.774297 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-784ae476-e61f-4fad-b8f1-a567e0e12fb0 req-aa59b0eb-d82b-441e-b291-27428e417e70 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:52.774297 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-784ae476-e61f-4fad-b8f1-a567e0e12fb0 req-aa59b0eb-d82b-441e-b291-27428e417e70 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:52.793635 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-784ae476-e61f-4fad-b8f1-a567e0e12fb0 req-aa59b0eb-d82b-441e-b291-27428e417e70 service nova] Creating event network-changed:8260de2a-72b7-4bc9-a2c3-b6cf940c5fa7 for instance 46032186-539a-44ea-83fd-fd87925589d9 on n-h2-849104-4 Jul 12 11:52:52.800922 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-784ae476-e61f-4fad-b8f1-a567e0e12fb0 req-aa59b0eb-d82b-441e-b291-27428e417e70 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048301 Jul 12 11:52:52.802326 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 482/1011] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:52.809925 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1484cd7d-19ea-4f08-8aa3-0554b999aefe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:52.810727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1484cd7d-19ea-4f08-8aa3-0554b999aefe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:52.819377 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1484cd7d-19ea-4f08-8aa3-0554b999aefe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:52.819931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1484cd7d-19ea-4f08-8aa3-0554b999aefe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:52.820891 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1484cd7d-19ea-4f08-8aa3-0554b999aefe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:52.821471 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1484cd7d-19ea-4f08-8aa3-0554b999aefe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:52.921612 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-442db6bb-97b4-4f06-96d3-4c4300b83841 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.954736 Jul 12 11:52:52.923197 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 530/1012] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:51 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:52.972330 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1484cd7d-19ea-4f08-8aa3-0554b999aefe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:52.988357 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1484cd7d-19ea-4f08-8aa3-0554b999aefe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1274 microversion: 2.1 time: 0.184281 Jul 12 11:52:52.989731 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 483/1013] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:52 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:53.439422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-578a339f-3d82-40b2-9823-744c31969f46 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:53.440134 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-578a339f-3d82-40b2-9823-744c31969f46 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:53.451331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-578a339f-3d82-40b2-9823-744c31969f46 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:53.452222 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-578a339f-3d82-40b2-9823-744c31969f46 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:53.457705 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-578a339f-3d82-40b2-9823-744c31969f46 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:53.460631 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-578a339f-3d82-40b2-9823-744c31969f46 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:53.957269 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-adb3ca1b-9ffb-4c07-b77b-09621a48019d tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:53.958046 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-adb3ca1b-9ffb-4c07-b77b-09621a48019d tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:53.985674 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-adb3ca1b-9ffb-4c07-b77b-09621a48019d tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:53.986537 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-adb3ca1b-9ffb-4c07-b77b-09621a48019d tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:53.991099 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-adb3ca1b-9ffb-4c07-b77b-09621a48019d tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:53.994121 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-adb3ca1b-9ffb-4c07-b77b-09621a48019d tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:54.034483 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-578a339f-3d82-40b2-9823-744c31969f46 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:54.062094 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-578a339f-3d82-40b2-9823-744c31969f46 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1537 microversion: 2.1 time: 0.626498 Jul 12 11:52:54.075599 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 531/1014] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:53 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1537 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:54.081051 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5da51cfe-a648-4ee2-bf4e-97680190f9e9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:54.081975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5da51cfe-a648-4ee2-bf4e-97680190f9e9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:54.092913 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5da51cfe-a648-4ee2-bf4e-97680190f9e9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:54.093755 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5da51cfe-a648-4ee2-bf4e-97680190f9e9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:54.095352 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5da51cfe-a648-4ee2-bf4e-97680190f9e9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:54.098181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5da51cfe-a648-4ee2-bf4e-97680190f9e9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:54.258509 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-adb3ca1b-9ffb-4c07-b77b-09621a48019d tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:52:54.325679 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-adb3ca1b-9ffb-4c07-b77b-09621a48019d tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.373789 Jul 12 11:52:54.327803 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 484/1015] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:53 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:54.838654 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5da51cfe-a648-4ee2-bf4e-97680190f9e9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:54.847622 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5da51cfe-a648-4ee2-bf4e-97680190f9e9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1316 microversion: 2.1 time: 0.770564 Jul 12 11:52:54.861959 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 532/1016] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:54 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1316 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:55.090527 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4f6bf07e-febb-45f0-a205-b685bb6f0540 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:55.092836 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4f6bf07e-febb-45f0-a205-b685bb6f0540 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:55.107616 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4f6bf07e-febb-45f0-a205-b685bb6f0540 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:55.109645 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4f6bf07e-febb-45f0-a205-b685bb6f0540 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:55.111432 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4f6bf07e-febb-45f0-a205-b685bb6f0540 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:55.113088 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4f6bf07e-febb-45f0-a205-b685bb6f0540 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:55.361774 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-71305623-2d07-439c-867c-f98795e419b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:55.365363 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-71305623-2d07-439c-867c-f98795e419b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:55.387951 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-71305623-2d07-439c-867c-f98795e419b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:55.392992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-71305623-2d07-439c-867c-f98795e419b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:55.394232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-71305623-2d07-439c-867c-f98795e419b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:55.395276 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-71305623-2d07-439c-867c-f98795e419b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:55.622454 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-71305623-2d07-439c-867c-f98795e419b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:52:55.672451 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-71305623-2d07-439c-867c-f98795e419b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.318314 Jul 12 11:52:55.674192 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 533/1017] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:55 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:52:55.683887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-55f589b6-782a-48c6-9dfb-db626d1f5240 req-65a76477-38dd-46a0-9708-7ef791685ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9cea1e-630e-46e2-a46d-c59fde9d6ac8", "tag": "547107d8-a0c0-4626-8a23-1cedd535a72c"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:52:55.700938 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-55f589b6-782a-48c6-9dfb-db626d1f5240 req-65a76477-38dd-46a0-9708-7ef791685ca9 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:55.701551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-55f589b6-782a-48c6-9dfb-db626d1f5240 req-65a76477-38dd-46a0-9708-7ef791685ca9 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:55.737585 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-55f589b6-782a-48c6-9dfb-db626d1f5240 req-65a76477-38dd-46a0-9708-7ef791685ca9 service nova] Creating event network-changed:547107d8-a0c0-4626-8a23-1cedd535a72c for instance 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 on n-h2-849104-4 Jul 12 11:52:55.746310 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-55f589b6-782a-48c6-9dfb-db626d1f5240 req-65a76477-38dd-46a0-9708-7ef791685ca9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068955 Jul 12 11:52:55.747192 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 534/1018] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:52:55.875369 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dc02daf5-6951-4d38-bb25-5051c4a076b5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:55.876718 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dc02daf5-6951-4d38-bb25-5051c4a076b5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:55.913447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc02daf5-6951-4d38-bb25-5051c4a076b5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:55.914715 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc02daf5-6951-4d38-bb25-5051c4a076b5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:55.916755 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc02daf5-6951-4d38-bb25-5051c4a076b5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:55.918103 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc02daf5-6951-4d38-bb25-5051c4a076b5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:56.149566 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4f6bf07e-febb-45f0-a205-b685bb6f0540 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:56.160330 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4f6bf07e-febb-45f0-a205-b685bb6f0540 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 1.080280 Jul 12 11:52:56.176983 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 485/1019] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:55 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:56.190732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dc02daf5-6951-4d38-bb25-5051c4a076b5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:56.198927 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dc02daf5-6951-4d38-bb25-5051c4a076b5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1316 microversion: 2.1 time: 0.334040 Jul 12 11:52:56.200479 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 535/1020] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:55 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:56.698271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9c58145c-989a-4513-b9e3-a764b15278de tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:56.700500 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9c58145c-989a-4513-b9e3-a764b15278de tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:56.711805 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9c58145c-989a-4513-b9e3-a764b15278de tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:56.712291 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9c58145c-989a-4513-b9e3-a764b15278de tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:56.713079 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9c58145c-989a-4513-b9e3-a764b15278de tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:56.713547 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9c58145c-989a-4513-b9e3-a764b15278de tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:56.844405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-9c58145c-989a-4513-b9e3-a764b15278de tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:52:56.895642 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9c58145c-989a-4513-b9e3-a764b15278de tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.203784 Jul 12 11:52:56.896977 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 486/1021] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:56 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:57.204485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1e35d5da-52a8-47dd-84e2-0e77c2e5bd26 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:57.205198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1e35d5da-52a8-47dd-84e2-0e77c2e5bd26 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:57.218235 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1e35d5da-52a8-47dd-84e2-0e77c2e5bd26 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:57.218787 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1e35d5da-52a8-47dd-84e2-0e77c2e5bd26 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:57.220822 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1e35d5da-52a8-47dd-84e2-0e77c2e5bd26 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:57.221615 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1e35d5da-52a8-47dd-84e2-0e77c2e5bd26 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:57.227949 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b23bb3cd-c4bb-4020-b4fc-2614bd4647c9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:57.229841 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b23bb3cd-c4bb-4020-b4fc-2614bd4647c9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:57.230226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:57.242045 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b23bb3cd-c4bb-4020-b4fc-2614bd4647c9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:57.242996 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b23bb3cd-c4bb-4020-b4fc-2614bd4647c9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:57.244299 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b23bb3cd-c4bb-4020-b4fc-2614bd4647c9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:57.245003 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b23bb3cd-c4bb-4020-b4fc-2614bd4647c9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:57.468780 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1e35d5da-52a8-47dd-84e2-0e77c2e5bd26 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:57.469221 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b23bb3cd-c4bb-4020-b4fc-2614bd4647c9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:57.486602 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1e35d5da-52a8-47dd-84e2-0e77c2e5bd26 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.305032 Jul 12 11:52:57.487476 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 536/1022] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:57 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:57.489217 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b23bb3cd-c4bb-4020-b4fc-2614bd4647c9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1316 microversion: 2.1 time: 0.270755 Jul 12 11:52:57.490146 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 487/1023] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:57 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:57.934233 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-023d0aca-10b5-4fad-9db7-4588a80f6ff0 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:57.935282 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-023d0aca-10b5-4fad-9db7-4588a80f6ff0 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:57.947423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-023d0aca-10b5-4fad-9db7-4588a80f6ff0 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:57.948563 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-023d0aca-10b5-4fad-9db7-4588a80f6ff0 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:57.951572 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-023d0aca-10b5-4fad-9db7-4588a80f6ff0 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:57.952406 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-023d0aca-10b5-4fad-9db7-4588a80f6ff0 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:58.081748 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-023d0aca-10b5-4fad-9db7-4588a80f6ff0 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:52:58.109715 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-023d0aca-10b5-4fad-9db7-4588a80f6ff0 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.182072 Jul 12 11:52:58.122348 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 537/1024] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:57 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:58.516778 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-995447b7-e401-4250-9d50-ad22c58a2d10 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:58.518042 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f590d5f9-4b2b-4f0d-b15b-59428fc2de5f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:58.518771 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f590d5f9-4b2b-4f0d-b15b-59428fc2de5f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:58.520017 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-995447b7-e401-4250-9d50-ad22c58a2d10 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:58.528300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f590d5f9-4b2b-4f0d-b15b-59428fc2de5f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:58.529166 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f590d5f9-4b2b-4f0d-b15b-59428fc2de5f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:58.530461 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f590d5f9-4b2b-4f0d-b15b-59428fc2de5f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:58.531589 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f590d5f9-4b2b-4f0d-b15b-59428fc2de5f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:58.533779 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-995447b7-e401-4250-9d50-ad22c58a2d10 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:58.534904 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-995447b7-e401-4250-9d50-ad22c58a2d10 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:58.536734 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-995447b7-e401-4250-9d50-ad22c58a2d10 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:58.537754 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-995447b7-e401-4250-9d50-ad22c58a2d10 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:58.563386 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:52:58.762418 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f590d5f9-4b2b-4f0d-b15b-59428fc2de5f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:58.770226 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f590d5f9-4b2b-4f0d-b15b-59428fc2de5f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.266830 Jul 12 11:52:58.770798 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 488/1025] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:58 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:52:58.876402 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-995447b7-e401-4250-9d50-ad22c58a2d10 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:52:58.891269 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-995447b7-e401-4250-9d50-ad22c58a2d10 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1316 microversion: 2.1 time: 0.380067 Jul 12 11:52:58.902364 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 538/1026] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:58 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:52:59.138069 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d78f72fa-65d1-4522-ac22-107b5cb6457c tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:59.139985 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d78f72fa-65d1-4522-ac22-107b5cb6457c tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:59.150919 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d78f72fa-65d1-4522-ac22-107b5cb6457c tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:59.152733 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d78f72fa-65d1-4522-ac22-107b5cb6457c tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:59.154357 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d78f72fa-65d1-4522-ac22-107b5cb6457c tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:59.155403 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d78f72fa-65d1-4522-ac22-107b5cb6457c tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:59.291411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-d78f72fa-65d1-4522-ac22-107b5cb6457c tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:52:59.318906 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d78f72fa-65d1-4522-ac22-107b5cb6457c tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.188037 Jul 12 11:52:59.320552 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 489/1027] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:52:59 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:52:59.802959 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3c8e66bc-e5a2-4d92-b812-36c0cee053e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:59.804968 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3c8e66bc-e5a2-4d92-b812-36c0cee053e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:59.831125 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c8e66bc-e5a2-4d92-b812-36c0cee053e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:59.832173 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c8e66bc-e5a2-4d92-b812-36c0cee053e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:59.837102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c8e66bc-e5a2-4d92-b812-36c0cee053e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:59.837765 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c8e66bc-e5a2-4d92-b812-36c0cee053e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:59.930106 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-029751e1-8e5f-4b30-8f69-defa592cf53e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:52:59.931215 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-029751e1-8e5f-4b30-8f69-defa592cf53e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:52:59.953845 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-029751e1-8e5f-4b30-8f69-defa592cf53e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:59.954634 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-029751e1-8e5f-4b30-8f69-defa592cf53e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:52:59.966484 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-029751e1-8e5f-4b30-8f69-defa592cf53e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:52:59.967551 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-029751e1-8e5f-4b30-8f69-defa592cf53e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:00.214130 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-029751e1-8e5f-4b30-8f69-defa592cf53e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:00.238109 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-029751e1-8e5f-4b30-8f69-defa592cf53e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1316 microversion: 2.1 time: 0.324493 Jul 12 11:53:00.239131 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 490/1028] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:59 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:00.347478 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c0ae4e6e-3adf-4ae6-b238-c5f8a5164440 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:00.348483 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c0ae4e6e-3adf-4ae6-b238-c5f8a5164440 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:00.357145 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c0ae4e6e-3adf-4ae6-b238-c5f8a5164440 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:00.358504 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c0ae4e6e-3adf-4ae6-b238-c5f8a5164440 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:00.360208 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c0ae4e6e-3adf-4ae6-b238-c5f8a5164440 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:00.385320 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c0ae4e6e-3adf-4ae6-b238-c5f8a5164440 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:00.413279 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3c8e66bc-e5a2-4d92-b812-36c0cee053e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:00.441069 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3c8e66bc-e5a2-4d92-b812-36c0cee053e5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.655276 Jul 12 11:53:00.442598 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 539/1029] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:52:59 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:00.514996 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-c0ae4e6e-3adf-4ae6-b238-c5f8a5164440 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:00.552439 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c0ae4e6e-3adf-4ae6-b238-c5f8a5164440 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.209119 Jul 12 11:53:00.553752 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 491/1030] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:00 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:53:01.261579 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a0009a6b-7f49-4c10-b2c9-496c2766a1a4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:01.262856 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a0009a6b-7f49-4c10-b2c9-496c2766a1a4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:01.272175 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0009a6b-7f49-4c10-b2c9-496c2766a1a4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:01.272975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0009a6b-7f49-4c10-b2c9-496c2766a1a4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:01.273981 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0009a6b-7f49-4c10-b2c9-496c2766a1a4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:01.274800 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0009a6b-7f49-4c10-b2c9-496c2766a1a4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:01.484423 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e6181c06-d9f8-4c20-836a-cd8590a95a8d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:01.485820 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e6181c06-d9f8-4c20-836a-cd8590a95a8d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:01.493944 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e6181c06-d9f8-4c20-836a-cd8590a95a8d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:01.494666 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e6181c06-d9f8-4c20-836a-cd8590a95a8d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:01.495687 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e6181c06-d9f8-4c20-836a-cd8590a95a8d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:01.496342 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e6181c06-d9f8-4c20-836a-cd8590a95a8d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:01.705605 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e6181c06-d9f8-4c20-836a-cd8590a95a8d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:01.732942 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e6181c06-d9f8-4c20-836a-cd8590a95a8d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.266500 Jul 12 11:53:01.735980 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 492/1031] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:01 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:01.755989 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5f5d6559-1a5c-4b22-a54e-b3190b2f0885 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:01.756927 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5f5d6559-1a5c-4b22-a54e-b3190b2f0885 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:01.771229 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a0009a6b-7f49-4c10-b2c9-496c2766a1a4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:01.779927 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5f5d6559-1a5c-4b22-a54e-b3190b2f0885 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:01.780632 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5f5d6559-1a5c-4b22-a54e-b3190b2f0885 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:01.781997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5f5d6559-1a5c-4b22-a54e-b3190b2f0885 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:01.782769 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5f5d6559-1a5c-4b22-a54e-b3190b2f0885 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:01.784076 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a0009a6b-7f49-4c10-b2c9-496c2766a1a4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1316 microversion: 2.1 time: 0.527363 Jul 12 11:53:01.799905 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 540/1032] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:01 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:02.048524 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-5f5d6559-1a5c-4b22-a54e-b3190b2f0885 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:02.095422 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5f5d6559-1a5c-4b22-a54e-b3190b2f0885 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.356329 Jul 12 11:53:02.096678 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 493/1033] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:01 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:02.754935 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-368f033f-a287-4633-8c55-8de074326bdb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:02.755908 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-368f033f-a287-4633-8c55-8de074326bdb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:02.759929 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:02.766270 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-368f033f-a287-4633-8c55-8de074326bdb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:02.766270 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-368f033f-a287-4633-8c55-8de074326bdb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:02.768784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-368f033f-a287-4633-8c55-8de074326bdb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:02.769347 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-368f033f-a287-4633-8c55-8de074326bdb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:02.814422 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f5bc0b70-6409-4994-85a7-be05d26f0d5c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:02.815460 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f5bc0b70-6409-4994-85a7-be05d26f0d5c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:02.827557 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5bc0b70-6409-4994-85a7-be05d26f0d5c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:02.828700 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5bc0b70-6409-4994-85a7-be05d26f0d5c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:02.830287 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5bc0b70-6409-4994-85a7-be05d26f0d5c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:02.831276 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5bc0b70-6409-4994-85a7-be05d26f0d5c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:02.984877 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-368f033f-a287-4633-8c55-8de074326bdb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:03.003769 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-368f033f-a287-4633-8c55-8de074326bdb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.252497 Jul 12 11:53:03.008189 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 541/1034] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:02 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:03.100062 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f5bc0b70-6409-4994-85a7-be05d26f0d5c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:03.114779 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f5bc0b70-6409-4994-85a7-be05d26f0d5c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1316 microversion: 2.1 time: 0.314340 Jul 12 11:53:03.116293 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 494/1035] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:02 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:03.137719 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f8f9ec21-5ad2-4256-9b46-b2200d9a1717 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:03.139233 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f8f9ec21-5ad2-4256-9b46-b2200d9a1717 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:03.150077 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8f9ec21-5ad2-4256-9b46-b2200d9a1717 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:03.151306 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-186e82ad-0885-4907-bf7d-280f2e49603f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61f537d3-98d7-46e4-b5e7-4622662b7215"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:03.151981 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8f9ec21-5ad2-4256-9b46-b2200d9a1717 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:03.153740 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-186e82ad-0885-4907-bf7d-280f2e49603f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:03.154277 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8f9ec21-5ad2-4256-9b46-b2200d9a1717 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:03.155365 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8f9ec21-5ad2-4256-9b46-b2200d9a1717 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:03.166691 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-186e82ad-0885-4907-bf7d-280f2e49603f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:03.168340 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-186e82ad-0885-4907-bf7d-280f2e49603f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:03.169775 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-186e82ad-0885-4907-bf7d-280f2e49603f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:03.170843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-186e82ad-0885-4907-bf7d-280f2e49603f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:03.327942 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-f8f9ec21-5ad2-4256-9b46-b2200d9a1717 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:03.366726 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f8f9ec21-5ad2-4256-9b46-b2200d9a1717 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.252785 Jul 12 11:53:03.384156 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 542/1036] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:03 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:53:03.783438 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-186e82ad-0885-4907-bf7d-280f2e49603f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "POST /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.640150 Jul 12 11:53:03.785358 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 495/1037] 10.222.0.50 () {60 vars in 1322 bytes} [Tue Jul 12 11:53:03 2022] POST /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments => generated 194 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:04.034627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-660981cf-afc4-447c-a586-0a1f60551d06 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:04.036322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-660981cf-afc4-447c-a586-0a1f60551d06 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:04.047447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-660981cf-afc4-447c-a586-0a1f60551d06 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:04.047906 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-660981cf-afc4-447c-a586-0a1f60551d06 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:04.048732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-660981cf-afc4-447c-a586-0a1f60551d06 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:04.049461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-660981cf-afc4-447c-a586-0a1f60551d06 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:04.151142 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-def26421-2820-4c58-8b14-f002548c0fa1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:04.152730 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-def26421-2820-4c58-8b14-f002548c0fa1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:04.162951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-def26421-2820-4c58-8b14-f002548c0fa1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:04.163393 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-def26421-2820-4c58-8b14-f002548c0fa1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:04.164457 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-def26421-2820-4c58-8b14-f002548c0fa1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:04.165117 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-def26421-2820-4c58-8b14-f002548c0fa1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:04.403490 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-def26421-2820-4c58-8b14-f002548c0fa1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:04.411819 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-def26421-2820-4c58-8b14-f002548c0fa1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1316 microversion: 2.1 time: 0.274780 Jul 12 11:53:04.422523 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 496/1038] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:04 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:04.428778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a98a1894-0023-4f68-9f51-790d006e594f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:04.429745 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a98a1894-0023-4f68-9f51-790d006e594f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:04.438341 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a98a1894-0023-4f68-9f51-790d006e594f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:04.440750 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a98a1894-0023-4f68-9f51-790d006e594f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:04.443407 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a98a1894-0023-4f68-9f51-790d006e594f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:04.444588 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a98a1894-0023-4f68-9f51-790d006e594f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:04.472171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-660981cf-afc4-447c-a586-0a1f60551d06 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:04.486111 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-660981cf-afc4-447c-a586-0a1f60551d06 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.463570 Jul 12 11:53:04.487310 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 543/1039] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:04 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:04.674036 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-a98a1894-0023-4f68-9f51-790d006e594f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:04.722517 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a98a1894-0023-4f68-9f51-790d006e594f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.297045 Jul 12 11:53:04.744197 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 497/1040] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:04 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:05.094115 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-05ca1793-cb8c-46d6-bb86-edf78ccdde40 req-d040d10a-8b3c-4a05-b683-8b20f2436124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9cea1e-630e-46e2-a46d-c59fde9d6ac8", "name": "network-vif-plugged", "status": "completed", "tag": "547107d8-a0c0-4626-8a23-1cedd535a72c"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:05.121933 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-05ca1793-cb8c-46d6-bb86-edf78ccdde40 req-d040d10a-8b3c-4a05-b683-8b20f2436124 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:05.123379 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-05ca1793-cb8c-46d6-bb86-edf78ccdde40 req-d040d10a-8b3c-4a05-b683-8b20f2436124 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:05.149348 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-05ca1793-cb8c-46d6-bb86-edf78ccdde40 req-d040d10a-8b3c-4a05-b683-8b20f2436124 service nova] Creating event network-vif-plugged:547107d8-a0c0-4626-8a23-1cedd535a72c for instance 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 on n-h2-849104-4 Jul 12 11:53:05.155944 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-05ca1793-cb8c-46d6-bb86-edf78ccdde40 req-d040d10a-8b3c-4a05-b683-8b20f2436124 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065601 Jul 12 11:53:05.156691 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 544/1041] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:05.431335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8cc2a2e1-91a2-440c-868d-414d7c9fa6c3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:05.433272 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8cc2a2e1-91a2-440c-868d-414d7c9fa6c3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:05.441958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8cc2a2e1-91a2-440c-868d-414d7c9fa6c3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:05.442824 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8cc2a2e1-91a2-440c-868d-414d7c9fa6c3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:05.443782 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8cc2a2e1-91a2-440c-868d-414d7c9fa6c3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:05.444411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8cc2a2e1-91a2-440c-868d-414d7c9fa6c3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:05.514522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d308e0c8-36ca-4091-bb20-6ba16b4a660e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:05.515555 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d308e0c8-36ca-4091-bb20-6ba16b4a660e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:05.525203 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d308e0c8-36ca-4091-bb20-6ba16b4a660e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:05.526047 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d308e0c8-36ca-4091-bb20-6ba16b4a660e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:05.528550 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d308e0c8-36ca-4091-bb20-6ba16b4a660e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:05.529425 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d308e0c8-36ca-4091-bb20-6ba16b4a660e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:05.655824 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8cc2a2e1-91a2-440c-868d-414d7c9fa6c3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:05.664945 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8cc2a2e1-91a2-440c-868d-414d7c9fa6c3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1316 microversion: 2.1 time: 0.238320 Jul 12 11:53:05.675368 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 498/1042] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:05 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:05.754890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0e17d81d-d92f-4beb-ae3b-d097c3805a00 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:05.757341 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0e17d81d-d92f-4beb-ae3b-d097c3805a00 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:05.780189 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0e17d81d-d92f-4beb-ae3b-d097c3805a00 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:05.780907 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0e17d81d-d92f-4beb-ae3b-d097c3805a00 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:05.782345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0e17d81d-d92f-4beb-ae3b-d097c3805a00 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:05.783019 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0e17d81d-d92f-4beb-ae3b-d097c3805a00 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:05.915443 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-0e17d81d-d92f-4beb-ae3b-d097c3805a00 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:05.940350 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0e17d81d-d92f-4beb-ae3b-d097c3805a00 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.192701 Jul 12 11:53:05.956763 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 499/1043] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:05 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:06.212122 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d308e0c8-36ca-4091-bb20-6ba16b4a660e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:06.227785 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d308e0c8-36ca-4091-bb20-6ba16b4a660e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.717746 Jul 12 11:53:06.230145 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 545/1044] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:05 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:06.696969 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e0ca6b14-87bd-42c3-b646-462e663b6de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:06.698821 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e0ca6b14-87bd-42c3-b646-462e663b6de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:06.738635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e0ca6b14-87bd-42c3-b646-462e663b6de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:06.739082 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e0ca6b14-87bd-42c3-b646-462e663b6de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:06.740117 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e0ca6b14-87bd-42c3-b646-462e663b6de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:06.740740 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e0ca6b14-87bd-42c3-b646-462e663b6de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:06.868020 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-512080293", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "24a2b846-48a0-496a-b982-522753a2dd1f"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:06.967837 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] validate_networks() for [('24a2b846-48a0-496a-b982-522753a2dd1f', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:53:07.269317 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e0ca6b14-87bd-42c3-b646-462e663b6de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:07.278052 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e0ca6b14-87bd-42c3-b646-462e663b6de1 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1316 microversion: 2.1 time: 0.594767 Jul 12 11:53:07.280312 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 546/1045] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:06 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1316 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:07.293696 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-41fb6e35-f83b-41bc-af3b-c7780181d07b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:07.295126 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-41fb6e35-f83b-41bc-af3b-c7780181d07b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:07.304475 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-41fb6e35-f83b-41bc-af3b-c7780181d07b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:07.305273 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-41fb6e35-f83b-41bc-af3b-c7780181d07b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:07.306262 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-41fb6e35-f83b-41bc-af3b-c7780181d07b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:07.306888 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-41fb6e35-f83b-41bc-af3b-c7780181d07b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:07.443605 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-41fb6e35-f83b-41bc-af3b-c7780181d07b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:07.514271 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-41fb6e35-f83b-41bc-af3b-c7780181d07b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.231979 Jul 12 11:53:07.514867 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 547/1046] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:07 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:07.531860 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b507e8f0-66f8-437a-8db6-b05d4e5239dc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:07.536060 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b507e8f0-66f8-437a-8db6-b05d4e5239dc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:07.537067 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b507e8f0-66f8-437a-8db6-b05d4e5239dc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Searching by: {'deleted': False, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 11:53:07.543960 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b507e8f0-66f8-437a-8db6-b05d4e5239dc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:07.544444 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b507e8f0-66f8-437a-8db6-b05d4e5239dc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:07.545248 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b507e8f0-66f8-437a-8db6-b05d4e5239dc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:07.545688 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b507e8f0-66f8-437a-8db6-b05d4e5239dc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:07.579144 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-b507e8f0-66f8-437a-8db6-b05d4e5239dc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 11:53:07.649303 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b507e8f0-66f8-437a-8db6-b05d4e5239dc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.121665 Jul 12 11:53:07.650392 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 548/1047] 10.222.0.50 () {58 vars in 1124 bytes} [Tue Jul 12 11:53:07 2022] GET /compute/v2.1/servers => generated 333 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:07.660541 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d8d884ef-f952-469a-9049-8aff47bc5190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:07.661986 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d8d884ef-f952-469a-9049-8aff47bc5190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:07.676180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d8d884ef-f952-469a-9049-8aff47bc5190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:07.676909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d8d884ef-f952-469a-9049-8aff47bc5190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:07.678076 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d8d884ef-f952-469a-9049-8aff47bc5190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:07.678695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d8d884ef-f952-469a-9049-8aff47bc5190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:07.725095 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:53:07.726067 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:53:07.727274 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:53:07.728131 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:53:07.728957 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:53:07.745903 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:07.746862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:07.748764 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:07.749562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:07.786250 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Getting quotas for project 6acea80b1e154ffcb3e657056d6e8dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:53:07.797809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Getting quotas for user 4c93078ac6044bf6b62ca073b3850016 and project 6acea80b1e154ffcb3e657056d6e8dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:53:07.826170 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:53:07.839413 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:53:07.884226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d8d884ef-f952-469a-9049-8aff47bc5190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:07.886491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=97,nova_api:INSERT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:07.896303 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d8d884ef-f952-469a-9049-8aff47bc5190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.243806 Jul 12 11:53:07.897332 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 549/1048] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:07 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:07.912764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5bceca97-d9d9-42bf-b261-0ee9fa9f7916 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:07.916645 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5bceca97-d9d9-42bf-b261-0ee9fa9f7916 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:07.917473 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5bceca97-d9d9-42bf-b261-0ee9fa9f7916 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Searching by: {'deleted': False, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 11:53:07.924292 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5bceca97-d9d9-42bf-b261-0ee9fa9f7916 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:07.925043 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5bceca97-d9d9-42bf-b261-0ee9fa9f7916 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:07.926461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5bceca97-d9d9-42bf-b261-0ee9fa9f7916 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:07.927065 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5bceca97-d9d9-42bf-b261-0ee9fa9f7916 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:07.948023 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0023ea9c-2c4c-4a22-8529-f6215447377e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349382 Jul 12 11:53:07.950777 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 500/1049] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:53:07.977954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a06adfe7-e9bc-4fd3-88c4-334ab7c5a4c7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:07.979949 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a06adfe7-e9bc-4fd3-88c4-334ab7c5a4c7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:08.051283 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-5bceca97-d9d9-42bf-b261-0ee9fa9f7916 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 11:53:08.090054 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a06adfe7-e9bc-4fd3-88c4-334ab7c5a4c7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:08.103268 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a06adfe7-e9bc-4fd3-88c4-334ab7c5a4c7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1214 microversion: 2.1 time: 0.143852 Jul 12 11:53:08.105184 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 501/1050] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:07 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:08.210893 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5bceca97-d9d9-42bf-b261-0ee9fa9f7916 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:08.218393 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5bceca97-d9d9-42bf-b261-0ee9fa9f7916 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:08.218966 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5bceca97-d9d9-42bf-b261-0ee9fa9f7916 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:08.299547 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9e78c77f-5c8d-4965-9385-f8e42598ef9f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:08.302689 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9e78c77f-5c8d-4965-9385-f8e42598ef9f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:08.331634 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9e78c77f-5c8d-4965-9385-f8e42598ef9f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:08.332434 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9e78c77f-5c8d-4965-9385-f8e42598ef9f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:08.334002 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9e78c77f-5c8d-4965-9385-f8e42598ef9f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:08.334753 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9e78c77f-5c8d-4965-9385-f8e42598ef9f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:08.553650 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5bceca97-d9d9-42bf-b261-0ee9fa9f7916 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.655035 Jul 12 11:53:08.554584 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 550/1051] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:53:07 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:08.560274 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a5cbc99e-2631-476c-9838-da26a6128d3b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:08.560881 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a5cbc99e-2631-476c-9838-da26a6128d3b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:08.572503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5cbc99e-2631-476c-9838-da26a6128d3b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:08.575086 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5cbc99e-2631-476c-9838-da26a6128d3b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:08.577913 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5cbc99e-2631-476c-9838-da26a6128d3b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:08.579311 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5cbc99e-2631-476c-9838-da26a6128d3b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:08.633533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:08.741372 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9e78c77f-5c8d-4965-9385-f8e42598ef9f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:08.750251 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9e78c77f-5c8d-4965-9385-f8e42598ef9f tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1316 microversion: 2.1 time: 0.458288 Jul 12 11:53:08.756293 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 502/1052] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:08 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1316 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:08.767112 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-a5cbc99e-2631-476c-9838-da26a6128d3b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:08.784846 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e625a1c5-d704-4be4-afce-f341b8fd2419 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:08.799553 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a5cbc99e-2631-476c-9838-da26a6128d3b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.243850 Jul 12 11:53:08.800839 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 551/1053] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:08 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:08.802970 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e625a1c5-d704-4be4-afce-f341b8fd2419 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043817 Jul 12 11:53:08.809939 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 503/1054] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:53:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:08.920431 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-382dd620-b2f3-4c97-b02b-86c239e6697a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:08.930458 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-382dd620-b2f3-4c97-b02b-86c239e6697a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:08.951018 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-382dd620-b2f3-4c97-b02b-86c239e6697a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:08.952375 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-382dd620-b2f3-4c97-b02b-86c239e6697a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:08.954044 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-382dd620-b2f3-4c97-b02b-86c239e6697a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:08.955237 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-382dd620-b2f3-4c97-b02b-86c239e6697a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:09.130435 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a86e408f-a919-475f-9e9d-c431f53ff05a tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:09.131608 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a86e408f-a919-475f-9e9d-c431f53ff05a tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:09.141307 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a86e408f-a919-475f-9e9d-c431f53ff05a tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:09.146277 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a86e408f-a919-475f-9e9d-c431f53ff05a tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:09.147382 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a86e408f-a919-475f-9e9d-c431f53ff05a tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:09.147989 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a86e408f-a919-475f-9e9d-c431f53ff05a tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:09.243540 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a86e408f-a919-475f-9e9d-c431f53ff05a tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:53:09.251113 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:09.261531 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-382dd620-b2f3-4c97-b02b-86c239e6697a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:09.270764 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-382dd620-b2f3-4c97-b02b-86c239e6697a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.359959 Jul 12 11:53:09.271432 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 552/1055] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:08 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:09.277381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-98305997-9f49-4124-bc12-6ffc3193ce75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:09.278274 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-98305997-9f49-4124-bc12-6ffc3193ce75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:09.295143 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-98305997-9f49-4124-bc12-6ffc3193ce75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:09.296169 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-98305997-9f49-4124-bc12-6ffc3193ce75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:09.297576 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-98305997-9f49-4124-bc12-6ffc3193ce75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:09.298198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-98305997-9f49-4124-bc12-6ffc3193ce75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:09.404123 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a86e408f-a919-475f-9e9d-c431f53ff05a tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 204 len: 0 microversion: 2.1 time: 0.278041 Jul 12 11:53:09.405304 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 504/1056] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:53:09 2022] DELETE /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 11:53:09.418030 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-98305997-9f49-4124-bc12-6ffc3193ce75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:09.428290 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-74376abe-d559-41d2-9578-ab1d1eaca8bc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:09.429832 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-74376abe-d559-41d2-9578-ab1d1eaca8bc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:09.430045 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-98305997-9f49-4124-bc12-6ffc3193ce75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1266 microversion: 2.1 time: 0.156814 Jul 12 11:53:09.438174 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-74376abe-d559-41d2-9578-ab1d1eaca8bc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:09.439778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-74376abe-d559-41d2-9578-ab1d1eaca8bc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:09.441407 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-74376abe-d559-41d2-9578-ab1d1eaca8bc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:09.442077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-74376abe-d559-41d2-9578-ab1d1eaca8bc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:09.450108 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 553/1057] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:09 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:09.687350 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-74376abe-d559-41d2-9578-ab1d1eaca8bc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:09.705818 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-74376abe-d559-41d2-9578-ab1d1eaca8bc tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1700 microversion: 2.1 time: 0.294389 Jul 12 11:53:09.707011 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 505/1058] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:09 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1700 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:09.779726 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c818b0d7-c398-4365-a145-aec5143c236d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:09.780927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c818b0d7-c398-4365-a145-aec5143c236d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:09.793388 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c818b0d7-c398-4365-a145-aec5143c236d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:09.794255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c818b0d7-c398-4365-a145-aec5143c236d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:09.795657 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c818b0d7-c398-4365-a145-aec5143c236d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:09.796523 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c818b0d7-c398-4365-a145-aec5143c236d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:09.835549 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d9e95284-326f-4b7a-8ac1-4e3bd402eaa6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:09.836598 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d9e95284-326f-4b7a-8ac1-4e3bd402eaa6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:09.847799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d9e95284-326f-4b7a-8ac1-4e3bd402eaa6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:09.848619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d9e95284-326f-4b7a-8ac1-4e3bd402eaa6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:09.850058 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d9e95284-326f-4b7a-8ac1-4e3bd402eaa6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:09.850853 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d9e95284-326f-4b7a-8ac1-4e3bd402eaa6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:09.995466 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-d9e95284-326f-4b7a-8ac1-4e3bd402eaa6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:10.033028 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d9e95284-326f-4b7a-8ac1-4e3bd402eaa6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.202627 Jul 12 11:53:10.034823 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 506/1059] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:09 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:53:10.039772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c818b0d7-c398-4365-a145-aec5143c236d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:10.054699 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c818b0d7-c398-4365-a145-aec5143c236d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1464 microversion: 2.1 time: 0.282658 Jul 12 11:53:10.067589 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 554/1060] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:09 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1464 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:10.077114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-adbc36f9-2c01-4b34-bc2d-b6aa87624347 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:10.078632 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-adbc36f9-2c01-4b34-bc2d-b6aa87624347 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:10.091052 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-adbc36f9-2c01-4b34-bc2d-b6aa87624347 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:10.092172 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-adbc36f9-2c01-4b34-bc2d-b6aa87624347 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:10.093471 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-adbc36f9-2c01-4b34-bc2d-b6aa87624347 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:10.094014 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-adbc36f9-2c01-4b34-bc2d-b6aa87624347 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:10.274929 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-adbc36f9-2c01-4b34-bc2d-b6aa87624347 tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1615 microversion: 2.1 time: 0.205545 Jul 12 11:53:10.276136 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 507/1061] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:10 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1615 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:10.298650 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-57d227dc-87cb-4167-b774-34ef3161268f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:10.299538 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-57d227dc-87cb-4167-b774-34ef3161268f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:10.308250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-57d227dc-87cb-4167-b774-34ef3161268f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:10.309086 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-57d227dc-87cb-4167-b774-34ef3161268f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:10.310105 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-57d227dc-87cb-4167-b774-34ef3161268f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:10.312006 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-57d227dc-87cb-4167-b774-34ef3161268f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:10.466900 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e4bbdfc4-d0bd-4eaf-bca5-b08fccdba19e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:10.467529 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e4bbdfc4-d0bd-4eaf-bca5-b08fccdba19e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:10.491493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4bbdfc4-d0bd-4eaf-bca5-b08fccdba19e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:10.494576 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4bbdfc4-d0bd-4eaf-bca5-b08fccdba19e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:10.495359 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4bbdfc4-d0bd-4eaf-bca5-b08fccdba19e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:10.499874 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4bbdfc4-d0bd-4eaf-bca5-b08fccdba19e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:10.584690 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-57d227dc-87cb-4167-b774-34ef3161268f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:10.602303 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-57d227dc-87cb-4167-b774-34ef3161268f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.308181 Jul 12 11:53:10.603292 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 555/1062] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:10 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:10.633565 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-642921782", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "df49a9f0-90aa-4bd7-91c8-1df741ab59a3"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:10.667473 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e4bbdfc4-d0bd-4eaf-bca5-b08fccdba19e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:10.677090 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e4bbdfc4-d0bd-4eaf-bca5-b08fccdba19e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1274 microversion: 2.1 time: 0.217204 Jul 12 11:53:10.678435 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 508/1063] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:10 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1274 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:10.726634 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4fc47bce-85f0-44fc-84f1-cfeafea1b609 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:10.727639 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4fc47bce-85f0-44fc-84f1-cfeafea1b609 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:10.736881 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] validate_networks() for None {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:53:10.741094 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4fc47bce-85f0-44fc-84f1-cfeafea1b609 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:10.742491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4fc47bce-85f0-44fc-84f1-cfeafea1b609 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:10.745521 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4fc47bce-85f0-44fc-84f1-cfeafea1b609 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:10.746382 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4fc47bce-85f0-44fc-84f1-cfeafea1b609 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:11.240288 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:53:11.241150 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:53:11.241150 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:53:11.241680 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:53:11.241976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:53:11.265647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:11.266125 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:11.266935 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:11.267385 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:11.333055 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for project 810246cfc801446599831d243d3a48dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:53:11.352512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Getting quotas for user 3e7eb4c715f04ea791384bcde9844fa7 and project 810246cfc801446599831d243d3a48dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:53:11.416022 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:53:11.420791 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:53:11.457620 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4fc47bce-85f0-44fc-84f1-cfeafea1b609 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:11.493980 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4fc47bce-85f0-44fc-84f1-cfeafea1b609 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1700 microversion: 2.1 time: 0.767039 Jul 12 11:53:11.497635 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 509/1064] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:10 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1700 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:11.520284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-39737e54-5543-4dd0-b0b0-3b66449f0be7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:11.530221 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-507a9c6f-9ac7-4809-9e4f-71d2725067be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924767 Jul 12 11:53:11.530880 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 556/1065] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:53:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:53:11.542816 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-39737e54-5543-4dd0-b0b0-3b66449f0be7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:11.561514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f2766993-2289-4296-8568-92da43dd9b81 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:11.562412 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f2766993-2289-4296-8568-92da43dd9b81 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:11.578024 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-39737e54-5543-4dd0-b0b0-3b66449f0be7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:11.585319 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-39737e54-5543-4dd0-b0b0-3b66449f0be7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:11.586884 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-39737e54-5543-4dd0-b0b0-3b66449f0be7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:11.587641 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-39737e54-5543-4dd0-b0b0-3b66449f0be7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:11.878665 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f2766993-2289-4296-8568-92da43dd9b81 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:11.880553 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-39737e54-5543-4dd0-b0b0-3b66449f0be7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:11.890742 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f2766993-2289-4296-8568-92da43dd9b81 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1216 microversion: 2.1 time: 0.341415 Jul 12 11:53:11.892331 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 557/1066] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:11 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1216 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:11.898551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d4bcfb7c-3ddc-47fb-8274-3ff32262e872 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:11.899880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d4bcfb7c-3ddc-47fb-8274-3ff32262e872 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:11.908022 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d4bcfb7c-3ddc-47fb-8274-3ff32262e872 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:11.908776 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d4bcfb7c-3ddc-47fb-8274-3ff32262e872 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:11.910216 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d4bcfb7c-3ddc-47fb-8274-3ff32262e872 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:11.910835 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d4bcfb7c-3ddc-47fb-8274-3ff32262e872 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:11.948949 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-39737e54-5543-4dd0-b0b0-3b66449f0be7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.447287 Jul 12 11:53:11.954115 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 510/1067] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:11 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:11.982212 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-22922444-d670-4691-995d-6d50e52a9e38 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:11.983436 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-22922444-d670-4691-995d-6d50e52a9e38 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:11.996239 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-22922444-d670-4691-995d-6d50e52a9e38 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:11.997151 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-22922444-d670-4691-995d-6d50e52a9e38 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:11.999604 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-22922444-d670-4691-995d-6d50e52a9e38 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:12.002010 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-22922444-d670-4691-995d-6d50e52a9e38 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:12.294528 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-22922444-d670-4691-995d-6d50e52a9e38 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:12.315176 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-22922444-d670-4691-995d-6d50e52a9e38 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1272 microversion: 2.1 time: 0.358579 Jul 12 11:53:12.317901 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 511/1068] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:11 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1272 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:12.525278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f601e7e2-f54a-4527-9728-b7fd4b6f631e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:12.525969 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f601e7e2-f54a-4527-9728-b7fd4b6f631e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:12.549741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f601e7e2-f54a-4527-9728-b7fd4b6f631e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:12.550201 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f601e7e2-f54a-4527-9728-b7fd4b6f631e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:12.551009 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f601e7e2-f54a-4527-9728-b7fd4b6f631e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:12.551455 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f601e7e2-f54a-4527-9728-b7fd4b6f631e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:12.565404 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d4bcfb7c-3ddc-47fb-8274-3ff32262e872 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:12.659013 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d4bcfb7c-3ddc-47fb-8274-3ff32262e872 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.756683 Jul 12 11:53:12.666611 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 558/1069] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:11 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:12.930147 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2996eae1-8d32-40b9-9351-6aef7f7de94d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:12.936742 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2996eae1-8d32-40b9-9351-6aef7f7de94d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:12.971635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2996eae1-8d32-40b9-9351-6aef7f7de94d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:12.975185 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2996eae1-8d32-40b9-9351-6aef7f7de94d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:12.980934 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2996eae1-8d32-40b9-9351-6aef7f7de94d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:12.982025 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2996eae1-8d32-40b9-9351-6aef7f7de94d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:13.106284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f601e7e2-f54a-4527-9728-b7fd4b6f631e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:13.132406 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f601e7e2-f54a-4527-9728-b7fd4b6f631e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1700 microversion: 2.1 time: 0.617513 Jul 12 11:53:13.133984 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 512/1070] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:12 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1700 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:13.165287 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6e5b4a4e-71c5-4b2d-ac38-404d52ef880f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:13.167751 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6e5b4a4e-71c5-4b2d-ac38-404d52ef880f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:13.206610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e5b4a4e-71c5-4b2d-ac38-404d52ef880f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:13.208365 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e5b4a4e-71c5-4b2d-ac38-404d52ef880f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:13.213273 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e5b4a4e-71c5-4b2d-ac38-404d52ef880f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:13.217887 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e5b4a4e-71c5-4b2d-ac38-404d52ef880f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:13.297359 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2996eae1-8d32-40b9-9351-6aef7f7de94d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:13.318583 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2996eae1-8d32-40b9-9351-6aef7f7de94d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1220 microversion: 2.1 time: 0.398413 Jul 12 11:53:13.324209 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 559/1071] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:12 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1220 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:13.347599 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8b6c47ad-f29d-470d-85b5-5f6cba517b0a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:13.351510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8b6c47ad-f29d-470d-85b5-5f6cba517b0a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:13.378480 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b6c47ad-f29d-470d-85b5-5f6cba517b0a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:13.378931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b6c47ad-f29d-470d-85b5-5f6cba517b0a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:13.381742 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b6c47ad-f29d-470d-85b5-5f6cba517b0a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:13.388289 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b6c47ad-f29d-470d-85b5-5f6cba517b0a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:13.550484 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-6e5b4a4e-71c5-4b2d-ac38-404d52ef880f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:13.626915 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6e5b4a4e-71c5-4b2d-ac38-404d52ef880f tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.470636 Jul 12 11:53:13.644902 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 513/1072] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:13 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:13.695124 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9ad5f130-04d7-439b-9d4f-8f9d5c4241b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:13.703541 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9ad5f130-04d7-439b-9d4f-8f9d5c4241b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:13.732233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ad5f130-04d7-439b-9d4f-8f9d5c4241b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:13.733373 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ad5f130-04d7-439b-9d4f-8f9d5c4241b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:13.734908 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ad5f130-04d7-439b-9d4f-8f9d5c4241b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:13.735871 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ad5f130-04d7-439b-9d4f-8f9d5c4241b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:14.241697 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8b6c47ad-f29d-470d-85b5-5f6cba517b0a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:14.253555 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8b6c47ad-f29d-470d-85b5-5f6cba517b0a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1314 microversion: 2.1 time: 0.915447 Jul 12 11:53:14.261848 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 560/1073] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:13 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1314 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:14.267473 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6c4e3991-9975-4313-ac55-410b049cb11e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:14.271281 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6c4e3991-9975-4313-ac55-410b049cb11e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:14.289728 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c4e3991-9975-4313-ac55-410b049cb11e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:14.290915 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c4e3991-9975-4313-ac55-410b049cb11e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:14.292622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c4e3991-9975-4313-ac55-410b049cb11e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:14.293740 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c4e3991-9975-4313-ac55-410b049cb11e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:14.454973 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9ad5f130-04d7-439b-9d4f-8f9d5c4241b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:14.491756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6c4e3991-9975-4313-ac55-410b049cb11e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a182b0927742a89093649b1e0968fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6547cfce324d3c88b883bbfa07d09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:14.495443 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9ad5f130-04d7-439b-9d4f-8f9d5c4241b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.794652 Jul 12 11:53:14.500599 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 514/1074] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:13 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:14.521708 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6c4e3991-9975-4313-ac55-410b049cb11e tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 200 len: 1632 microversion: 2.1 time: 0.256721 Jul 12 11:53:14.527572 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 561/1075] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:14 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 1632 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:14.547484 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4e06005d-bc0c-41b7-afb1-2dc005aba3d8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:14.547775 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-2ac27cc8-8d70-44ce-b520-9f6d1c61646a req-6a79f35f-dbc4-4317-ad2a-954384c5a3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72", "name": "network-vif-deleted", "tag": "827f4044-3788-44c6-9411-c923971bf9c5"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:14.549457 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4e06005d-bc0c-41b7-afb1-2dc005aba3d8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:14.562967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-2ac27cc8-8d70-44ce-b520-9f6d1c61646a req-6a79f35f-dbc4-4317-ad2a-954384c5a3f4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:14.563480 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-2ac27cc8-8d70-44ce-b520-9f6d1c61646a req-6a79f35f-dbc4-4317-ad2a-954384c5a3f4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:14.569234 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e06005d-bc0c-41b7-afb1-2dc005aba3d8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:14.570925 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e06005d-bc0c-41b7-afb1-2dc005aba3d8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:14.573969 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e06005d-bc0c-41b7-afb1-2dc005aba3d8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:14.575462 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e06005d-bc0c-41b7-afb1-2dc005aba3d8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:14.580054 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-2ac27cc8-8d70-44ce-b520-9f6d1c61646a req-6a79f35f-dbc4-4317-ad2a-954384c5a3f4 service nova] Creating event network-vif-deleted:827f4044-3788-44c6-9411-c923971bf9c5 for instance fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 on n-h1-849104-4 Jul 12 11:53:14.593630 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-2ac27cc8-8d70-44ce-b520-9f6d1c61646a req-6a79f35f-dbc4-4317-ad2a-954384c5a3f4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060509 Jul 12 11:53:14.594248 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 562/1076] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:53:14.672183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-61672a43-d061-4720-8bca-22e6bead1f30 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:14.688732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-61672a43-d061-4720-8bca-22e6bead1f30 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:14.706958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61672a43-d061-4720-8bca-22e6bead1f30 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:14.713192 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61672a43-d061-4720-8bca-22e6bead1f30 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:14.717902 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61672a43-d061-4720-8bca-22e6bead1f30 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:14.728239 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61672a43-d061-4720-8bca-22e6bead1f30 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:14.762640 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4e06005d-bc0c-41b7-afb1-2dc005aba3d8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:14.794774 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4e06005d-bc0c-41b7-afb1-2dc005aba3d8 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1274 microversion: 2.1 time: 0.292193 Jul 12 11:53:14.797000 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 515/1077] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:14 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1274 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:14.910693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-61672a43-d061-4720-8bca-22e6bead1f30 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:14.945234 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-61672a43-d061-4720-8bca-22e6bead1f30 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.279551 Jul 12 11:53:14.960175 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 563/1078] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:14 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:15.293044 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-72e4be7a-40e8-4e2e-b63b-a57463fd687c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:15.295685 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-72e4be7a-40e8-4e2e-b63b-a57463fd687c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:15.310877 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-72e4be7a-40e8-4e2e-b63b-a57463fd687c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:15.312130 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-72e4be7a-40e8-4e2e-b63b-a57463fd687c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:15.313761 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-72e4be7a-40e8-4e2e-b63b-a57463fd687c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:15.315633 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-72e4be7a-40e8-4e2e-b63b-a57463fd687c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:15.531540 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7cef8b75-dcad-48ed-9a04-c0d49cea2e3c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:15.533270 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7cef8b75-dcad-48ed-9a04-c0d49cea2e3c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:15.542149 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7cef8b75-dcad-48ed-9a04-c0d49cea2e3c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:15.542602 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7cef8b75-dcad-48ed-9a04-c0d49cea2e3c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:15.543586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7cef8b75-dcad-48ed-9a04-c0d49cea2e3c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:15.544053 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7cef8b75-dcad-48ed-9a04-c0d49cea2e3c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:15.681722 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-72e4be7a-40e8-4e2e-b63b-a57463fd687c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:15.696381 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-72e4be7a-40e8-4e2e-b63b-a57463fd687c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1314 microversion: 2.1 time: 0.414984 Jul 12 11:53:15.698452 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 516/1079] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:15 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:15.705243 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4268952c-a08b-4a89-807e-2430fea9bdc0 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:15.706290 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4268952c-a08b-4a89-807e-2430fea9bdc0 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] [instance: fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:15.713267 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4268952c-a08b-4a89-807e-2430fea9bdc0 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:15.714487 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4268952c-a08b-4a89-807e-2430fea9bdc0 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:15.715311 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4268952c-a08b-4a89-807e-2430fea9bdc0 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:15.715742 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4268952c-a08b-4a89-807e-2430fea9bdc0 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:15.738585 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-4268952c-a08b-4a89-807e-2430fea9bdc0 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] HTTP exception thrown: Instance fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 could not be found. Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4268952c-a08b-4a89-807e-2430fea9bdc0 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Request method failure captured: Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 HTTP/1.1 Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWBefvmHTt-PgE02p61TQwsNrC-q0CGpQ1F_ptfxrvs8y9p5gplOS1-jqndpLHoRrTdRU6lWFXzCxRDV8fNvLxfFhnHTSa95C77MgptnZGs2--W2YTDO-edg39fFxD01Z-oARuFAkkvmcowQlrGJzMqw0rOvsvWYxGncakupnb19GSw Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 9a6547cfce324d3c88b883bbfa07d09f Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServersTestJSON-859416660 Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9a6547cfce324d3c88b883bbfa07d09f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9a6547cfce324d3c88b883bbfa07d09f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9a6547cfce324d3c88b883bbfa07d09f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9a6547cfce324d3c88b883bbfa07d09f", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServersTestJSON-859416660 Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 9a6547cfce324d3c88b883bbfa07d09f Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServersTestJSON-859416660 Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServersTestJSON-859416660-project Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 03a182b0927742a89093649b1e0968fc Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServersTestJSON-859416660-project Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 could not be found. Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72'} Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 could not be found. Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 could not be found. Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:15.741598 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:15.750648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:53:15.750648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:53:15.750648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:53:15.750648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:53:15.750648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 could not be found. Jul 12 11:53:15.750648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:15.752547 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4268952c-a08b-4a89-807e-2430fea9bdc0 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Returning 404 to user: Instance fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:53:15.754685 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4268952c-a08b-4a89-807e-2430fea9bdc0 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72" status: 404 len: 111 microversion: 2.1 time: 0.054116 Jul 12 11:53:15.761529 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 517/1080] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:15 2022] GET /compute/v2.1/servers/fe5ba5b8-1165-4eb6-b94c-dee90ac9ed72 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:53:15.768414 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7cef8b75-dcad-48ed-9a04-c0d49cea2e3c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:15.771842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-135aa905-3f25-4ce2-a1d3-f00bfebea0b8 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] Calling method '.version_select at 0x7f5e0a89aca0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:15.813579 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7cef8b75-dcad-48ed-9a04-c0d49cea2e3c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.288568 Jul 12 11:53:15.815232 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 564/1081] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:15 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:15.825358 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-135aa905-3f25-4ce2-a1d3-f00bfebea0b8 tempest-ServersTestJSON-859416660 tempest-ServersTestJSON-859416660-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779531043" status: 202 len: 0 microversion: 2.1 time: 0.061668 Jul 12 11:53:15.831312 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 518/1082] 10.222.0.50 () {58 vars in 1220 bytes} [Tue Jul 12 11:53:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779531043 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:53:15.831561 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-caacae00-d1a9-4601-ab72-1df854047977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:15.831561 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-caacae00-d1a9-4601-ab72-1df854047977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:15.839889 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-caacae00-d1a9-4601-ab72-1df854047977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:15.840922 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-caacae00-d1a9-4601-ab72-1df854047977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:15.846354 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-caacae00-d1a9-4601-ab72-1df854047977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:15.846963 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-caacae00-d1a9-4601-ab72-1df854047977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:15.978375 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a949235e-a3a9-473a-b74f-bc7acf3382b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:15.979200 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a949235e-a3a9-473a-b74f-bc7acf3382b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:16.001180 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a949235e-a3a9-473a-b74f-bc7acf3382b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:16.002332 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a949235e-a3a9-473a-b74f-bc7acf3382b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:16.003405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a949235e-a3a9-473a-b74f-bc7acf3382b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:16.004245 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a949235e-a3a9-473a-b74f-bc7acf3382b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:16.019002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-caacae00-d1a9-4601-ab72-1df854047977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:16.036140 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-caacae00-d1a9-4601-ab72-1df854047977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1274 microversion: 2.1 time: 0.218572 Jul 12 11:53:16.036989 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 565/1083] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:15 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1274 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:16.223048 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-a949235e-a3a9-473a-b74f-bc7acf3382b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:16.260498 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a949235e-a3a9-473a-b74f-bc7acf3382b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.285608 Jul 12 11:53:16.272157 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 519/1084] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:15 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:53:16.590382 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-cdffdffa-2668-4fe0-8997-dce7cb750877 req-adff1f06-6aff-4ba2-b58c-826c34cc7a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07a2e514-796f-4ddf-87f3-72e6ca31659e", "tag": "548948e7-18e0-478e-a904-4aa9a8a158eb"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:16.654691 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-cdffdffa-2668-4fe0-8997-dce7cb750877 req-adff1f06-6aff-4ba2-b58c-826c34cc7a3e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:16.655151 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-cdffdffa-2668-4fe0-8997-dce7cb750877 req-adff1f06-6aff-4ba2-b58c-826c34cc7a3e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:16.683201 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-cdffdffa-2668-4fe0-8997-dce7cb750877 req-adff1f06-6aff-4ba2-b58c-826c34cc7a3e service nova] Creating event network-changed:548948e7-18e0-478e-a904-4aa9a8a158eb for instance 07a2e514-796f-4ddf-87f3-72e6ca31659e on n-h1-849104-4 Jul 12 11:53:16.699355 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-cdffdffa-2668-4fe0-8997-dce7cb750877 req-adff1f06-6aff-4ba2-b58c-826c34cc7a3e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125418 Jul 12 11:53:16.706034 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 566/1085] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:16.731032 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4b046566-fadd-4d85-8bff-3bbb4db19129 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:16.731926 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4b046566-fadd-4d85-8bff-3bbb4db19129 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:16.782656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4b046566-fadd-4d85-8bff-3bbb4db19129 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:16.787026 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4b046566-fadd-4d85-8bff-3bbb4db19129 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:16.793498 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4b046566-fadd-4d85-8bff-3bbb4db19129 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:16.794670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4b046566-fadd-4d85-8bff-3bbb4db19129 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:16.837934 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:16.845290 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-81c2ca4a-a730-4f50-9557-3f725f394b56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:16.846290 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-81c2ca4a-a730-4f50-9557-3f725f394b56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:16.872608 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-81c2ca4a-a730-4f50-9557-3f725f394b56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:16.873188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-81c2ca4a-a730-4f50-9557-3f725f394b56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:16.874043 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-81c2ca4a-a730-4f50-9557-3f725f394b56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:16.874683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-81c2ca4a-a730-4f50-9557-3f725f394b56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:17.256875 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-81c2ca4a-a730-4f50-9557-3f725f394b56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:17.273186 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-81c2ca4a-a730-4f50-9557-3f725f394b56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.432667 Jul 12 11:53:17.274094 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 567/1086] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:16 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:17.291490 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a541fb3e-1270-457e-920f-2d657487588c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:17.292995 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a541fb3e-1270-457e-920f-2d657487588c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:17.303561 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a541fb3e-1270-457e-920f-2d657487588c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:17.305058 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a541fb3e-1270-457e-920f-2d657487588c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:17.306848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a541fb3e-1270-457e-920f-2d657487588c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:17.308640 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a541fb3e-1270-457e-920f-2d657487588c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:17.568591 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a541fb3e-1270-457e-920f-2d657487588c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:17.577609 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a541fb3e-1270-457e-920f-2d657487588c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1316 microversion: 2.1 time: 0.292327 Jul 12 11:53:17.587142 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 568/1087] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:17 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:17.590497 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-24fceef8-5c13-41f2-94a6-38a3b06e7e49 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:17.591150 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-24fceef8-5c13-41f2-94a6-38a3b06e7e49 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:17.599411 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24fceef8-5c13-41f2-94a6-38a3b06e7e49 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:17.599864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24fceef8-5c13-41f2-94a6-38a3b06e7e49 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:17.600682 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24fceef8-5c13-41f2-94a6-38a3b06e7e49 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:17.601396 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24fceef8-5c13-41f2-94a6-38a3b06e7e49 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:17.757226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-24fceef8-5c13-41f2-94a6-38a3b06e7e49 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:17.768405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:17.805640 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-24fceef8-5c13-41f2-94a6-38a3b06e7e49 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.218737 Jul 12 11:53:17.808192 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 569/1088] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:17 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:17.892588 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4b046566-fadd-4d85-8bff-3bbb4db19129 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:17.909659 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4b046566-fadd-4d85-8bff-3bbb4db19129 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1314 microversion: 2.1 time: 1.186905 Jul 12 11:53:17.911486 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 520/1089] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:16 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1314 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:18.298236 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-303f0a21-40f7-4386-9b61-2afa3698627a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:18.299964 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-303f0a21-40f7-4386-9b61-2afa3698627a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:18.317656 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-303f0a21-40f7-4386-9b61-2afa3698627a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:18.318504 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-303f0a21-40f7-4386-9b61-2afa3698627a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:18.320129 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-303f0a21-40f7-4386-9b61-2afa3698627a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:18.320944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-303f0a21-40f7-4386-9b61-2afa3698627a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:18.331714 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:18.598063 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a67cafe9-eb96-4ff7-974f-5b70a38b59a3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:18.598962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a67cafe9-eb96-4ff7-974f-5b70a38b59a3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:18.606632 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=8 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:18.609058 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a67cafe9-eb96-4ff7-974f-5b70a38b59a3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:18.609527 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a67cafe9-eb96-4ff7-974f-5b70a38b59a3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:18.610574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a67cafe9-eb96-4ff7-974f-5b70a38b59a3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:18.610771 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a67cafe9-eb96-4ff7-974f-5b70a38b59a3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:18.681218 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-303f0a21-40f7-4386-9b61-2afa3698627a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:18.695688 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-303f0a21-40f7-4386-9b61-2afa3698627a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.405929 Jul 12 11:53:18.701506 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 570/1090] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:18 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:18.842061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2ac8b2de-5368-48fb-80ca-a27a7c0e5b2e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:18.844498 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2ac8b2de-5368-48fb-80ca-a27a7c0e5b2e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:18.855245 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2ac8b2de-5368-48fb-80ca-a27a7c0e5b2e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:18.856165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2ac8b2de-5368-48fb-80ca-a27a7c0e5b2e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:18.857836 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2ac8b2de-5368-48fb-80ca-a27a7c0e5b2e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:18.858921 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2ac8b2de-5368-48fb-80ca-a27a7c0e5b2e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:18.931083 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a67cafe9-eb96-4ff7-974f-5b70a38b59a3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:18.954781 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a67cafe9-eb96-4ff7-974f-5b70a38b59a3 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1316 microversion: 2.1 time: 0.362338 Jul 12 11:53:18.955789 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 521/1091] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:18 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:18.974167 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-263923ae-7424-4e78-bcf2-63242b780be7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:18.975299 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-263923ae-7424-4e78-bcf2-63242b780be7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:18.993920 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-263923ae-7424-4e78-bcf2-63242b780be7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:18.994404 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-263923ae-7424-4e78-bcf2-63242b780be7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:18.995538 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-263923ae-7424-4e78-bcf2-63242b780be7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:18.995991 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-263923ae-7424-4e78-bcf2-63242b780be7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:19.198248 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-2ac8b2de-5368-48fb-80ca-a27a7c0e5b2e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:19.211507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-263923ae-7424-4e78-bcf2-63242b780be7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:19.221242 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-263923ae-7424-4e78-bcf2-63242b780be7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1314 microversion: 2.1 time: 0.263195 Jul 12 11:53:19.232562 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 522/1092] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:18 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:19.237663 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2ac8b2de-5368-48fb-80ca-a27a7c0e5b2e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.403659 Jul 12 11:53:19.239300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-926bfce1-de14-411b-90a4-fda59308736c req-f96158d3-4b5e-4396-a5b2-64323ddd8c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43639aef-3a2d-45f9-a65a-b6db8b47f97a", "tag": "df7058ed-4830-453a-9b06-4684afbbab82"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:19.251945 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-926bfce1-de14-411b-90a4-fda59308736c req-f96158d3-4b5e-4396-a5b2-64323ddd8c84 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:19.252634 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 571/1093] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:18 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:19.253022 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-926bfce1-de14-411b-90a4-fda59308736c req-f96158d3-4b5e-4396-a5b2-64323ddd8c84 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:19.266388 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-926bfce1-de14-411b-90a4-fda59308736c req-f96158d3-4b5e-4396-a5b2-64323ddd8c84 service nova] Creating event network-changed:df7058ed-4830-453a-9b06-4684afbbab82 for instance 43639aef-3a2d-45f9-a65a-b6db8b47f97a on n-h1-849104-4 Jul 12 11:53:19.271448 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-926bfce1-de14-411b-90a4-fda59308736c req-f96158d3-4b5e-4396-a5b2-64323ddd8c84 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036812 Jul 12 11:53:19.272466 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 523/1094] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:19.723650 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7d72ae86-9918-4316-a952-75056801ed3f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:19.725023 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7d72ae86-9918-4316-a952-75056801ed3f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:19.740431 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d72ae86-9918-4316-a952-75056801ed3f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:19.741858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d72ae86-9918-4316-a952-75056801ed3f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:19.743889 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d72ae86-9918-4316-a952-75056801ed3f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:19.745122 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d72ae86-9918-4316-a952-75056801ed3f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:19.980502 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fe6440ea-23db-4dac-b9ba-96afb81b7ca5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:19.981855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fe6440ea-23db-4dac-b9ba-96afb81b7ca5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:19.990253 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe6440ea-23db-4dac-b9ba-96afb81b7ca5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:19.990817 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe6440ea-23db-4dac-b9ba-96afb81b7ca5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:19.991906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe6440ea-23db-4dac-b9ba-96afb81b7ca5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:19.992823 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe6440ea-23db-4dac-b9ba-96afb81b7ca5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:20.082823 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7d72ae86-9918-4316-a952-75056801ed3f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:20.094259 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7d72ae86-9918-4316-a952-75056801ed3f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.378480 Jul 12 11:53:20.106013 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 572/1095] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:19 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:20.240097 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-47a09726-afef-43a9-bca3-afef07ee3503 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:20.240824 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-47a09726-afef-43a9-bca3-afef07ee3503 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:20.251225 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-47a09726-afef-43a9-bca3-afef07ee3503 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:20.251772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-47a09726-afef-43a9-bca3-afef07ee3503 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:20.252809 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-47a09726-afef-43a9-bca3-afef07ee3503 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:20.253324 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-47a09726-afef-43a9-bca3-afef07ee3503 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:20.441839 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fe6440ea-23db-4dac-b9ba-96afb81b7ca5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:20.458188 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fe6440ea-23db-4dac-b9ba-96afb81b7ca5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1316 microversion: 2.1 time: 0.487380 Jul 12 11:53:20.459512 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 524/1096] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:19 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1316 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:20.470958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8c4722f8-8fe9-4a34-bf8e-221f217710b3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:20.472570 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8c4722f8-8fe9-4a34-bf8e-221f217710b3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:20.487506 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c4722f8-8fe9-4a34-bf8e-221f217710b3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:20.488823 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c4722f8-8fe9-4a34-bf8e-221f217710b3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:20.490336 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c4722f8-8fe9-4a34-bf8e-221f217710b3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:20.491221 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c4722f8-8fe9-4a34-bf8e-221f217710b3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:20.607348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-47a09726-afef-43a9-bca3-afef07ee3503 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:20.625713 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-47a09726-afef-43a9-bca3-afef07ee3503 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1314 microversion: 2.1 time: 0.389835 Jul 12 11:53:20.626723 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 573/1097] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:20 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:20.682845 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-8c4722f8-8fe9-4a34-bf8e-221f217710b3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:20.725254 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8c4722f8-8fe9-4a34-bf8e-221f217710b3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.263613 Jul 12 11:53:20.738026 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 525/1098] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:20 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:21.114398 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d603108e-869d-4bb0-9b8a-cea83d610b3b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:21.116283 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d603108e-869d-4bb0-9b8a-cea83d610b3b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:21.127471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d603108e-869d-4bb0-9b8a-cea83d610b3b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:21.128420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d603108e-869d-4bb0-9b8a-cea83d610b3b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:21.129277 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d603108e-869d-4bb0-9b8a-cea83d610b3b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:21.129819 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d603108e-869d-4bb0-9b8a-cea83d610b3b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:21.300713 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:21.419665 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d603108e-869d-4bb0-9b8a-cea83d610b3b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:21.439736 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d603108e-869d-4bb0-9b8a-cea83d610b3b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.328931 Jul 12 11:53:21.450757 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 574/1099] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:21 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:21.498369 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0ce06e2f-af37-4494-a81a-7503e9109927 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:21.500315 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0ce06e2f-af37-4494-a81a-7503e9109927 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:21.516779 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ce06e2f-af37-4494-a81a-7503e9109927 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:21.517934 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ce06e2f-af37-4494-a81a-7503e9109927 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:21.519369 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ce06e2f-af37-4494-a81a-7503e9109927 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:21.520816 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ce06e2f-af37-4494-a81a-7503e9109927 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:21.655389 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2edb3331-8166-49c1-b378-c68134b5b7a2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:21.656594 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2edb3331-8166-49c1-b378-c68134b5b7a2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:21.664673 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2edb3331-8166-49c1-b378-c68134b5b7a2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:21.665781 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2edb3331-8166-49c1-b378-c68134b5b7a2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:21.667016 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2edb3331-8166-49c1-b378-c68134b5b7a2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:21.667648 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2edb3331-8166-49c1-b378-c68134b5b7a2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:21.799567 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0ce06e2f-af37-4494-a81a-7503e9109927 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:21.822354 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0ce06e2f-af37-4494-a81a-7503e9109927 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1316 microversion: 2.1 time: 0.335703 Jul 12 11:53:21.824175 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 526/1100] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:21 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:21.840334 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7e1fe0c2-68c3-4794-81dd-42809d7226dd tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:21.841879 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7e1fe0c2-68c3-4794-81dd-42809d7226dd tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:21.861426 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7e1fe0c2-68c3-4794-81dd-42809d7226dd tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:21.862073 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7e1fe0c2-68c3-4794-81dd-42809d7226dd tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:21.863309 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7e1fe0c2-68c3-4794-81dd-42809d7226dd tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:21.864000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7e1fe0c2-68c3-4794-81dd-42809d7226dd tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:21.886641 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=10 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:21.980602 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-7e1fe0c2-68c3-4794-81dd-42809d7226dd tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:22.009561 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7e1fe0c2-68c3-4794-81dd-42809d7226dd tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.183312 Jul 12 11:53:22.011086 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 527/1101] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:21 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:22.158763 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2edb3331-8166-49c1-b378-c68134b5b7a2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:22.204685 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2edb3331-8166-49c1-b378-c68134b5b7a2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1314 microversion: 2.1 time: 0.552792 Jul 12 11:53:22.208077 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 575/1102] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:21 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:22.335887 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-883c43cd-77d5-4d2c-9720-b28c74a1ba47 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b5c9c754-d27e-4178-9bd3-3b955c3e4b9c"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:22.339331 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-883c43cd-77d5-4d2c-9720-b28c74a1ba47 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:22.351831 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-883c43cd-77d5-4d2c-9720-b28c74a1ba47 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:22.353365 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-883c43cd-77d5-4d2c-9720-b28c74a1ba47 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:22.354948 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-883c43cd-77d5-4d2c-9720-b28c74a1ba47 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:22.355642 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-883c43cd-77d5-4d2c-9720-b28c74a1ba47 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:22.460445 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5a0cca8b-ea72-4988-b627-beb7545e3a64 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:22.461849 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5a0cca8b-ea72-4988-b627-beb7545e3a64 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:22.467895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:22.477660 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a0cca8b-ea72-4988-b627-beb7545e3a64 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:22.478709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a0cca8b-ea72-4988-b627-beb7545e3a64 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:22.480907 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a0cca8b-ea72-4988-b627-beb7545e3a64 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:22.481891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a0cca8b-ea72-4988-b627-beb7545e3a64 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:22.783672 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5a0cca8b-ea72-4988-b627-beb7545e3a64 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:22.804275 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5a0cca8b-ea72-4988-b627-beb7545e3a64 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.348496 Jul 12 11:53:22.816272 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 576/1103] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:22 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:22.852623 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5a8ce9ab-6a7e-4c20-a931-7648ba18d3fd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:22.856618 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5a8ce9ab-6a7e-4c20-a931-7648ba18d3fd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:22.870944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a8ce9ab-6a7e-4c20-a931-7648ba18d3fd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:22.872056 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a8ce9ab-6a7e-4c20-a931-7648ba18d3fd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:22.874137 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-883c43cd-77d5-4d2c-9720-b28c74a1ba47 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] HTTP exception thrown: Volume b5c9c754-d27e-4178-9bd3-3b955c3e4b9c could not be found. Jul 12 11:53:22.875216 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a8ce9ab-6a7e-4c20-a931-7648ba18d3fd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:22.877065 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a8ce9ab-6a7e-4c20-a931-7648ba18d3fd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-883c43cd-77d5-4d2c-9720-b28c74a1ba47 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] Request method failure captured: Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: request: PUT /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments/61f537d3-98d7-46e4-b5e7-4622662b7215 HTTP/1.1 Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 74 Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWBBhprt3k5C0vxBR4t430Uaa_sKPL4IfttVXhfiLMmYOM3qDX2Bzzhku70B4WH3ToJBPzyqbJ7L1py6DaycJRv8hemWW-PnXYWdP_1wmwVHFxmVM2mQr0rB4uzkiHaEGcyJeu2GpLMetU6IqON0j5bWWH1CJQbQtp_sfc6G7ykhzqQ Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 72d697d522c2412abfe1e7a183186c5e Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-VolumesAdminNegativeTest-1019490232 Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72d697d522c2412abfe1e7a183186c5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72d697d522c2412abfe1e7a183186c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72d697d522c2412abfe1e7a183186c5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72d697d522c2412abfe1e7a183186c5e", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-VolumesAdminNegativeTest-1019490232 Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 72d697d522c2412abfe1e7a183186c5e Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1019490232 Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-VolumesAdminNegativeTest-1019490232-project-admin Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 654cc31838d8437f9ac2d3e50e44b877 Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-VolumesAdminNegativeTest-1019490232-project-admin Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: {"volumeAttachment": {"volumeId": "b5c9c754-d27e-4178-9bd3-3b955c3e4b9c"}} Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: exception: Volume b5c9c754-d27e-4178-9bd3-3b955c3e4b9c could not be found. Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'server_id': 'bdb218c5-ad4e-4287-b44f-1c77481559cb', 'id': '61f537d3-98d7-46e4-b5e7-4622662b7215', 'body': {'volumeAttachment': {'volumeId': 'b5c9c754-d27e-4178-9bd3-3b955c3e4b9c'}}} Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5c9c754-d27e-4178-9bd3-3b955c3e4b9c could not be found. (HTTP 404) (Request-ID: req-adaae943-888f-4917-b7b9-d32debce2ebc) Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 11:53:22.882415 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5c9c754-d27e-4178-9bd3-3b955c3e4b9c could not be found. Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume b5c9c754-d27e-4178-9bd3-3b955c3e4b9c could not be found. Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5c9c754-d27e-4178-9bd3-3b955c3e4b9c could not be found. Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-883c43cd-77d5-4d2c-9720-b28c74a1ba47 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] Returning 400 to user: Volume b5c9c754-d27e-4178-9bd3-3b955c3e4b9c could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-883c43cd-77d5-4d2c-9720-b28c74a1ba47 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] 10.222.0.50 "PUT /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments/61f537d3-98d7-46e4-b5e7-4622662b7215" status: 400 len: 107 microversion: 2.1 time: 0.825105 Jul 12 11:53:22.891389 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 528/1104] 10.222.0.50 () {60 vars in 1432 bytes} [Tue Jul 12 11:53:22 2022] PUT /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments/61f537d3-98d7-46e4-b5e7-4622662b7215 => generated 107 bytes in 829 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:53:23.006204 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ddc9e0a9-835d-4827-8ab4-2c87bbda36ec tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:23.018752 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ddc9e0a9-835d-4827-8ab4-2c87bbda36ec tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:23.042271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ddc9e0a9-835d-4827-8ab4-2c87bbda36ec tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:23.043097 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ddc9e0a9-835d-4827-8ab4-2c87bbda36ec tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:23.044447 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ddc9e0a9-835d-4827-8ab4-2c87bbda36ec tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:23.045173 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ddc9e0a9-835d-4827-8ab4-2c87bbda36ec tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:23.254912 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5a8ce9ab-6a7e-4c20-a931-7648ba18d3fd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:23.308887 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5a8ce9ab-6a7e-4c20-a931-7648ba18d3fd tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1316 microversion: 2.1 time: 0.451973 Jul 12 11:53:23.309991 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 577/1105] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:22 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:23.318399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ebc71069-55e2-43f9-94bd-0e6e33f6b240 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:23.320272 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ebc71069-55e2-43f9-94bd-0e6e33f6b240 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:23.337680 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ebc71069-55e2-43f9-94bd-0e6e33f6b240 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:23.339050 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ebc71069-55e2-43f9-94bd-0e6e33f6b240 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:23.340475 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ebc71069-55e2-43f9-94bd-0e6e33f6b240 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:23.341526 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ebc71069-55e2-43f9-94bd-0e6e33f6b240 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:23.422139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-ddc9e0a9-835d-4827-8ab4-2c87bbda36ec tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lazy-loading 'services' on Instance uuid bdb218c5-ad4e-4287-b44f-1c77481559cb {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:23.514341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-ebc71069-55e2-43f9-94bd-0e6e33f6b240 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:23.593642 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ebc71069-55e2-43f9-94bd-0e6e33f6b240 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.281940 Jul 12 11:53:23.599865 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 578/1106] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:23 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:23.610771 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5cda43a4-8bb0-4b6c-8bb7-339478cbc8a5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:23.612565 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5cda43a4-8bb0-4b6c-8bb7-339478cbc8a5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:23.625324 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5cda43a4-8bb0-4b6c-8bb7-339478cbc8a5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:23.625784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5cda43a4-8bb0-4b6c-8bb7-339478cbc8a5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:23.626589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5cda43a4-8bb0-4b6c-8bb7-339478cbc8a5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:23.627205 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5cda43a4-8bb0-4b6c-8bb7-339478cbc8a5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:23.694419 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ddc9e0a9-835d-4827-8ab4-2c87bbda36ec tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments/61f537d3-98d7-46e4-b5e7-4622662b7215" status: 202 len: 0 microversion: 2.1 time: 0.692916 Jul 12 11:53:23.696564 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 529/1107] 10.222.0.50 () {58 vars in 1415 bytes} [Tue Jul 12 11:53:22 2022] DELETE /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments/61f537d3-98d7-46e4-b5e7-4622662b7215 => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:53:23.718648 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d3385e24-3dcf-4c99-95bc-1205de4e65cf tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:23.722051 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d3385e24-3dcf-4c99-95bc-1205de4e65cf tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:23.735857 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d3385e24-3dcf-4c99-95bc-1205de4e65cf tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:23.737045 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d3385e24-3dcf-4c99-95bc-1205de4e65cf tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:23.738654 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d3385e24-3dcf-4c99-95bc-1205de4e65cf tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:23.739868 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d3385e24-3dcf-4c99-95bc-1205de4e65cf tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:23.829422 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d3385e24-3dcf-4c99-95bc-1205de4e65cf tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121042 Jul 12 11:53:23.831746 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 530/1108] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:53:23 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:23.848409 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-4e82430f-f0ab-4fa6-851c-29cbbb98e96b req-75fe47e1-6ca5-471d-b6d9-f7d3fbce2d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a2e514-796f-4ddf-87f3-72e6ca31659e", "name": "network-vif-plugged", "status": "completed", "tag": "548948e7-18e0-478e-a904-4aa9a8a158eb"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:23.864660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4e82430f-f0ab-4fa6-851c-29cbbb98e96b req-75fe47e1-6ca5-471d-b6d9-f7d3fbce2d1b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:23.871296 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4e82430f-f0ab-4fa6-851c-29cbbb98e96b req-75fe47e1-6ca5-471d-b6d9-f7d3fbce2d1b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:23.895710 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-4e82430f-f0ab-4fa6-851c-29cbbb98e96b req-75fe47e1-6ca5-471d-b6d9-f7d3fbce2d1b service nova] Creating event network-vif-plugged:548948e7-18e0-478e-a904-4aa9a8a158eb for instance 07a2e514-796f-4ddf-87f3-72e6ca31659e on n-h1-849104-4 Jul 12 11:53:23.896760 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5cda43a4-8bb0-4b6c-8bb7-339478cbc8a5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:23.903844 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5cda43a4-8bb0-4b6c-8bb7-339478cbc8a5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1314 microversion: 2.1 time: 0.301821 Jul 12 11:53:23.905272 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 579/1109] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:23 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:23.910358 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-4e82430f-f0ab-4fa6-851c-29cbbb98e96b req-75fe47e1-6ca5-471d-b6d9-f7d3fbce2d1b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075799 Jul 12 11:53:23.913876 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 531/1110] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:23.914464 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9c9d1215-ee00-4a1a-a232-ce91ef308d36 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:23.916017 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9c9d1215-ee00-4a1a-a232-ce91ef308d36 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:23.938135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c9d1215-ee00-4a1a-a232-ce91ef308d36 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:23.938503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c9d1215-ee00-4a1a-a232-ce91ef308d36 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:23.940268 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c9d1215-ee00-4a1a-a232-ce91ef308d36 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:23.941346 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c9d1215-ee00-4a1a-a232-ce91ef308d36 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:24.169929 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9c9d1215-ee00-4a1a-a232-ce91ef308d36 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:24.196466 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9c9d1215-ee00-4a1a-a232-ce91ef308d36 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.288328 Jul 12 11:53:24.199650 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 580/1111] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:23 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:24.342985 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fd16e626-572a-4aa1-a095-441a6cd0fcf9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:24.344619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fd16e626-572a-4aa1-a095-441a6cd0fcf9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:24.355078 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd16e626-572a-4aa1-a095-441a6cd0fcf9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:24.355876 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd16e626-572a-4aa1-a095-441a6cd0fcf9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:24.357545 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd16e626-572a-4aa1-a095-441a6cd0fcf9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:24.358485 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd16e626-572a-4aa1-a095-441a6cd0fcf9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:24.586022 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fd16e626-572a-4aa1-a095-441a6cd0fcf9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:24.601724 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fd16e626-572a-4aa1-a095-441a6cd0fcf9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1316 microversion: 2.1 time: 0.265535 Jul 12 11:53:24.603202 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 532/1112] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:24 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:24.633681 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dfadbcee-e558-4ec1-8338-2ac5bd1bf441 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:24.635906 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dfadbcee-e558-4ec1-8338-2ac5bd1bf441 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:24.648903 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dfadbcee-e558-4ec1-8338-2ac5bd1bf441 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:24.649678 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dfadbcee-e558-4ec1-8338-2ac5bd1bf441 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:24.651293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dfadbcee-e558-4ec1-8338-2ac5bd1bf441 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:24.652487 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dfadbcee-e558-4ec1-8338-2ac5bd1bf441 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:24.816456 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-dfadbcee-e558-4ec1-8338-2ac5bd1bf441 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:24.851758 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-616ded39-63f2-43b1-b239-e377a3745e81 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:24.853664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-616ded39-63f2-43b1-b239-e377a3745e81 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:24.871703 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-616ded39-63f2-43b1-b239-e377a3745e81 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:24.872913 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-616ded39-63f2-43b1-b239-e377a3745e81 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:24.874797 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-616ded39-63f2-43b1-b239-e377a3745e81 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:24.875843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-616ded39-63f2-43b1-b239-e377a3745e81 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:24.881869 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dfadbcee-e558-4ec1-8338-2ac5bd1bf441 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.257429 Jul 12 11:53:24.883548 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 581/1113] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:24 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:24.931627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-84ee1b0b-2fa9-466a-975a-e058a82d3671 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:24.932927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-84ee1b0b-2fa9-466a-975a-e058a82d3671 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:24.950913 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-616ded39-63f2-43b1-b239-e377a3745e81 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109916 Jul 12 11:53:24.952250 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 533/1114] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:53:24 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:24.960637 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84ee1b0b-2fa9-466a-975a-e058a82d3671 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:24.961709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84ee1b0b-2fa9-466a-975a-e058a82d3671 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:24.963617 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84ee1b0b-2fa9-466a-975a-e058a82d3671 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:24.964385 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84ee1b0b-2fa9-466a-975a-e058a82d3671 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:25.196271 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-84ee1b0b-2fa9-466a-975a-e058a82d3671 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:25.208215 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-84ee1b0b-2fa9-466a-975a-e058a82d3671 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1314 microversion: 2.1 time: 0.281033 Jul 12 11:53:25.222553 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 582/1115] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:24 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:25.225692 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-331a9d2f-02f9-4d75-a22c-5898b1350d2e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:25.227346 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-331a9d2f-02f9-4d75-a22c-5898b1350d2e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:25.238871 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-331a9d2f-02f9-4d75-a22c-5898b1350d2e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:25.239649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-331a9d2f-02f9-4d75-a22c-5898b1350d2e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:25.241545 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-331a9d2f-02f9-4d75-a22c-5898b1350d2e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:25.242070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-331a9d2f-02f9-4d75-a22c-5898b1350d2e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:25.558870 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-331a9d2f-02f9-4d75-a22c-5898b1350d2e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:25.588287 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-331a9d2f-02f9-4d75-a22c-5898b1350d2e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.365642 Jul 12 11:53:25.591523 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 534/1116] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:25 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:25.626167 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2cf73e52-61aa-4d2e-bedb-e787cb20211e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:25.627062 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2cf73e52-61aa-4d2e-bedb-e787cb20211e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:25.646577 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2cf73e52-61aa-4d2e-bedb-e787cb20211e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:25.647148 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2cf73e52-61aa-4d2e-bedb-e787cb20211e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:25.648183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2cf73e52-61aa-4d2e-bedb-e787cb20211e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:25.648852 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2cf73e52-61aa-4d2e-bedb-e787cb20211e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:25.918373 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0eb484dd-34b5-4b33-a4ad-a2dc0acf5525 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:25.923987 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0eb484dd-34b5-4b33-a4ad-a2dc0acf5525 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:25.933474 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2cf73e52-61aa-4d2e-bedb-e787cb20211e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:25.936902 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0eb484dd-34b5-4b33-a4ad-a2dc0acf5525 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:25.940179 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0eb484dd-34b5-4b33-a4ad-a2dc0acf5525 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:25.941623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0eb484dd-34b5-4b33-a4ad-a2dc0acf5525 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:25.942827 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0eb484dd-34b5-4b33-a4ad-a2dc0acf5525 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:25.943049 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2cf73e52-61aa-4d2e-bedb-e787cb20211e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1316 microversion: 2.1 time: 0.321725 Jul 12 11:53:25.944161 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 583/1117] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:25 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:25.963646 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4bd2af2c-c213-40f8-a897-5066c3558d9e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:25.964951 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4bd2af2c-c213-40f8-a897-5066c3558d9e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:25.972787 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4bd2af2c-c213-40f8-a897-5066c3558d9e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:25.973866 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4bd2af2c-c213-40f8-a897-5066c3558d9e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:25.976349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4bd2af2c-c213-40f8-a897-5066c3558d9e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:25.976886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4bd2af2c-c213-40f8-a897-5066c3558d9e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:26.055606 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4bd2af2c-c213-40f8-a897-5066c3558d9e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096184 Jul 12 11:53:26.057775 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 584/1118] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:53:25 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:26.124219 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-0eb484dd-34b5-4b33-a4ad-a2dc0acf5525 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:26.188722 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0eb484dd-34b5-4b33-a4ad-a2dc0acf5525 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.278628 Jul 12 11:53:26.190409 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 535/1119] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:25 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:26.230351 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-58166c39-b6a7-4744-b0be-a934c92c05b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:26.231082 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-58166c39-b6a7-4744-b0be-a934c92c05b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:26.243640 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58166c39-b6a7-4744-b0be-a934c92c05b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:26.245153 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58166c39-b6a7-4744-b0be-a934c92c05b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:26.246210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58166c39-b6a7-4744-b0be-a934c92c05b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:26.246821 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58166c39-b6a7-4744-b0be-a934c92c05b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:26.486759 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-58166c39-b6a7-4744-b0be-a934c92c05b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:26.492957 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:26.503967 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-58166c39-b6a7-4744-b0be-a934c92c05b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1500 microversion: 2.1 time: 0.278587 Jul 12 11:53:26.505232 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 585/1120] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:26 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1500 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:26.533234 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8a67a37f-7a8f-4bd0-b3c6-e2fa4a0917e6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:26.533938 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8a67a37f-7a8f-4bd0-b3c6-e2fa4a0917e6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:26.546283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8a67a37f-7a8f-4bd0-b3c6-e2fa4a0917e6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:26.547211 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8a67a37f-7a8f-4bd0-b3c6-e2fa4a0917e6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:26.549202 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8a67a37f-7a8f-4bd0-b3c6-e2fa4a0917e6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:26.549972 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8a67a37f-7a8f-4bd0-b3c6-e2fa4a0917e6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:26.616958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8a67a37f-7a8f-4bd0-b3c6-e2fa4a0917e6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:53:26.617962 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d7f605f3-b5ce-417b-99e8-e60b8d2db7cf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:26.618939 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d7f605f3-b5ce-417b-99e8-e60b8d2db7cf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:26.622008 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:26.631583 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d7f605f3-b5ce-417b-99e8-e60b8d2db7cf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:26.632414 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d7f605f3-b5ce-417b-99e8-e60b8d2db7cf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:26.633761 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d7f605f3-b5ce-417b-99e8-e60b8d2db7cf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:26.634851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d7f605f3-b5ce-417b-99e8-e60b8d2db7cf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:26.753906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:26.759244 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8a67a37f-7a8f-4bd0-b3c6-e2fa4a0917e6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 204 len: 0 microversion: 2.1 time: 0.234794 Jul 12 11:53:26.759842 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 536/1121] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:53:26 2022] DELETE /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:53:26.769099 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fb3cf5fb-c7ad-43c0-a55e-dd6da21a8b3f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:26.769896 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fb3cf5fb-c7ad-43c0-a55e-dd6da21a8b3f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:26.778266 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fb3cf5fb-c7ad-43c0-a55e-dd6da21a8b3f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:26.778809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fb3cf5fb-c7ad-43c0-a55e-dd6da21a8b3f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:26.780326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fb3cf5fb-c7ad-43c0-a55e-dd6da21a8b3f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:26.780326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fb3cf5fb-c7ad-43c0-a55e-dd6da21a8b3f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:26.943712 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fb3cf5fb-c7ad-43c0-a55e-dd6da21a8b3f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:26.953475 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fb3cf5fb-c7ad-43c0-a55e-dd6da21a8b3f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1506 microversion: 2.1 time: 0.188575 Jul 12 11:53:26.956191 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 537/1122] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:26 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1506 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:26.975644 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-84975ccb-1764-47b4-948a-afb451ba72f5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:26.977102 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-84975ccb-1764-47b4-948a-afb451ba72f5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:26.985245 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-84975ccb-1764-47b4-948a-afb451ba72f5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:26.985964 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-84975ccb-1764-47b4-948a-afb451ba72f5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:26.986980 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-84975ccb-1764-47b4-948a-afb451ba72f5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:26.987714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-84975ccb-1764-47b4-948a-afb451ba72f5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:27.012429 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d7f605f3-b5ce-417b-99e8-e60b8d2db7cf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:27.033642 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d7f605f3-b5ce-417b-99e8-e60b8d2db7cf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.421867 Jul 12 11:53:27.034723 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 586/1123] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:26 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:27.073674 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1eadca68-bc75-4b0e-82b9-eea9cb5dfcdb tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:27.075004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1eadca68-bc75-4b0e-82b9-eea9cb5dfcdb tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:27.083405 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1eadca68-bc75-4b0e-82b9-eea9cb5dfcdb tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:27.086424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1eadca68-bc75-4b0e-82b9-eea9cb5dfcdb tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:27.087501 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1eadca68-bc75-4b0e-82b9-eea9cb5dfcdb tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:27.090095 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1eadca68-bc75-4b0e-82b9-eea9cb5dfcdb tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:27.163104 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1eadca68-bc75-4b0e-82b9-eea9cb5dfcdb tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091931 Jul 12 11:53:27.165099 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 587/1124] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:53:27 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:27.221783 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4629d6a0-7f84-4e26-8d22-41a50258325e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:27.223519 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4629d6a0-7f84-4e26-8d22-41a50258325e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:27.234171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4629d6a0-7f84-4e26-8d22-41a50258325e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:27.235431 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4629d6a0-7f84-4e26-8d22-41a50258325e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:27.237044 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4629d6a0-7f84-4e26-8d22-41a50258325e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:27.238086 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4629d6a0-7f84-4e26-8d22-41a50258325e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:27.260841 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-84975ccb-1764-47b4-948a-afb451ba72f5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:27.271474 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-84975ccb-1764-47b4-948a-afb451ba72f5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1316 microversion: 2.1 time: 0.310807 Jul 12 11:53:27.291680 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 538/1125] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:26 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:27.408652 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-4629d6a0-7f84-4e26-8d22-41a50258325e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:27.436851 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4629d6a0-7f84-4e26-8d22-41a50258325e tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.221637 Jul 12 11:53:27.437975 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 588/1126] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:27 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:53:27.523672 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-86f7c4a4-17bb-412a-b8b1-8c8b7de6f415 req-661bba3b-7f3c-4883-b468-0beba1cbb357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43639aef-3a2d-45f9-a65a-b6db8b47f97a", "name": "network-vif-plugged", "status": "completed", "tag": "df7058ed-4830-453a-9b06-4684afbbab82"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:27.568633 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-86f7c4a4-17bb-412a-b8b1-8c8b7de6f415 req-661bba3b-7f3c-4883-b468-0beba1cbb357 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:27.570099 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-86f7c4a4-17bb-412a-b8b1-8c8b7de6f415 req-661bba3b-7f3c-4883-b468-0beba1cbb357 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:27.590293 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-86f7c4a4-17bb-412a-b8b1-8c8b7de6f415 req-661bba3b-7f3c-4883-b468-0beba1cbb357 service nova] Creating event network-vif-plugged:df7058ed-4830-453a-9b06-4684afbbab82 for instance 43639aef-3a2d-45f9-a65a-b6db8b47f97a on n-h1-849104-4 Jul 12 11:53:27.601356 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-86f7c4a4-17bb-412a-b8b1-8c8b7de6f415 req-661bba3b-7f3c-4883-b468-0beba1cbb357 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082155 Jul 12 11:53:27.603297 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 539/1127] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:27.989061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-83f038fa-0a0d-4a16-9684-0e3f921ed00d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:27.990928 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-83f038fa-0a0d-4a16-9684-0e3f921ed00d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:28.005083 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83f038fa-0a0d-4a16-9684-0e3f921ed00d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:28.006776 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83f038fa-0a0d-4a16-9684-0e3f921ed00d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:28.008917 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83f038fa-0a0d-4a16-9684-0e3f921ed00d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:28.009631 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83f038fa-0a0d-4a16-9684-0e3f921ed00d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:28.077770 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0e83a4fa-50f3-4bcf-9844-eded1e0e8e3a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:28.082057 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0e83a4fa-50f3-4bcf-9844-eded1e0e8e3a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:28.103778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0e83a4fa-50f3-4bcf-9844-eded1e0e8e3a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:28.105894 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0e83a4fa-50f3-4bcf-9844-eded1e0e8e3a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:28.107597 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0e83a4fa-50f3-4bcf-9844-eded1e0e8e3a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:28.108286 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0e83a4fa-50f3-4bcf-9844-eded1e0e8e3a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:28.316883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-83f038fa-0a0d-4a16-9684-0e3f921ed00d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:28.330413 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-83f038fa-0a0d-4a16-9684-0e3f921ed00d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1506 microversion: 2.1 time: 0.353692 Jul 12 11:53:28.331017 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 589/1128] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:27 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:28.350932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b1cc58df-576a-438d-bf91-58ecce60ae0d tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:28.364589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b1cc58df-576a-438d-bf91-58ecce60ae0d tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:28.387490 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b1cc58df-576a-438d-bf91-58ecce60ae0d tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:28.388220 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b1cc58df-576a-438d-bf91-58ecce60ae0d tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:28.389641 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b1cc58df-576a-438d-bf91-58ecce60ae0d tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:28.390247 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b1cc58df-576a-438d-bf91-58ecce60ae0d tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:28.514061 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0e83a4fa-50f3-4bcf-9844-eded1e0e8e3a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:28.537938 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0e83a4fa-50f3-4bcf-9844-eded1e0e8e3a tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.479327 Jul 12 11:53:28.539786 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 540/1129] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:28 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:28.551635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c5e11337-7108-4f62-a6fc-4ea41808348d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:28.558282 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c5e11337-7108-4f62-a6fc-4ea41808348d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:28.574776 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5e11337-7108-4f62-a6fc-4ea41808348d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:28.584865 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5e11337-7108-4f62-a6fc-4ea41808348d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:28.593751 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5e11337-7108-4f62-a6fc-4ea41808348d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:28.595061 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5e11337-7108-4f62-a6fc-4ea41808348d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:28.788146 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b1cc58df-576a-438d-bf91-58ecce60ae0d tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.441424 Jul 12 11:53:28.793367 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 590/1130] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:53:28 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments => generated 197 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:28.797693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4586f820-50fb-4635-a57f-375768bf88e2 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:28.798313 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4586f820-50fb-4635-a57f-375768bf88e2 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:28.838618 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4586f820-50fb-4635-a57f-375768bf88e2 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:28.840780 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4586f820-50fb-4635-a57f-375768bf88e2 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:28.844714 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4586f820-50fb-4635-a57f-375768bf88e2 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:28.845864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4586f820-50fb-4635-a57f-375768bf88e2 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:29.057026 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c5e11337-7108-4f62-a6fc-4ea41808348d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:29.064158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-4586f820-50fb-4635-a57f-375768bf88e2 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:29.082243 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c5e11337-7108-4f62-a6fc-4ea41808348d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1316 microversion: 2.1 time: 0.539076 Jul 12 11:53:29.089659 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 541/1131] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:28 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:29.113410 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4586f820-50fb-4635-a57f-375768bf88e2 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.323575 Jul 12 11:53:29.115890 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 591/1132] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:28 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:29.358687 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-76acaaef-db24-45fd-9cdd-3d117cac348d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:29.361674 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-76acaaef-db24-45fd-9cdd-3d117cac348d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:29.409793 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76acaaef-db24-45fd-9cdd-3d117cac348d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:29.410577 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76acaaef-db24-45fd-9cdd-3d117cac348d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:29.412426 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76acaaef-db24-45fd-9cdd-3d117cac348d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:29.413356 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76acaaef-db24-45fd-9cdd-3d117cac348d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:29.568620 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bf5f9d28-0a8e-4c16-8562-ee295b6145f4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:29.573759 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bf5f9d28-0a8e-4c16-8562-ee295b6145f4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:29.600743 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf5f9d28-0a8e-4c16-8562-ee295b6145f4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:29.604871 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf5f9d28-0a8e-4c16-8562-ee295b6145f4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:29.609431 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf5f9d28-0a8e-4c16-8562-ee295b6145f4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:29.620200 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf5f9d28-0a8e-4c16-8562-ee295b6145f4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:29.724555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-76acaaef-db24-45fd-9cdd-3d117cac348d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:29.738253 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-76acaaef-db24-45fd-9cdd-3d117cac348d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 200 len: 1464 microversion: 2.1 time: 0.388263 Jul 12 11:53:29.741654 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 542/1133] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:29 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 1464 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:29.773863 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-ef443f2c-d8f1-44f1-90e7-6085ec0e7cbb req-9e0046ea-a9f8-4641-a8e2-83dd74e9e674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a2e514-796f-4ddf-87f3-72e6ca31659e", "name": "network-vif-deleted", "tag": "548948e7-18e0-478e-a904-4aa9a8a158eb"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:29.793558 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-ef443f2c-d8f1-44f1-90e7-6085ec0e7cbb req-9e0046ea-a9f8-4641-a8e2-83dd74e9e674 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:29.797754 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-ef443f2c-d8f1-44f1-90e7-6085ec0e7cbb req-9e0046ea-a9f8-4641-a8e2-83dd74e9e674 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:29.828170 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-ef443f2c-d8f1-44f1-90e7-6085ec0e7cbb req-9e0046ea-a9f8-4641-a8e2-83dd74e9e674 service nova] Creating event network-vif-deleted:548948e7-18e0-478e-a904-4aa9a8a158eb for instance 07a2e514-796f-4ddf-87f3-72e6ca31659e on n-h1-849104-4 Jul 12 11:53:29.845895 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-ef443f2c-d8f1-44f1-90e7-6085ec0e7cbb req-9e0046ea-a9f8-4641-a8e2-83dd74e9e674 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101518 Jul 12 11:53:29.849190 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 543/1134] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:29.858167 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-11f7c391-efa7-4dcc-8f05-c460eb56d251 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:29.859529 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-11f7c391-efa7-4dcc-8f05-c460eb56d251 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:29.868363 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11f7c391-efa7-4dcc-8f05-c460eb56d251 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:29.869100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11f7c391-efa7-4dcc-8f05-c460eb56d251 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:29.870647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11f7c391-efa7-4dcc-8f05-c460eb56d251 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:29.871576 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11f7c391-efa7-4dcc-8f05-c460eb56d251 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:29.934728 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-11f7c391-efa7-4dcc-8f05-c460eb56d251 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082000 Jul 12 11:53:29.936064 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 544/1135] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:53:29 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:30.110171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9036600c-f61f-4b18-bbce-cfc70f111836 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:30.111021 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9036600c-f61f-4b18-bbce-cfc70f111836 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:30.122954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9036600c-f61f-4b18-bbce-cfc70f111836 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:30.123795 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9036600c-f61f-4b18-bbce-cfc70f111836 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:30.125295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9036600c-f61f-4b18-bbce-cfc70f111836 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:30.126082 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9036600c-f61f-4b18-bbce-cfc70f111836 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:30.144005 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bf5f9d28-0a8e-4c16-8562-ee295b6145f4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:30.160003 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bf5f9d28-0a8e-4c16-8562-ee295b6145f4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.600047 Jul 12 11:53:30.161273 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 592/1136] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:29 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:30.169693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8b087907-9887-4114-b204-f82334e45edf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:30.171225 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8b087907-9887-4114-b204-f82334e45edf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:30.183140 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b087907-9887-4114-b204-f82334e45edf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:30.184231 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b087907-9887-4114-b204-f82334e45edf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:30.186602 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b087907-9887-4114-b204-f82334e45edf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:30.188472 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b087907-9887-4114-b204-f82334e45edf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:30.393894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-8b087907-9887-4114-b204-f82334e45edf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:30.454386 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8b087907-9887-4114-b204-f82334e45edf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.290970 Jul 12 11:53:30.455873 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 593/1137] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:30 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:30.517057 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9036600c-f61f-4b18-bbce-cfc70f111836 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:30.540161 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9036600c-f61f-4b18-bbce-cfc70f111836 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1466 microversion: 2.1 time: 0.437333 Jul 12 11:53:30.541295 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 545/1138] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:30 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1466 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:30.564526 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3f7ffd37-4514-494f-8c98-4c1cbda532fe tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:30.565832 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3f7ffd37-4514-494f-8c98-4c1cbda532fe tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:30.590957 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f7ffd37-4514-494f-8c98-4c1cbda532fe tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:30.595275 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f7ffd37-4514-494f-8c98-4c1cbda532fe tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:30.597159 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f7ffd37-4514-494f-8c98-4c1cbda532fe tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:30.604712 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f7ffd37-4514-494f-8c98-4c1cbda532fe tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:30.771437 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d2f7bb27-30b7-4c12-84df-e17e73684833 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:30.772509 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d2f7bb27-30b7-4c12-84df-e17e73684833 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:30.804100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d2f7bb27-30b7-4c12-84df-e17e73684833 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:30.804559 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d2f7bb27-30b7-4c12-84df-e17e73684833 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:30.805372 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d2f7bb27-30b7-4c12-84df-e17e73684833 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:30.805814 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d2f7bb27-30b7-4c12-84df-e17e73684833 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:30.830041 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-d2f7bb27-30b7-4c12-84df-e17e73684833 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d2f7bb27-30b7-4c12-84df-e17e73684833 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e HTTP/1.1 Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '07a2e514-796f-4ddf-87f3-72e6ca31659e'} Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:53:30.831453 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:30.835946 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:30.835946 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:53:30.835946 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:53:30.835946 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:53:30.835946 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:53:30.835946 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:53:30.835946 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:30.837844 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d2f7bb27-30b7-4c12-84df-e17e73684833 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:53:30.839422 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d2f7bb27-30b7-4c12-84df-e17e73684833 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 404 len: 111 microversion: 2.1 time: 0.076757 Jul 12 11:53:30.840683 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 546/1139] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:30 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:53:30.952966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ed9c38f2-f012-4790-a087-0167d24b163e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:30.954201 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ed9c38f2-f012-4790-a087-0167d24b163e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:30.964492 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ed9c38f2-f012-4790-a087-0167d24b163e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:30.965293 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ed9c38f2-f012-4790-a087-0167d24b163e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:30.966722 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ed9c38f2-f012-4790-a087-0167d24b163e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:30.967652 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ed9c38f2-f012-4790-a087-0167d24b163e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:31.032305 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3f7ffd37-4514-494f-8c98-4c1cbda532fe tempest-ServersOnMultiNodesTest-2002874473 tempest-ServersOnMultiNodesTest-2002874473-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1617 microversion: 2.1 time: 0.478035 Jul 12 11:53:31.033217 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 594/1140] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:30 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1617 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:31.037302 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ed9c38f2-f012-4790-a087-0167d24b163e tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090643 Jul 12 11:53:31.044582 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 547/1141] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:53:30 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:53:31.065780 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b920a03d-658f-4e5d-bdc5-b1e5b2db4d66 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:31.066397 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b920a03d-658f-4e5d-bdc5-b1e5b2db4d66 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:31.076773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b920a03d-658f-4e5d-bdc5-b1e5b2db4d66 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:31.077506 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b920a03d-658f-4e5d-bdc5-b1e5b2db4d66 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:31.078518 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b920a03d-658f-4e5d-bdc5-b1e5b2db4d66 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:31.079046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b920a03d-658f-4e5d-bdc5-b1e5b2db4d66 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:31.119048 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-715158689", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "24a2b846-48a0-496a-b982-522753a2dd1f"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:31.169953 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b920a03d-658f-4e5d-bdc5-b1e5b2db4d66 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:53:31.264581 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] validate_networks() for [('24a2b846-48a0-496a-b982-522753a2dd1f', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:53:31.392405 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b920a03d-658f-4e5d-bdc5-b1e5b2db4d66 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "DELETE /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 204 len: 0 microversion: 2.1 time: 0.325411 Jul 12 11:53:31.402072 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 595/1142] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:53:31 2022] DELETE /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:53:31.422365 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-75f28630-4ba1-4f46-a997-3f2649fcf958 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:31.424336 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-75f28630-4ba1-4f46-a997-3f2649fcf958 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:31.457102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-75f28630-4ba1-4f46-a997-3f2649fcf958 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:31.461715 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-75f28630-4ba1-4f46-a997-3f2649fcf958 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:31.466155 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-75f28630-4ba1-4f46-a997-3f2649fcf958 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:31.467658 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-75f28630-4ba1-4f46-a997-3f2649fcf958 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:32.020383 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-75f28630-4ba1-4f46-a997-3f2649fcf958 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:32.028825 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:53:32.029638 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:53:32.029825 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:53:32.030224 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:53:32.030647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:53:32.035550 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-75f28630-4ba1-4f46-a997-3f2649fcf958 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.629563 Jul 12 11:53:32.048967 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:32.051382 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 596/1143] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:31 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:32.058091 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5fc16381-2740-44cc-81b1-85a366060a2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:32.058887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5fc16381-2740-44cc-81b1-85a366060a2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:32.059151 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:32.060805 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:32.061827 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:32.075732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5fc16381-2740-44cc-81b1-85a366060a2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:32.077892 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5fc16381-2740-44cc-81b1-85a366060a2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:32.080447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5fc16381-2740-44cc-81b1-85a366060a2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:32.081930 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5fc16381-2740-44cc-81b1-85a366060a2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:32.116156 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Getting quotas for project 6acea80b1e154ffcb3e657056d6e8dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:53:32.141600 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Getting quotas for user 4c93078ac6044bf6b62ca073b3850016 and project 6acea80b1e154ffcb3e657056d6e8dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:53:32.214822 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:53:32.225379 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:53:32.313586 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e2d5b889-51a8-4c71-a564-281b40ecfe90 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.203799 Jul 12 11:53:32.315226 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 548/1144] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:53:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:53:32.328567 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2bbf36a4-8f90-49a1-b0a2-0bb4f446c0cf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:32.329194 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2bbf36a4-8f90-49a1-b0a2-0bb4f446c0cf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:32.338636 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2bbf36a4-8f90-49a1-b0a2-0bb4f446c0cf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:32.339093 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2bbf36a4-8f90-49a1-b0a2-0bb4f446c0cf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:32.340979 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2bbf36a4-8f90-49a1-b0a2-0bb4f446c0cf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:32.341705 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2bbf36a4-8f90-49a1-b0a2-0bb4f446c0cf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:32.539220 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5fc16381-2740-44cc-81b1-85a366060a2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:32.549707 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5fc16381-2740-44cc-81b1-85a366060a2a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1472 microversion: 2.1 time: 0.494923 Jul 12 11:53:32.552804 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 597/1145] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:32 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1472 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:32.573043 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4aae6f8f-31ca-4637-a139-98e7ebaf7ab6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:32.574097 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4aae6f8f-31ca-4637-a139-98e7ebaf7ab6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:32.584741 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4aae6f8f-31ca-4637-a139-98e7ebaf7ab6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:32.585739 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4aae6f8f-31ca-4637-a139-98e7ebaf7ab6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:32.587446 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4aae6f8f-31ca-4637-a139-98e7ebaf7ab6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:32.588209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4aae6f8f-31ca-4637-a139-98e7ebaf7ab6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:32.599293 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-2bbf36a4-8f90-49a1-b0a2-0bb4f446c0cf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:32.641383 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2bbf36a4-8f90-49a1-b0a2-0bb4f446c0cf tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.325028 Jul 12 11:53:32.642990 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 549/1146] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:32 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:32.644900 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4aae6f8f-31ca-4637-a139-98e7ebaf7ab6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090196 Jul 12 11:53:32.646006 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 598/1147] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:53:32 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:53:32.664668 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4e83b408-2540-4bca-a610-4d80f36179ba tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:32.665760 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4e83b408-2540-4bca-a610-4d80f36179ba tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:32.896875 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4e83b408-2540-4bca-a610-4d80f36179ba tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:32.913903 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4e83b408-2540-4bca-a610-4d80f36179ba tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1214 microversion: 2.1 time: 0.270502 Jul 12 11:53:32.914851 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 550/1148] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:32 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1214 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:33.058137 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9b5ed43e-ca29-4c68-a477-3dd9a6687fe5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:33.060390 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9b5ed43e-ca29-4c68-a477-3dd9a6687fe5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:33.089684 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9b5ed43e-ca29-4c68-a477-3dd9a6687fe5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:33.090508 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9b5ed43e-ca29-4c68-a477-3dd9a6687fe5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:33.091919 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9b5ed43e-ca29-4c68-a477-3dd9a6687fe5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:33.105223 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9b5ed43e-ca29-4c68-a477-3dd9a6687fe5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:33.185803 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1602558656", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "86a45c3d-d234-45c3-8ca4-afa66535a366"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:33.367899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] validate_networks() for [('86a45c3d-d234-45c3-8ca4-afa66535a366', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:53:33.838246 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9b5ed43e-ca29-4c68-a477-3dd9a6687fe5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:33.862280 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:33.876547 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9b5ed43e-ca29-4c68-a477-3dd9a6687fe5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.822354 Jul 12 11:53:33.877223 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 599/1149] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:33 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:33.896241 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-80d0ad8b-7081-4800-b2b5-6ace78945cc6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:33.897348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-80d0ad8b-7081-4800-b2b5-6ace78945cc6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:33.923257 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-80d0ad8b-7081-4800-b2b5-6ace78945cc6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:33.926369 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-80d0ad8b-7081-4800-b2b5-6ace78945cc6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:33.928798 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-80d0ad8b-7081-4800-b2b5-6ace78945cc6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:33.929299 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-80d0ad8b-7081-4800-b2b5-6ace78945cc6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:34.406375 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-80d0ad8b-7081-4800-b2b5-6ace78945cc6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:34.428655 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-80d0ad8b-7081-4800-b2b5-6ace78945cc6 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1472 microversion: 2.1 time: 0.546378 Jul 12 11:53:34.429237 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 600/1150] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:33 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1472 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:34.435050 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a4bdb895-7a00-428b-a4c6-f75f67c2a710 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:34.449368 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a4bdb895-7a00-428b-a4c6-f75f67c2a710 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:34.461755 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a4bdb895-7a00-428b-a4c6-f75f67c2a710 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:34.463046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a4bdb895-7a00-428b-a4c6-f75f67c2a710 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:34.465036 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a4bdb895-7a00-428b-a4c6-f75f67c2a710 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:34.465772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a4bdb895-7a00-428b-a4c6-f75f67c2a710 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:34.679140 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-a4bdb895-7a00-428b-a4c6-f75f67c2a710 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:34.758031 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a4bdb895-7a00-428b-a4c6-f75f67c2a710 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.327296 Jul 12 11:53:34.759167 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 601/1151] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:34 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:34.767128 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3670f29a-1c36-42c1-8fff-206512b45f75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:34.768229 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3670f29a-1c36-42c1-8fff-206512b45f75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:34.787538 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3670f29a-1c36-42c1-8fff-206512b45f75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:34.789451 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3670f29a-1c36-42c1-8fff-206512b45f75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:34.791063 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3670f29a-1c36-42c1-8fff-206512b45f75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:34.792005 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3670f29a-1c36-42c1-8fff-206512b45f75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:34.939618 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3670f29a-1c36-42c1-8fff-206512b45f75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:34.981632 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3670f29a-1c36-42c1-8fff-206512b45f75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1272 microversion: 2.1 time: 0.220715 Jul 12 11:53:34.985399 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 602/1152] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:34 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:35.001557 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6ca3bd5e-8722-471b-b3c4-6639cf730fa0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:35.002385 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6ca3bd5e-8722-471b-b3c4-6639cf730fa0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:35.014303 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ca3bd5e-8722-471b-b3c4-6639cf730fa0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:35.015397 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ca3bd5e-8722-471b-b3c4-6639cf730fa0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:35.016623 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ca3bd5e-8722-471b-b3c4-6639cf730fa0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:35.017188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ca3bd5e-8722-471b-b3c4-6639cf730fa0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:35.068267 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:53:35.068918 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:53:35.069642 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:53:35.070231 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:53:35.070603 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:53:35.104103 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:35.109078 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:35.116541 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:35.117332 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:35.192304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Getting quotas for project bd080a7dad6c4a6ebf684e44bf7a6e76. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:53:35.221202 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Getting quotas for user 5a7ca463d55047caa749c514a3e1499d and project bd080a7dad6c4a6ebf684e44bf7a6e76. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:53:35.269910 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:53:35.272512 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:53:35.348110 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-81c1a793-01da-4955-9fa2-c5f920b5b452 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.169544 Jul 12 11:53:35.358519 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 551/1153] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:53:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:53:35.379854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-365adc65-df12-4b61-9be5-2dd3fee0d453 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:35.383276 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-365adc65-df12-4b61-9be5-2dd3fee0d453 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:35.574922 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-365adc65-df12-4b61-9be5-2dd3fee0d453 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:35.616706 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-365adc65-df12-4b61-9be5-2dd3fee0d453 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1218 microversion: 2.1 time: 0.253658 Jul 12 11:53:35.625631 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 552/1154] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:35 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1218 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:35.663515 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c1f2d3be-72c7-4588-a13f-06b618566978 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:35.663867 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c1f2d3be-72c7-4588-a13f-06b618566978 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:35.702325 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c1f2d3be-72c7-4588-a13f-06b618566978 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:35.703039 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c1f2d3be-72c7-4588-a13f-06b618566978 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:35.704484 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c1f2d3be-72c7-4588-a13f-06b618566978 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:35.705269 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c1f2d3be-72c7-4588-a13f-06b618566978 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:35.863039 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c1f2d3be-72c7-4588-a13f-06b618566978 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:35.864117 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c1f2d3be-72c7-4588-a13f-06b618566978 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:35.865191 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-c1f2d3be-72c7-4588-a13f-06b618566978 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lazy-loading 'fault' on Instance uuid 43639aef-3a2d-45f9-a65a-b6db8b47f97a {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:36.153455 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c1f2d3be-72c7-4588-a13f-06b618566978 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:36.186204 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c1f2d3be-72c7-4588-a13f-06b618566978 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 200 len: 1306 microversion: 2.1 time: 0.544437 Jul 12 11:53:36.198208 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 553/1155] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:35 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 1306 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:36.227242 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-20da3cb1-4435-40a7-9ebd-3b071651b72f req-6a152bd5-bec4-4f39-81c0-5793b63d8e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43639aef-3a2d-45f9-a65a-b6db8b47f97a", "name": "network-vif-deleted", "tag": "df7058ed-4830-453a-9b06-4684afbbab82"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:36.278727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-20da3cb1-4435-40a7-9ebd-3b071651b72f req-6a152bd5-bec4-4f39-81c0-5793b63d8e5f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:36.280530 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-20da3cb1-4435-40a7-9ebd-3b071651b72f req-6a152bd5-bec4-4f39-81c0-5793b63d8e5f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:36.321809 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6ca3bd5e-8722-471b-b3c4-6639cf730fa0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:36.358377 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-20da3cb1-4435-40a7-9ebd-3b071651b72f req-6a152bd5-bec4-4f39-81c0-5793b63d8e5f service nova] Creating event network-vif-deleted:df7058ed-4830-453a-9b06-4684afbbab82 for instance 43639aef-3a2d-45f9-a65a-b6db8b47f97a on n-h1-849104-4 Jul 12 11:53:36.358787 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6ca3bd5e-8722-471b-b3c4-6639cf730fa0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 1.364691 Jul 12 11:53:36.364684 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 603/1156] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:34 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:36.372383 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a6e28c0b-4129-4f1e-8111-f9bc0786f8bb tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:36.381561 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a6e28c0b-4129-4f1e-8111-f9bc0786f8bb tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:36.402422 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-20da3cb1-4435-40a7-9ebd-3b071651b72f req-6a152bd5-bec4-4f39-81c0-5793b63d8e5f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200978 Jul 12 11:53:36.403862 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 554/1157] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:36.421958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3b08bf6a-6dd9-427e-bb58-2d12c5a9fc21 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:36.429689 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a6e28c0b-4129-4f1e-8111-f9bc0786f8bb tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:36.431899 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a6e28c0b-4129-4f1e-8111-f9bc0786f8bb tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:36.433789 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3b08bf6a-6dd9-427e-bb58-2d12c5a9fc21 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:36.436323 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a6e28c0b-4129-4f1e-8111-f9bc0786f8bb tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:36.438037 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a6e28c0b-4129-4f1e-8111-f9bc0786f8bb tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:36.456294 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b08bf6a-6dd9-427e-bb58-2d12c5a9fc21 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:36.457075 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b08bf6a-6dd9-427e-bb58-2d12c5a9fc21 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:36.463795 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b08bf6a-6dd9-427e-bb58-2d12c5a9fc21 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:36.470386 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b08bf6a-6dd9-427e-bb58-2d12c5a9fc21 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:36.653994 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-a6e28c0b-4129-4f1e-8111-f9bc0786f8bb tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:36.704938 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a6e28c0b-4129-4f1e-8111-f9bc0786f8bb tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.338026 Jul 12 11:53:36.706512 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 604/1158] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:36 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:36.715107 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dbaa66d1-680f-4534-9598-ca4a57370ab8 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:36.717134 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dbaa66d1-680f-4534-9598-ca4a57370ab8 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:36.738192 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbaa66d1-680f-4534-9598-ca4a57370ab8 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:36.739337 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbaa66d1-680f-4534-9598-ca4a57370ab8 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:36.740926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbaa66d1-680f-4534-9598-ca4a57370ab8 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:36.741864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbaa66d1-680f-4534-9598-ca4a57370ab8 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:36.969079 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dbaa66d1-680f-4534-9598-ca4a57370ab8 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:36.985937 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dbaa66d1-680f-4534-9598-ca4a57370ab8 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1222 microversion: 2.1 time: 0.278010 Jul 12 11:53:36.986686 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 605/1159] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:36 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1222 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:37.076908 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3b08bf6a-6dd9-427e-bb58-2d12c5a9fc21 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:37.106294 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3b08bf6a-6dd9-427e-bb58-2d12c5a9fc21 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1314 microversion: 2.1 time: 0.694322 Jul 12 11:53:37.109068 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 555/1160] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:36 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:37.234262 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-be2fba3f-a3c5-43f6-8c8b-d657713d961d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:37.235275 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-be2fba3f-a3c5-43f6-8c8b-d657713d961d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 43639aef-3a2d-45f9-a65a-b6db8b47f97a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:37.254867 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-be2fba3f-a3c5-43f6-8c8b-d657713d961d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:37.256331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-be2fba3f-a3c5-43f6-8c8b-d657713d961d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:37.258111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-be2fba3f-a3c5-43f6-8c8b-d657713d961d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:37.260232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-be2fba3f-a3c5-43f6-8c8b-d657713d961d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:37.346155 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-be2fba3f-a3c5-43f6-8c8b-d657713d961d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] HTTP exception thrown: Instance 43639aef-3a2d-45f9-a65a-b6db8b47f97a could not be found. Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-be2fba3f-a3c5-43f6-8c8b-d657713d961d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Request method failure captured: Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a HTTP/1.1 Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWAIsAjWusJZqZTqO-T5k7sF3XVQ_BVMWkgLAmSdn_h1MRycYbdcU7cykB4uGTStunIOo5ApPn465SO0jjUMYRsZwApvmb-AO14yFiVrUNdkrYxS017oV-XNhYB9rF-oG05Xyetaq0ERBw2wHAO_zCDvGtPTgwRLhQcDsw5foMYdahY Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/810246cfc801446599831d243d3a48dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_810246cfc801446599831d243d3a48dd", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 3e7eb4c715f04ea791384bcde9844fa7 Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 43639aef-3a2d-45f9-a65a-b6db8b47f97a could not be found. Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '43639aef-3a2d-45f9-a65a-b6db8b47f97a'} Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43639aef-3a2d-45f9-a65a-b6db8b47f97a could not be found. Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43639aef-3a2d-45f9-a65a-b6db8b47f97a could not be found. Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:53:37.356965 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:53:37.367378 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:37.367378 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:53:37.367378 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:53:37.367378 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:53:37.367378 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:53:37.367378 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43639aef-3a2d-45f9-a65a-b6db8b47f97a could not be found. Jul 12 11:53:37.367378 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:53:37.374002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-be2fba3f-a3c5-43f6-8c8b-d657713d961d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Returning 404 to user: Instance 43639aef-3a2d-45f9-a65a-b6db8b47f97a could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:53:37.375803 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-be2fba3f-a3c5-43f6-8c8b-d657713d961d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a" status: 404 len: 111 microversion: 2.1 time: 0.152580 Jul 12 11:53:37.377420 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 606/1161] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:37 2022] GET /compute/v2.1/servers/43639aef-3a2d-45f9-a65a-b6db8b47f97a => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 11:53:37.389284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-75294465-ef7d-4c30-99fa-2258bd50faff tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:37.399046 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-75294465-ef7d-4c30-99fa-2258bd50faff tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:37.420681 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e2954aab-4728-4244-a25e-4bff1640e04d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:37.425510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e2954aab-4728-4244-a25e-4bff1640e04d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:37.439480 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-75294465-ef7d-4c30-99fa-2258bd50faff tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:37.445087 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-75294465-ef7d-4c30-99fa-2258bd50faff tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:37.446435 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-75294465-ef7d-4c30-99fa-2258bd50faff tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:37.447841 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-75294465-ef7d-4c30-99fa-2258bd50faff tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:37.450113 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e2954aab-4728-4244-a25e-4bff1640e04d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:37.450582 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e2954aab-4728-4244-a25e-4bff1640e04d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:37.456522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e2954aab-4728-4244-a25e-4bff1640e04d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:37.457468 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e2954aab-4728-4244-a25e-4bff1640e04d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:37.520773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e2954aab-4728-4244-a25e-4bff1640e04d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:53:37.750086 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e2954aab-4728-4244-a25e-4bff1640e04d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 204 len: 0 microversion: 2.1 time: 0.353173 Jul 12 11:53:37.751701 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 607/1162] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:53:37 2022] DELETE /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:53:37.787210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ecbe2ae5-76f9-4c38-8e70-b51c2f1d4da3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:37.789766 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ecbe2ae5-76f9-4c38-8e70-b51c2f1d4da3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:37.812175 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ecbe2ae5-76f9-4c38-8e70-b51c2f1d4da3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:37.812974 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ecbe2ae5-76f9-4c38-8e70-b51c2f1d4da3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:37.814685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ecbe2ae5-76f9-4c38-8e70-b51c2f1d4da3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:37.815490 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ecbe2ae5-76f9-4c38-8e70-b51c2f1d4da3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:37.837085 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-75294465-ef7d-4c30-99fa-2258bd50faff tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:37.865546 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-75294465-ef7d-4c30-99fa-2258bd50faff tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.484212 Jul 12 11:53:37.867313 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 556/1163] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:37 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:37.885182 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-83e1f664-dc47-49f8-9ba4-e01df48c239c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:37.886842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-83e1f664-dc47-49f8-9ba4-e01df48c239c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:37.898408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-83e1f664-dc47-49f8-9ba4-e01df48c239c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:37.899781 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-83e1f664-dc47-49f8-9ba4-e01df48c239c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:37.901611 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-83e1f664-dc47-49f8-9ba4-e01df48c239c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:37.902741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-83e1f664-dc47-49f8-9ba4-e01df48c239c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:37.911883 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:38.070988 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-ecbe2ae5-76f9-4c38-8e70-b51c2f1d4da3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:38.124775 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ecbe2ae5-76f9-4c38-8e70-b51c2f1d4da3 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.365247 Jul 12 11:53:38.126727 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 608/1164] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:37 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:38.149214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-322e58b6-f5c6-452b-b91b-32999747941b tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:38.151182 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-322e58b6-f5c6-452b-b91b-32999747941b tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:38.175575 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-322e58b6-f5c6-452b-b91b-32999747941b tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:38.176440 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-322e58b6-f5c6-452b-b91b-32999747941b tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:38.177888 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-322e58b6-f5c6-452b-b91b-32999747941b tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:38.178584 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-322e58b6-f5c6-452b-b91b-32999747941b tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:38.371707 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-83e1f664-dc47-49f8-9ba4-e01df48c239c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:38.398953 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-83e1f664-dc47-49f8-9ba4-e01df48c239c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1470 microversion: 2.1 time: 0.529070 Jul 12 11:53:38.400638 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 557/1165] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:37 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1470 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:38.417410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fc9a26cc-41b0-4f32-a11f-dbed0a3d5eed tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:38.418040 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fc9a26cc-41b0-4f32-a11f-dbed0a3d5eed tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:38.434287 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-322e58b6-f5c6-452b-b91b-32999747941b tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:38.446917 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fc9a26cc-41b0-4f32-a11f-dbed0a3d5eed tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:38.448095 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fc9a26cc-41b0-4f32-a11f-dbed0a3d5eed tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:38.449324 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fc9a26cc-41b0-4f32-a11f-dbed0a3d5eed tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:38.450338 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fc9a26cc-41b0-4f32-a11f-dbed0a3d5eed tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:38.461249 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-322e58b6-f5c6-452b-b91b-32999747941b tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1278 microversion: 2.1 time: 0.321542 Jul 12 11:53:38.461941 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 609/1166] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:38 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1278 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:38.735052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-c8562b36-d3be-4a8a-8db5-c9670cd582c9 req-9b2b5988-6191-43de-833a-6532863e90b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be284e8-364a-45aa-97d4-944bfb60fc64", "tag": "8ffbdeea-3f69-4b50-9b87-39003070cf5a"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:38.767370 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-c8562b36-d3be-4a8a-8db5-c9670cd582c9 req-9b2b5988-6191-43de-833a-6532863e90b0 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:38.775218 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-c8562b36-d3be-4a8a-8db5-c9670cd582c9 req-9b2b5988-6191-43de-833a-6532863e90b0 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:38.812259 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-c8562b36-d3be-4a8a-8db5-c9670cd582c9 req-9b2b5988-6191-43de-833a-6532863e90b0 service nova] Creating event network-changed:8ffbdeea-3f69-4b50-9b87-39003070cf5a for instance 6be284e8-364a-45aa-97d4-944bfb60fc64 on n-h1-849104-4 Jul 12 11:53:38.830021 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-c8562b36-d3be-4a8a-8db5-c9670cd582c9 req-9b2b5988-6191-43de-833a-6532863e90b0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103654 Jul 12 11:53:38.830905 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 610/1167] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:38.891975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d4553aa4-045c-4b00-98c8-2226814a918f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:38.898432 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d4553aa4-045c-4b00-98c8-2226814a918f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:38.917497 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d4553aa4-045c-4b00-98c8-2226814a918f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:38.918376 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d4553aa4-045c-4b00-98c8-2226814a918f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:38.919795 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d4553aa4-045c-4b00-98c8-2226814a918f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:38.920660 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d4553aa4-045c-4b00-98c8-2226814a918f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:38.929716 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fc9a26cc-41b0-4f32-a11f-dbed0a3d5eed tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:38.980423 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fc9a26cc-41b0-4f32-a11f-dbed0a3d5eed tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1314 microversion: 2.1 time: 0.577912 Jul 12 11:53:38.989042 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 558/1168] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:38 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:39.169176 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-96125493-1d3d-47b7-932c-870ad68214b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:39.176124 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-96125493-1d3d-47b7-932c-870ad68214b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:39.206461 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-96125493-1d3d-47b7-932c-870ad68214b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:39.211702 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-96125493-1d3d-47b7-932c-870ad68214b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:39.215198 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-96125493-1d3d-47b7-932c-870ad68214b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:39.216239 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-96125493-1d3d-47b7-932c-870ad68214b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:39.397748 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-96125493-1d3d-47b7-932c-870ad68214b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:39.433494 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-96125493-1d3d-47b7-932c-870ad68214b6 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.280694 Jul 12 11:53:39.450675 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 559/1169] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:39 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:39.457596 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d5230b71-5b23-41ce-b765-ec0adcc94610 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:39.458741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d5230b71-5b23-41ce-b765-ec0adcc94610 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:39.468097 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d4553aa4-045c-4b00-98c8-2226814a918f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:39.479695 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d4553aa4-045c-4b00-98c8-2226814a918f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.595261 Jul 12 11:53:39.487132 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d5230b71-5b23-41ce-b765-ec0adcc94610 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:39.487836 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d5230b71-5b23-41ce-b765-ec0adcc94610 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:39.488876 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 611/1170] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:38 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:39.496055 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d5230b71-5b23-41ce-b765-ec0adcc94610 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:39.496560 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d5230b71-5b23-41ce-b765-ec0adcc94610 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:39.503520 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e5f41d15-c2d3-41c2-bb9d-37060732ef04 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:39.504167 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e5f41d15-c2d3-41c2-bb9d-37060732ef04 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:39.509727 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:39.516170 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e5f41d15-c2d3-41c2-bb9d-37060732ef04 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:39.516643 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e5f41d15-c2d3-41c2-bb9d-37060732ef04 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:39.518196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e5f41d15-c2d3-41c2-bb9d-37060732ef04 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:39.518869 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e5f41d15-c2d3-41c2-bb9d-37060732ef04 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:39.696540 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e5f41d15-c2d3-41c2-bb9d-37060732ef04 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:39.721682 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e5f41d15-c2d3-41c2-bb9d-37060732ef04 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1278 microversion: 2.1 time: 0.225340 Jul 12 11:53:39.723015 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 612/1171] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:39 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1278 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:40.014679 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8a912cf6-b0e2-4d46-be23-a8d105ce70fd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:40.018436 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8a912cf6-b0e2-4d46-be23-a8d105ce70fd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:40.034576 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a912cf6-b0e2-4d46-be23-a8d105ce70fd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:40.035637 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a912cf6-b0e2-4d46-be23-a8d105ce70fd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:40.036707 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a912cf6-b0e2-4d46-be23-a8d105ce70fd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:40.038165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a912cf6-b0e2-4d46-be23-a8d105ce70fd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:40.051523 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d5230b71-5b23-41ce-b765-ec0adcc94610 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:40.070505 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d5230b71-5b23-41ce-b765-ec0adcc94610 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1470 microversion: 2.1 time: 0.616676 Jul 12 11:53:40.080285 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 560/1172] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:39 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1470 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:40.460988 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e682d603-7bc2-4bad-8b67-667e9a5130b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:40.464276 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e682d603-7bc2-4bad-8b67-667e9a5130b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:40.481885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e682d603-7bc2-4bad-8b67-667e9a5130b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:40.482843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e682d603-7bc2-4bad-8b67-667e9a5130b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:40.484721 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e682d603-7bc2-4bad-8b67-667e9a5130b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:40.485994 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e682d603-7bc2-4bad-8b67-667e9a5130b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:40.522578 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8a912cf6-b0e2-4d46-be23-a8d105ce70fd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:40.542921 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8a912cf6-b0e2-4d46-be23-a8d105ce70fd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1314 microversion: 2.1 time: 0.535276 Jul 12 11:53:40.558219 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 613/1173] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:40 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:40.567269 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-31f0f3ce-78ea-4759-ac05-cfcd38dad190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:40.568755 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-31f0f3ce-78ea-4759-ac05-cfcd38dad190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:40.583015 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31f0f3ce-78ea-4759-ac05-cfcd38dad190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:40.583884 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31f0f3ce-78ea-4759-ac05-cfcd38dad190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:40.585745 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31f0f3ce-78ea-4759-ac05-cfcd38dad190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:40.586417 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31f0f3ce-78ea-4759-ac05-cfcd38dad190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:40.697950 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-e682d603-7bc2-4bad-8b67-667e9a5130b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:40.721256 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e682d603-7bc2-4bad-8b67-667e9a5130b5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.264571 Jul 12 11:53:40.722380 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 561/1174] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:40 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:53:40.742330 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f245bfdc-9b57-4e43-a06b-61d88084a624 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:40.744346 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f245bfdc-9b57-4e43-a06b-61d88084a624 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:40.752914 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f245bfdc-9b57-4e43-a06b-61d88084a624 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:40.753966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f245bfdc-9b57-4e43-a06b-61d88084a624 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:40.754988 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f245bfdc-9b57-4e43-a06b-61d88084a624 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:40.755626 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f245bfdc-9b57-4e43-a06b-61d88084a624 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:40.852503 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f245bfdc-9b57-4e43-a06b-61d88084a624 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:40.864526 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f245bfdc-9b57-4e43-a06b-61d88084a624 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1276 microversion: 2.1 time: 0.126910 Jul 12 11:53:40.865790 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 562/1175] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:40 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:41.023271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-85104178", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "3d2582a1-b124-4a19-a38c-8f0feee5f3a6"}, {"uuid": "d032066f-731b-4c34-9285-99f1b5c9d7b4"}, {"uuid": "3d2582a1-b124-4a19-a38c-8f0feee5f3a6"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:41.152126 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-31f0f3ce-78ea-4759-ac05-cfcd38dad190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:41.158161 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] validate_networks() for [('3d2582a1-b124-4a19-a38c-8f0feee5f3a6', None, None, None, None, None), ('d032066f-731b-4c34-9285-99f1b5c9d7b4', None, None, None, None, None), ('3d2582a1-b124-4a19-a38c-8f0feee5f3a6', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:53:41.171668 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-31f0f3ce-78ea-4759-ac05-cfcd38dad190 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.610867 Jul 12 11:53:41.174305 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 614/1176] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:40 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:41.204719 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4997236a-bd0e-4a93-9da5-a2ac96e7f827 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:41.206452 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4997236a-bd0e-4a93-9da5-a2ac96e7f827 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:41.219488 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4997236a-bd0e-4a93-9da5-a2ac96e7f827 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:41.223192 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4997236a-bd0e-4a93-9da5-a2ac96e7f827 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:41.224939 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4997236a-bd0e-4a93-9da5-a2ac96e7f827 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:41.228903 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4997236a-bd0e-4a93-9da5-a2ac96e7f827 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:41.265182 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:41.843431 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4997236a-bd0e-4a93-9da5-a2ac96e7f827 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:41.857854 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4997236a-bd0e-4a93-9da5-a2ac96e7f827 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1470 microversion: 2.1 time: 0.681261 Jul 12 11:53:41.867829 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 615/1177] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:41 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1470 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:41.886886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9c75dd85-60b4-45cd-89c7-9d9909b1d229 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:41.887905 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9c75dd85-60b4-45cd-89c7-9d9909b1d229 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:41.901547 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c75dd85-60b4-45cd-89c7-9d9909b1d229 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:41.902275 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c75dd85-60b4-45cd-89c7-9d9909b1d229 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:41.903383 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c75dd85-60b4-45cd-89c7-9d9909b1d229 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:41.904007 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c75dd85-60b4-45cd-89c7-9d9909b1d229 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:42.510066 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9c75dd85-60b4-45cd-89c7-9d9909b1d229 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:42.533481 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9c75dd85-60b4-45cd-89c7-9d9909b1d229 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1314 microversion: 2.1 time: 0.663776 Jul 12 11:53:42.537874 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 616/1178] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:41 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:42.561916 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ce1a0b8d-07e5-4756-bddb-7fb2cc69925b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:42.565458 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ce1a0b8d-07e5-4756-bddb-7fb2cc69925b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:42.595622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ce1a0b8d-07e5-4756-bddb-7fb2cc69925b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:42.597341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ce1a0b8d-07e5-4756-bddb-7fb2cc69925b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:42.601407 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ce1a0b8d-07e5-4756-bddb-7fb2cc69925b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:42.605125 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ce1a0b8d-07e5-4756-bddb-7fb2cc69925b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:42.778161 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-ce1a0b8d-07e5-4756-bddb-7fb2cc69925b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:42.819589 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ce1a0b8d-07e5-4756-bddb-7fb2cc69925b tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.279181 Jul 12 11:53:42.820528 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 617/1179] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:42 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:42.829738 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6d98b58e-3441-4f37-bd57-5575618fe78c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:42.831171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6d98b58e-3441-4f37-bd57-5575618fe78c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:42.850532 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d98b58e-3441-4f37-bd57-5575618fe78c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:42.851852 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d98b58e-3441-4f37-bd57-5575618fe78c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:42.852819 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d98b58e-3441-4f37-bd57-5575618fe78c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:42.855831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d98b58e-3441-4f37-bd57-5575618fe78c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:43.136505 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6d98b58e-3441-4f37-bd57-5575618fe78c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:43.158684 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6d98b58e-3441-4f37-bd57-5575618fe78c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1318 microversion: 2.1 time: 0.333327 Jul 12 11:53:43.159641 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 618/1180] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:42 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:43.187979 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-33223f16-5e8f-4e7a-9020-cbc0ec69a6b1 req-d2c0eef2-0314-4d71-99b4-89caece842f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9cea1e-630e-46e2-a46d-c59fde9d6ac8", "name": "network-vif-deleted", "tag": "547107d8-a0c0-4626-8a23-1cedd535a72c"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:43.215809 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-33223f16-5e8f-4e7a-9020-cbc0ec69a6b1 req-d2c0eef2-0314-4d71-99b4-89caece842f9 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:43.216750 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-33223f16-5e8f-4e7a-9020-cbc0ec69a6b1 req-d2c0eef2-0314-4d71-99b4-89caece842f9 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:43.244763 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-33223f16-5e8f-4e7a-9020-cbc0ec69a6b1 req-d2c0eef2-0314-4d71-99b4-89caece842f9 service nova] Creating event network-vif-deleted:547107d8-a0c0-4626-8a23-1cedd535a72c for instance 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 on n-h2-849104-4 Jul 12 11:53:43.255057 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-33223f16-5e8f-4e7a-9020-cbc0ec69a6b1 req-d2c0eef2-0314-4d71-99b4-89caece842f9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093384 Jul 12 11:53:43.256584 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 619/1181] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:43.265090 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7dbdc10d-aa57-46c5-a6d6-0d91f3afeb8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:43.267442 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7dbdc10d-aa57-46c5-a6d6-0d91f3afeb8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:43.323689 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7dbdc10d-aa57-46c5-a6d6-0d91f3afeb8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:43.331166 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7dbdc10d-aa57-46c5-a6d6-0d91f3afeb8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:43.337118 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7dbdc10d-aa57-46c5-a6d6-0d91f3afeb8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:43.341685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7dbdc10d-aa57-46c5-a6d6-0d91f3afeb8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:43.523663 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:53:43.524421 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:53:43.524686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:53:43.525606 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:53:43.526271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:53:43.548662 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:43.549218 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:43.553049 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:43.555832 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:43.594428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:43.606347 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Getting quotas for project 8526c888ef874e22b5d9496db4568cfa. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:53:43.621270 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Getting quotas for user f91215d432f74692b5b8129dab66bc51 and project 8526c888ef874e22b5d9496db4568cfa. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:53:43.657614 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:53:43.661705 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:53:43.762920 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-60a1793f-aa66-416f-951e-bd61fdf17d51 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.752014 Jul 12 11:53:43.765481 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 563/1182] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:53:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 11:53:43.779221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7dbdc10d-aa57-46c5-a6d6-0d91f3afeb8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:43.782140 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-57732661-c339-48a4-b423-b8ea5871d32c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:43.783579 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-57732661-c339-48a4-b423-b8ea5871d32c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:43.788520 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7dbdc10d-aa57-46c5-a6d6-0d91f3afeb8c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1542 microversion: 2.1 time: 0.530325 Jul 12 11:53:43.789103 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 620/1183] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:43 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1542 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:43.804656 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0dbcbee7-5766-4a76-8c67-d28b2682f898 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:43.805438 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0dbcbee7-5766-4a76-8c67-d28b2682f898 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:43.806866 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-57732661-c339-48a4-b423-b8ea5871d32c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:43.808720 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-57732661-c339-48a4-b423-b8ea5871d32c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:43.809740 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-57732661-c339-48a4-b423-b8ea5871d32c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:43.816111 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-57732661-c339-48a4-b423-b8ea5871d32c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:43.828301 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0dbcbee7-5766-4a76-8c67-d28b2682f898 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:43.828786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0dbcbee7-5766-4a76-8c67-d28b2682f898 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:43.830285 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0dbcbee7-5766-4a76-8c67-d28b2682f898 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:43.830285 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0dbcbee7-5766-4a76-8c67-d28b2682f898 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:43.890140 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-57732661-c339-48a4-b423-b8ea5871d32c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:43.890591 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-57732661-c339-48a4-b423-b8ea5871d32c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:43.891064 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-57732661-c339-48a4-b423-b8ea5871d32c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lazy-loading 'fault' on Instance uuid 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:44.053623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-57732661-c339-48a4-b423-b8ea5871d32c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:44.070069 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-57732661-c339-48a4-b423-b8ea5871d32c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 200 len: 1306 microversion: 2.1 time: 0.302089 Jul 12 11:53:44.071433 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 564/1184] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:43 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 1306 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:44.115302 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-70e54b2f-c2fe-45fb-b194-bbb1714ca0bd tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:44.115958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-70e54b2f-c2fe-45fb-b194-bbb1714ca0bd tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:44.290660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-70e54b2f-c2fe-45fb-b194-bbb1714ca0bd tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:44.324426 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-70e54b2f-c2fe-45fb-b194-bbb1714ca0bd tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1211 microversion: 2.1 time: 0.237707 Jul 12 11:53:44.346425 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 565/1185] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:44 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1211 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:44.367368 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e1bb7031-f84d-411e-bba6-1bf34fa51fe1 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:44.373998 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e1bb7031-f84d-411e-bba6-1bf34fa51fe1 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:44.396418 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1bb7031-f84d-411e-bba6-1bf34fa51fe1 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:44.398152 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1bb7031-f84d-411e-bba6-1bf34fa51fe1 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:44.399215 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1bb7031-f84d-411e-bba6-1bf34fa51fe1 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:44.402261 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1bb7031-f84d-411e-bba6-1bf34fa51fe1 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:44.458010 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0dbcbee7-5766-4a76-8c67-d28b2682f898 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:44.472531 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0dbcbee7-5766-4a76-8c67-d28b2682f898 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1314 microversion: 2.1 time: 0.678744 Jul 12 11:53:44.474964 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 621/1186] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:43 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:44.481947 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-672ccde4-902f-4f28-8947-97555525fc26 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:44.482987 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-672ccde4-902f-4f28-8947-97555525fc26 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:44.516830 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-672ccde4-902f-4f28-8947-97555525fc26 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:44.517354 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-672ccde4-902f-4f28-8947-97555525fc26 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:44.529557 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-672ccde4-902f-4f28-8947-97555525fc26 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:44.530014 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-672ccde4-902f-4f28-8947-97555525fc26 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:44.740452 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-e1bb7031-f84d-411e-bba6-1bf34fa51fe1 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:44.846660 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e1bb7031-f84d-411e-bba6-1bf34fa51fe1 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.493526 Jul 12 11:53:44.853482 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 566/1187] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:44 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:44.869607 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-50a293ee-9b56-4c5d-bd7f-78fc23adf458 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:44.873455 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-50a293ee-9b56-4c5d-bd7f-78fc23adf458 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:44.890446 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-50a293ee-9b56-4c5d-bd7f-78fc23adf458 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:44.893012 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-50a293ee-9b56-4c5d-bd7f-78fc23adf458 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:44.895768 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-50a293ee-9b56-4c5d-bd7f-78fc23adf458 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:44.896530 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-50a293ee-9b56-4c5d-bd7f-78fc23adf458 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:45.045135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-672ccde4-902f-4f28-8947-97555525fc26 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:45.055202 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-672ccde4-902f-4f28-8947-97555525fc26 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1318 microversion: 2.1 time: 0.578659 Jul 12 11:53:45.058064 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 622/1188] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:44 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:45.091277 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d5e86536-f21a-4376-a803-e861dd3b0559 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:45.092280 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d5e86536-f21a-4376-a803-e861dd3b0559 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:45.108390 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d5e86536-f21a-4376-a803-e861dd3b0559 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:45.112846 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d5e86536-f21a-4376-a803-e861dd3b0559 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:45.113918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d5e86536-f21a-4376-a803-e861dd3b0559 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:45.114621 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d5e86536-f21a-4376-a803-e861dd3b0559 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:45.148988 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-d5e86536-f21a-4376-a803-e861dd3b0559 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] HTTP exception thrown: Instance 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 could not be found. Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d5e86536-f21a-4376-a803-e861dd3b0559 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Request method failure captured: Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 HTTP/1.1 Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWAIsAjWusJZqZTqO-T5k7sF3XVQ_BVMWkgLAmSdn_h1MRycYbdcU7cykB4uGTStunIOo5ApPn465SO0jjUMYRsZwApvmb-AO14yFiVrUNdkrYxS017oV-XNhYB9rF-oG05Xyetaq0ERBw2wHAO_zCDvGtPTgwRLhQcDsw5foMYdahY Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/810246cfc801446599831d243d3a48dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_810246cfc801446599831d243d3a48dd", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 3e7eb4c715f04ea791384bcde9844fa7 Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 could not be found. Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '4b9cea1e-630e-46e2-a46d-c59fde9d6ac8'} Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 could not be found. Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 could not be found. Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:53:45.151065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:53:45.155092 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:45.155092 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:53:45.155092 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:53:45.155092 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:53:45.155092 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:53:45.155092 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 could not be found. Jul 12 11:53:45.155092 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:53:45.157211 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d5e86536-f21a-4376-a803-e861dd3b0559 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Returning 404 to user: Instance 4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:53:45.159029 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d5e86536-f21a-4376-a803-e861dd3b0559 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8" status: 404 len: 111 microversion: 2.1 time: 0.073440 Jul 12 11:53:45.164570 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 623/1189] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:45 2022] GET /compute/v2.1/servers/4b9cea1e-630e-46e2-a46d-c59fde9d6ac8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:53:45.178503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6370d34b-1120-457b-839e-ad254ee0501d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:45.179568 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6370d34b-1120-457b-839e-ad254ee0501d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:45.188674 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6370d34b-1120-457b-839e-ad254ee0501d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:45.189234 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6370d34b-1120-457b-839e-ad254ee0501d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:45.190049 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6370d34b-1120-457b-839e-ad254ee0501d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:45.190492 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6370d34b-1120-457b-839e-ad254ee0501d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:45.271465 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6370d34b-1120-457b-839e-ad254ee0501d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:53:45.505738 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-50a293ee-9b56-4c5d-bd7f-78fc23adf458 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:45.515719 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-50a293ee-9b56-4c5d-bd7f-78fc23adf458 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1541 microversion: 2.1 time: 0.658967 Jul 12 11:53:45.534272 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 567/1190] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:44 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1541 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:45.549671 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b7ed01a9-887b-4c94-9f93-a278e290b75f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:45.551226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b7ed01a9-887b-4c94-9f93-a278e290b75f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:45.563540 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b7ed01a9-887b-4c94-9f93-a278e290b75f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:45.565099 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b7ed01a9-887b-4c94-9f93-a278e290b75f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:45.566230 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b7ed01a9-887b-4c94-9f93-a278e290b75f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:45.566868 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b7ed01a9-887b-4c94-9f93-a278e290b75f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:45.632752 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6370d34b-1120-457b-839e-ad254ee0501d tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 204 len: 0 microversion: 2.1 time: 0.453332 Jul 12 11:53:45.643293 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 624/1191] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:53:45 2022] DELETE /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 11:53:45.667287 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f9a9add2-b06b-4680-99ca-64973c549b7a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:45.668606 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f9a9add2-b06b-4680-99ca-64973c549b7a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:45.683661 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9a9add2-b06b-4680-99ca-64973c549b7a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:45.684595 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9a9add2-b06b-4680-99ca-64973c549b7a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:45.686044 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9a9add2-b06b-4680-99ca-64973c549b7a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:45.687102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9a9add2-b06b-4680-99ca-64973c549b7a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:45.977149 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f9a9add2-b06b-4680-99ca-64973c549b7a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:46.001402 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f9a9add2-b06b-4680-99ca-64973c549b7a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1314 microversion: 2.1 time: 0.357079 Jul 12 11:53:46.016102 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 625/1192] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:45 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:46.016102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-d677c7bd-3fa6-418e-8bb9-6866a89c8951 req-8d5e2433-7c36-4f77-972c-1ad2cb575a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f300ccc7-18ee-45d7-8d82-a23ddff013eb", "tag": "b51cdaef-49cb-475a-aa61-b858be6b5ca0"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:46.028196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d677c7bd-3fa6-418e-8bb9-6866a89c8951 req-8d5e2433-7c36-4f77-972c-1ad2cb575a48 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:46.029314 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d677c7bd-3fa6-418e-8bb9-6866a89c8951 req-8d5e2433-7c36-4f77-972c-1ad2cb575a48 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:46.045822 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-d677c7bd-3fa6-418e-8bb9-6866a89c8951 req-8d5e2433-7c36-4f77-972c-1ad2cb575a48 service nova] Creating event network-changed:b51cdaef-49cb-475a-aa61-b858be6b5ca0 for instance f300ccc7-18ee-45d7-8d82-a23ddff013eb on n-h2-849104-4 Jul 12 11:53:46.051570 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-d677c7bd-3fa6-418e-8bb9-6866a89c8951 req-8d5e2433-7c36-4f77-972c-1ad2cb575a48 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043177 Jul 12 11:53:46.056809 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 626/1193] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:46.062867 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-22ac68a2-a992-4f61-a6c2-1e51a3bc1be5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:46.063600 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-22ac68a2-a992-4f61-a6c2-1e51a3bc1be5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:46.072622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22ac68a2-a992-4f61-a6c2-1e51a3bc1be5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:46.073075 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22ac68a2-a992-4f61-a6c2-1e51a3bc1be5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:46.074189 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22ac68a2-a992-4f61-a6c2-1e51a3bc1be5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:46.074808 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22ac68a2-a992-4f61-a6c2-1e51a3bc1be5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:46.357419 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b7ed01a9-887b-4c94-9f93-a278e290b75f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:46.368772 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b7ed01a9-887b-4c94-9f93-a278e290b75f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1263 microversion: 2.1 time: 0.832567 Jul 12 11:53:46.372428 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 568/1194] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:45 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1263 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:46.389846 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fca336b5-7086-4cda-bdec-8a6408d8caf7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:46.390837 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fca336b5-7086-4cda-bdec-8a6408d8caf7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:46.408000 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-22ac68a2-a992-4f61-a6c2-1e51a3bc1be5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:46.411938 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fca336b5-7086-4cda-bdec-8a6408d8caf7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:46.412436 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fca336b5-7086-4cda-bdec-8a6408d8caf7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:46.413244 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fca336b5-7086-4cda-bdec-8a6408d8caf7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:46.413697 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fca336b5-7086-4cda-bdec-8a6408d8caf7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:46.420488 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-22ac68a2-a992-4f61-a6c2-1e51a3bc1be5 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1472 microversion: 2.1 time: 0.362375 Jul 12 11:53:46.424559 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 627/1195] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:46 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1472 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:46.430319 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-924848dc-bc05-4e50-8f5b-77f64199321a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:46.430942 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-924848dc-bc05-4e50-8f5b-77f64199321a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:46.440654 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-924848dc-bc05-4e50-8f5b-77f64199321a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:46.441448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-924848dc-bc05-4e50-8f5b-77f64199321a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:46.442553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-924848dc-bc05-4e50-8f5b-77f64199321a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:46.443232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-924848dc-bc05-4e50-8f5b-77f64199321a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:46.578716 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-fca336b5-7086-4cda-bdec-8a6408d8caf7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:46.600436 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fca336b5-7086-4cda-bdec-8a6408d8caf7 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.226792 Jul 12 11:53:46.601627 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 569/1196] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:46 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:46.607288 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1a945f84-6ff1-4b73-947f-a50003612298 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:46.617189 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1a945f84-6ff1-4b73-947f-a50003612298 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:46.619463 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1a945f84-6ff1-4b73-947f-a50003612298 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:46.619463 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1a945f84-6ff1-4b73-947f-a50003612298 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:46.620761 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1a945f84-6ff1-4b73-947f-a50003612298 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:46.621397 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1a945f84-6ff1-4b73-947f-a50003612298 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:46.715609 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-924848dc-bc05-4e50-8f5b-77f64199321a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:46.739145 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-924848dc-bc05-4e50-8f5b-77f64199321a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1318 microversion: 2.1 time: 0.313084 Jul 12 11:53:46.739830 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 628/1197] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:46 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:46.886485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-de123757-10d0-40ac-b02c-886507a805be req-4617a182-3c47-4fa6-bd7a-76204d2e84a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c311469b-29d4-4011-b455-8fe3ffd81d3c", "name": "network-vif-unplugged", "status": "completed", "tag": "4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:46.896341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-de123757-10d0-40ac-b02c-886507a805be req-4617a182-3c47-4fa6-bd7a-76204d2e84a1 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:46.896815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-de123757-10d0-40ac-b02c-886507a805be req-4617a182-3c47-4fa6-bd7a-76204d2e84a1 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:46.909829 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-de123757-10d0-40ac-b02c-886507a805be req-4617a182-3c47-4fa6-bd7a-76204d2e84a1 service nova] Creating event network-vif-unplugged:4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec for instance c311469b-29d4-4011-b455-8fe3ffd81d3c on n-h1-849104-4 Jul 12 11:53:46.918711 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [req-de123757-10d0-40ac-b02c-886507a805be req-4617a182-3c47-4fa6-bd7a-76204d2e84a1 service nova] Instance c311469b-29d4-4011-b455-8fe3ffd81d3c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849104-4', 'n-h1-849104-4'} {{(pid=125984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 12 11:53:46.939229 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-de123757-10d0-40ac-b02c-886507a805be req-4617a182-3c47-4fa6-bd7a-76204d2e84a1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059049 Jul 12 11:53:46.940645 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 629/1198] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:53:46.985856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1a945f84-6ff1-4b73-947f-a50003612298 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:47.006865 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1a945f84-6ff1-4b73-947f-a50003612298 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1541 microversion: 2.1 time: 0.403523 Jul 12 11:53:47.012566 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 570/1199] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:46 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1541 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:47.037055 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-662d0733-9a06-461a-ae68-4e229d52dcee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:47.037871 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-662d0733-9a06-461a-ae68-4e229d52dcee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:47.046400 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-662d0733-9a06-461a-ae68-4e229d52dcee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:47.046894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-662d0733-9a06-461a-ae68-4e229d52dcee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:47.047988 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-662d0733-9a06-461a-ae68-4e229d52dcee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:47.048216 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-662d0733-9a06-461a-ae68-4e229d52dcee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:47.256859 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-662d0733-9a06-461a-ae68-4e229d52dcee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:47.273122 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-662d0733-9a06-461a-ae68-4e229d52dcee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1314 microversion: 2.1 time: 0.246927 Jul 12 11:53:47.274495 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 630/1200] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:47 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:47.395255 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b095eda6-e1aa-4f4d-a42e-5ee5395325fb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:47.395882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b095eda6-e1aa-4f4d-a42e-5ee5395325fb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:47.409430 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b095eda6-e1aa-4f4d-a42e-5ee5395325fb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:47.410272 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b095eda6-e1aa-4f4d-a42e-5ee5395325fb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:47.411589 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b095eda6-e1aa-4f4d-a42e-5ee5395325fb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:47.412133 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b095eda6-e1aa-4f4d-a42e-5ee5395325fb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:47.442243 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-94bd95d4-e83f-42c8-8e6d-ea1429dd0f0c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:47.443340 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-94bd95d4-e83f-42c8-8e6d-ea1429dd0f0c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:47.459138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94bd95d4-e83f-42c8-8e6d-ea1429dd0f0c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:47.463607 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94bd95d4-e83f-42c8-8e6d-ea1429dd0f0c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:47.465326 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94bd95d4-e83f-42c8-8e6d-ea1429dd0f0c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:47.467765 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94bd95d4-e83f-42c8-8e6d-ea1429dd0f0c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:47.652870 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b095eda6-e1aa-4f4d-a42e-5ee5395325fb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:47.672495 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b095eda6-e1aa-4f4d-a42e-5ee5395325fb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1269 microversion: 2.1 time: 0.279649 Jul 12 11:53:47.673721 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 571/1201] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:47 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1269 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:47.678923 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-eab5ffda-6bed-42fc-b4a3-23a567e2c762 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:47.680814 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-eab5ffda-6bed-42fc-b4a3-23a567e2c762 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:47.703400 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eab5ffda-6bed-42fc-b4a3-23a567e2c762 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:47.704314 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eab5ffda-6bed-42fc-b4a3-23a567e2c762 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:47.705342 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eab5ffda-6bed-42fc-b4a3-23a567e2c762 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:47.705961 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eab5ffda-6bed-42fc-b4a3-23a567e2c762 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:47.999673 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-eab5ffda-6bed-42fc-b4a3-23a567e2c762 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:48.014764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-94bd95d4-e83f-42c8-8e6d-ea1429dd0f0c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:48.032738 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-94bd95d4-e83f-42c8-8e6d-ea1429dd0f0c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1472 microversion: 2.1 time: 0.594195 Jul 12 11:53:48.048512 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 631/1202] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:47 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1472 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:48.060803 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-84ae902b-096e-46d5-b52f-95a335fdd449 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:48.062068 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-84ae902b-096e-46d5-b52f-95a335fdd449 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:48.089660 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-eab5ffda-6bed-42fc-b4a3-23a567e2c762 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.414734 Jul 12 11:53:48.090404 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 572/1203] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:47 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:48.108938 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3edbd038-c877-47ce-879a-a9780626ad95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:48.109569 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3edbd038-c877-47ce-879a-a9780626ad95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:48.113740 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84ae902b-096e-46d5-b52f-95a335fdd449 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:48.114221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84ae902b-096e-46d5-b52f-95a335fdd449 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:48.115043 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84ae902b-096e-46d5-b52f-95a335fdd449 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:48.115610 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84ae902b-096e-46d5-b52f-95a335fdd449 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:48.123728 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3edbd038-c877-47ce-879a-a9780626ad95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:48.124766 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3edbd038-c877-47ce-879a-a9780626ad95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:48.125590 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3edbd038-c877-47ce-879a-a9780626ad95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:48.126034 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3edbd038-c877-47ce-879a-a9780626ad95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:48.135893 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:48.177767 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:48.725889 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3edbd038-c877-47ce-879a-a9780626ad95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:48.734883 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3edbd038-c877-47ce-879a-a9780626ad95 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1541 microversion: 2.1 time: 0.629750 Jul 12 11:53:48.736884 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 573/1204] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:48 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1541 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:48.747272 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f7da82ee-7f84-4dc4-99f9-50e33af1610f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:48.748633 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f7da82ee-7f84-4dc4-99f9-50e33af1610f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:48.761000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f7da82ee-7f84-4dc4-99f9-50e33af1610f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:48.770337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f7da82ee-7f84-4dc4-99f9-50e33af1610f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:48.772953 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f7da82ee-7f84-4dc4-99f9-50e33af1610f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:48.773789 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f7da82ee-7f84-4dc4-99f9-50e33af1610f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:48.975405 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-84ae902b-096e-46d5-b52f-95a335fdd449 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:48.988077 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-84ae902b-096e-46d5-b52f-95a335fdd449 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1318 microversion: 2.1 time: 0.937877 Jul 12 11:53:48.991123 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 632/1205] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:48 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1318 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:49.011666 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2b589a80-e9c5-4f7f-890d-8f8cb64a0d7e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:49.012972 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2b589a80-e9c5-4f7f-890d-8f8cb64a0d7e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:49.037384 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2b589a80-e9c5-4f7f-890d-8f8cb64a0d7e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:49.040147 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2b589a80-e9c5-4f7f-890d-8f8cb64a0d7e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:49.041972 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2b589a80-e9c5-4f7f-890d-8f8cb64a0d7e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:49.043205 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2b589a80-e9c5-4f7f-890d-8f8cb64a0d7e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:49.289013 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f7da82ee-7f84-4dc4-99f9-50e33af1610f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:49.311185 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f7da82ee-7f84-4dc4-99f9-50e33af1610f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1314 microversion: 2.1 time: 0.567986 Jul 12 11:53:49.312595 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 574/1206] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:48 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:49.321453 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-46dd0ea9-add6-48c4-b7ef-6672714123c0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:49.323278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-46dd0ea9-add6-48c4-b7ef-6672714123c0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:49.332460 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-46dd0ea9-add6-48c4-b7ef-6672714123c0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:49.333305 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-46dd0ea9-add6-48c4-b7ef-6672714123c0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:49.334180 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-46dd0ea9-add6-48c4-b7ef-6672714123c0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:49.334692 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-46dd0ea9-add6-48c4-b7ef-6672714123c0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:49.379132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2b589a80-e9c5-4f7f-890d-8f8cb64a0d7e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:49.398327 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2b589a80-e9c5-4f7f-890d-8f8cb64a0d7e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1311 microversion: 2.1 time: 0.403774 Jul 12 11:53:49.398934 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 633/1207] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:48 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1311 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:49.414478 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-ba84e6d5-d5e6-46e1-9c76-c217617be9b8 req-78429633-16cb-480c-aa40-485b31b90cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be284e8-364a-45aa-97d4-944bfb60fc64", "name": "network-vif-plugged", "status": "completed", "tag": "8ffbdeea-3f69-4b50-9b87-39003070cf5a"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:49.423796 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-ba84e6d5-d5e6-46e1-9c76-c217617be9b8 req-78429633-16cb-480c-aa40-485b31b90cad service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:49.424566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-ba84e6d5-d5e6-46e1-9c76-c217617be9b8 req-78429633-16cb-480c-aa40-485b31b90cad service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:49.449205 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-ba84e6d5-d5e6-46e1-9c76-c217617be9b8 req-78429633-16cb-480c-aa40-485b31b90cad service nova] Creating event network-vif-plugged:8ffbdeea-3f69-4b50-9b87-39003070cf5a for instance 6be284e8-364a-45aa-97d4-944bfb60fc64 on n-h1-849104-4 Jul 12 11:53:49.463711 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-ba84e6d5-d5e6-46e1-9c76-c217617be9b8 req-78429633-16cb-480c-aa40-485b31b90cad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057389 Jul 12 11:53:49.475197 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 634/1208] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:49.482250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-d6d9362b-ae89-479b-b8eb-f102b915cd4a req-b139a685-38bc-4458-98ad-885089f048f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c311469b-29d4-4011-b455-8fe3ffd81d3c", "tag": "4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:49.523388 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d6d9362b-ae89-479b-b8eb-f102b915cd4a req-b139a685-38bc-4458-98ad-885089f048f2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:49.534848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d6d9362b-ae89-479b-b8eb-f102b915cd4a req-b139a685-38bc-4458-98ad-885089f048f2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:49.559910 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-d6d9362b-ae89-479b-b8eb-f102b915cd4a req-b139a685-38bc-4458-98ad-885089f048f2 service nova] Creating event network-changed:4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec for instance c311469b-29d4-4011-b455-8fe3ffd81d3c on n-h1-849104-4 Jul 12 11:53:49.579124 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [req-d6d9362b-ae89-479b-b8eb-f102b915cd4a req-b139a685-38bc-4458-98ad-885089f048f2 service nova] Instance c311469b-29d4-4011-b455-8fe3ffd81d3c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849104-4', 'n-h1-849104-4'} {{(pid=125984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 12 11:53:49.604639 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-d6d9362b-ae89-479b-b8eb-f102b915cd4a req-b139a685-38bc-4458-98ad-885089f048f2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126827 Jul 12 11:53:49.606799 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 635/1209] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:49.614682 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-338ced0e-5d06-47b8-abda-733cdb2a2b75 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:49.615749 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-338ced0e-5d06-47b8-abda-733cdb2a2b75 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:49.624395 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-338ced0e-5d06-47b8-abda-733cdb2a2b75 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:49.625209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-338ced0e-5d06-47b8-abda-733cdb2a2b75 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:49.626236 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-338ced0e-5d06-47b8-abda-733cdb2a2b75 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:49.626941 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-338ced0e-5d06-47b8-abda-733cdb2a2b75 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:49.756116 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-338ced0e-5d06-47b8-abda-733cdb2a2b75 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:49.810162 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-338ced0e-5d06-47b8-abda-733cdb2a2b75 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1927 microversion: 2.75 time: 0.200846 Jul 12 11:53:49.810967 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 636/1210] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:49 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1927 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:49.822695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-94ca6b4e-0279-4dad-b266-ae88c8f38ccb req-19fdc2fc-3558-4a50-a358-e649f6ef9f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e523720-c162-4dac-a620-1e2325a63dfa", "name": "network-vif-deleted", "tag": "5c3dfca1-7449-46f3-994a-4127c1b004e4"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:49.850099 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-94ca6b4e-0279-4dad-b266-ae88c8f38ccb req-19fdc2fc-3558-4a50-a358-e649f6ef9f65 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:49.850778 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-94ca6b4e-0279-4dad-b266-ae88c8f38ccb req-19fdc2fc-3558-4a50-a358-e649f6ef9f65 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:49.879372 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-94ca6b4e-0279-4dad-b266-ae88c8f38ccb req-19fdc2fc-3558-4a50-a358-e649f6ef9f65 service nova] Creating event network-vif-deleted:5c3dfca1-7449-46f3-994a-4127c1b004e4 for instance 7e523720-c162-4dac-a620-1e2325a63dfa on n-h2-849104-4 Jul 12 11:53:49.889096 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-46dd0ea9-add6-48c4-b7ef-6672714123c0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:49.906999 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-94ca6b4e-0279-4dad-b266-ae88c8f38ccb req-19fdc2fc-3558-4a50-a358-e649f6ef9f65 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093888 Jul 12 11:53:49.911131 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 637/1211] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:49.914101 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-46dd0ea9-add6-48c4-b7ef-6672714123c0 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1472 microversion: 2.1 time: 0.598333 Jul 12 11:53:49.930383 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 575/1212] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:49 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1472 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:49.932485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-12841c66-f642-43bd-a14b-016b54512987 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:49.933492 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-12841c66-f642-43bd-a14b-016b54512987 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:49.943366 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-12841c66-f642-43bd-a14b-016b54512987 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:49.944552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-12841c66-f642-43bd-a14b-016b54512987 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:49.948486 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-12841c66-f642-43bd-a14b-016b54512987 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:49.949313 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-12841c66-f642-43bd-a14b-016b54512987 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:50.023404 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6320c3e1-79dd-44f5-a634-4efbeb2c993f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:50.024787 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6320c3e1-79dd-44f5-a634-4efbeb2c993f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:50.037821 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6320c3e1-79dd-44f5-a634-4efbeb2c993f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:50.042087 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6320c3e1-79dd-44f5-a634-4efbeb2c993f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:50.044777 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6320c3e1-79dd-44f5-a634-4efbeb2c993f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:50.045981 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6320c3e1-79dd-44f5-a634-4efbeb2c993f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:50.383546 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-12841c66-f642-43bd-a14b-016b54512987 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:50.401666 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-12841c66-f642-43bd-a14b-016b54512987 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1473 microversion: 2.1 time: 0.486085 Jul 12 11:53:50.403873 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 638/1213] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:49 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1473 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:50.410088 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6b76f3bf-a81f-4ae0-92db-b1f29b6f6b2f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:50.411064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6b76f3bf-a81f-4ae0-92db-b1f29b6f6b2f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:50.418714 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6b76f3bf-a81f-4ae0-92db-b1f29b6f6b2f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:50.419172 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6b76f3bf-a81f-4ae0-92db-b1f29b6f6b2f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:50.419977 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6b76f3bf-a81f-4ae0-92db-b1f29b6f6b2f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:50.420481 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6b76f3bf-a81f-4ae0-92db-b1f29b6f6b2f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:50.481588 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6320c3e1-79dd-44f5-a634-4efbeb2c993f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:50.495942 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6320c3e1-79dd-44f5-a634-4efbeb2c993f tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1318 microversion: 2.1 time: 0.479594 Jul 12 11:53:50.497176 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 576/1214] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:50 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:50.503518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b71ed20d-1732-4bdb-8075-31c6bcc7d08d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:50.504513 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b71ed20d-1732-4bdb-8075-31c6bcc7d08d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:50.516164 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b71ed20d-1732-4bdb-8075-31c6bcc7d08d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:50.516853 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b71ed20d-1732-4bdb-8075-31c6bcc7d08d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:50.518328 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b71ed20d-1732-4bdb-8075-31c6bcc7d08d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:50.518918 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b71ed20d-1732-4bdb-8075-31c6bcc7d08d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:50.740441 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6b76f3bf-a81f-4ae0-92db-b1f29b6f6b2f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:50.760498 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6b76f3bf-a81f-4ae0-92db-b1f29b6f6b2f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1314 microversion: 2.1 time: 0.353709 Jul 12 11:53:50.771517 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 639/1215] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:50 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:50.833570 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f1b192be-2852-47bd-8852-976262f64536 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:50.834535 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f1b192be-2852-47bd-8852-976262f64536 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:50.846416 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f1b192be-2852-47bd-8852-976262f64536 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:50.847536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f1b192be-2852-47bd-8852-976262f64536 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:50.848658 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f1b192be-2852-47bd-8852-976262f64536 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:50.849154 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f1b192be-2852-47bd-8852-976262f64536 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:50.892778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b71ed20d-1732-4bdb-8075-31c6bcc7d08d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:50.904230 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b71ed20d-1732-4bdb-8075-31c6bcc7d08d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1332 microversion: 2.1 time: 0.405595 Jul 12 11:53:50.905245 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 577/1216] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:50 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1332 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:50.936770 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-00cff440-15e2-4626-8225-6b13a5633f9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:50.937714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-00cff440-15e2-4626-8225-6b13a5633f9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:50.946018 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-00cff440-15e2-4626-8225-6b13a5633f9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:50.946018 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-00cff440-15e2-4626-8225-6b13a5633f9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:50.948714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-00cff440-15e2-4626-8225-6b13a5633f9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:50.948714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-00cff440-15e2-4626-8225-6b13a5633f9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:50.960828 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-f1b192be-2852-47bd-8852-976262f64536 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:51.000539 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f1b192be-2852-47bd-8852-976262f64536 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1933 microversion: 2.75 time: 0.170910 Jul 12 11:53:51.001194 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-00cff440-15e2-4626-8225-6b13a5633f9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:51.004083 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 640/1217] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:50 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1933 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:51.004233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-00cff440-15e2-4626-8225-6b13a5633f9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:51.004233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-00cff440-15e2-4626-8225-6b13a5633f9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lazy-loading 'fault' on Instance uuid 7e523720-c162-4dac-a620-1e2325a63dfa {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:51.045482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-00cff440-15e2-4626-8225-6b13a5633f9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:51.054249 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-00cff440-15e2-4626-8225-6b13a5633f9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 200 len: 1307 microversion: 2.1 time: 0.122830 Jul 12 11:53:51.055527 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 578/1218] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:50 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 1307 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:51.424520 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a4900f39-daef-40ff-bb8e-bdbb9799ecf8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:51.425250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a4900f39-daef-40ff-bb8e-bdbb9799ecf8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:51.432872 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a4900f39-daef-40ff-bb8e-bdbb9799ecf8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:51.433325 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a4900f39-daef-40ff-bb8e-bdbb9799ecf8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:51.434119 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a4900f39-daef-40ff-bb8e-bdbb9799ecf8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:51.434564 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a4900f39-daef-40ff-bb8e-bdbb9799ecf8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:51.515915 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-860e7483-3b68-40ba-aabb-dc1d23a89064 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:51.516712 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-860e7483-3b68-40ba-aabb-dc1d23a89064 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:51.523679 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-860e7483-3b68-40ba-aabb-dc1d23a89064 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:51.524170 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-860e7483-3b68-40ba-aabb-dc1d23a89064 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:51.525521 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-860e7483-3b68-40ba-aabb-dc1d23a89064 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:51.525965 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-860e7483-3b68-40ba-aabb-dc1d23a89064 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:51.598105 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a4900f39-daef-40ff-bb8e-bdbb9799ecf8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:51.606596 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a4900f39-daef-40ff-bb8e-bdbb9799ecf8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1473 microversion: 2.1 time: 0.186154 Jul 12 11:53:51.607192 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 641/1219] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:51 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1473 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:51.693164 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-53cf6dc9-2434-4095-8a26-0c2a79c2be12 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:51.693798 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-53cf6dc9-2434-4095-8a26-0c2a79c2be12 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:51.700421 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53cf6dc9-2434-4095-8a26-0c2a79c2be12 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:51.700877 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53cf6dc9-2434-4095-8a26-0c2a79c2be12 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:51.701872 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53cf6dc9-2434-4095-8a26-0c2a79c2be12 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:51.702336 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53cf6dc9-2434-4095-8a26-0c2a79c2be12 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:51.771259 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-860e7483-3b68-40ba-aabb-dc1d23a89064 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:51.786972 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-860e7483-3b68-40ba-aabb-dc1d23a89064 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1318 microversion: 2.1 time: 0.274714 Jul 12 11:53:51.787261 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 579/1220] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:51 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:51.798422 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-aaa3e9bc-4892-42d4-ab34-64566bb8a405 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:51.799582 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-aaa3e9bc-4892-42d4-ab34-64566bb8a405 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:51.809674 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aaa3e9bc-4892-42d4-ab34-64566bb8a405 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:51.810421 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aaa3e9bc-4892-42d4-ab34-64566bb8a405 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:51.811555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aaa3e9bc-4892-42d4-ab34-64566bb8a405 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:51.812194 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aaa3e9bc-4892-42d4-ab34-64566bb8a405 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:51.988372 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-53cf6dc9-2434-4095-8a26-0c2a79c2be12 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1813 microversion: 2.1 time: 0.299826 Jul 12 11:53:51.989264 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 642/1221] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:51 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1813 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:53:51.994303 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5a7f18b9-e95a-43e0-82d4-13dc4fddf7d0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:51.994916 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5a7f18b9-e95a-43e0-82d4-13dc4fddf7d0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:52.002410 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a7f18b9-e95a-43e0-82d4-13dc4fddf7d0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.002864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a7f18b9-e95a-43e0-82d4-13dc4fddf7d0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.003653 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a7f18b9-e95a-43e0-82d4-13dc4fddf7d0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.004127 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5a7f18b9-e95a-43e0-82d4-13dc4fddf7d0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.169235 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5a7f18b9-e95a-43e0-82d4-13dc4fddf7d0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:52.178525 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5a7f18b9-e95a-43e0-82d4-13dc4fddf7d0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1332 microversion: 2.1 time: 0.188194 Jul 12 11:53:52.189883 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 643/1222] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:51 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1332 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:52.189883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7dae2488-ab1c-40ba-9488-8d73a76285cb tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:52.189883 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:53:52.189883 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:53:52.189883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7dae2488-ab1c-40ba-9488-8d73a76285cb tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.189883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7dae2488-ab1c-40ba-9488-8d73a76285cb tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.190570 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7dae2488-ab1c-40ba-9488-8d73a76285cb tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.191105 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7dae2488-ab1c-40ba-9488-8d73a76285cb tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.226071 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7dae2488-ab1c-40ba-9488-8d73a76285cb tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045644 Jul 12 11:53:52.226973 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 644/1223] 10.222.0.50 () {58 vars in 1175 bytes} [Tue Jul 12 11:53:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:52.237444 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-aaa3e9bc-4892-42d4-ab34-64566bb8a405 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:52.238021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d012eabc-d5f4-4e2c-8380-1df74f065202 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:52.238311 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d012eabc-d5f4-4e2c-8380-1df74f065202 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:52.246821 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d012eabc-d5f4-4e2c-8380-1df74f065202 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.247351 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d012eabc-d5f4-4e2c-8380-1df74f065202 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.247834 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-aaa3e9bc-4892-42d4-ab34-64566bb8a405 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1314 microversion: 2.1 time: 0.459210 Jul 12 11:53:52.248309 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d012eabc-d5f4-4e2c-8380-1df74f065202 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.248597 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 580/1224] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:51 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:52.253765 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2ae763c1-5a43-4261-a9ad-23e77873e619 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:52.255531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2ae763c1-5a43-4261-a9ad-23e77873e619 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7e523720-c162-4dac-a620-1e2325a63dfa] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:52.260819 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d012eabc-d5f4-4e2c-8380-1df74f065202 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.265854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2ae763c1-5a43-4261-a9ad-23e77873e619 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.266856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2ae763c1-5a43-4261-a9ad-23e77873e619 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.267872 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2ae763c1-5a43-4261-a9ad-23e77873e619 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.268583 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2ae763c1-5a43-4261-a9ad-23e77873e619 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.286400 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-2ae763c1-5a43-4261-a9ad-23e77873e619 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] HTTP exception thrown: Instance 7e523720-c162-4dac-a620-1e2325a63dfa could not be found. Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2ae763c1-5a43-4261-a9ad-23e77873e619 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Request method failure captured: Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa HTTP/1.1 Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWAIsAjWusJZqZTqO-T5k7sF3XVQ_BVMWkgLAmSdn_h1MRycYbdcU7cykB4uGTStunIOo5ApPn465SO0jjUMYRsZwApvmb-AO14yFiVrUNdkrYxS017oV-XNhYB9rF-oG05Xyetaq0ERBw2wHAO_zCDvGtPTgwRLhQcDsw5foMYdahY Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/810246cfc801446599831d243d3a48dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_810246cfc801446599831d243d3a48dd", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 3e7eb4c715f04ea791384bcde9844fa7 Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 7e523720-c162-4dac-a620-1e2325a63dfa could not be found. Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '7e523720-c162-4dac-a620-1e2325a63dfa'} Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e523720-c162-4dac-a620-1e2325a63dfa could not be found. Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e523720-c162-4dac-a620-1e2325a63dfa could not be found. Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:53:52.289384 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:52.295371 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:53:52.295371 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:53:52.295371 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:53:52.295371 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:53:52.295371 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:53:52.295371 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e523720-c162-4dac-a620-1e2325a63dfa could not be found. Jul 12 11:53:52.295371 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:53:52.299613 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2ae763c1-5a43-4261-a9ad-23e77873e619 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Returning 404 to user: Instance 7e523720-c162-4dac-a620-1e2325a63dfa could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:53:52.301505 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2ae763c1-5a43-4261-a9ad-23e77873e619 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa" status: 404 len: 111 microversion: 2.1 time: 0.051457 Jul 12 11:53:52.304070 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 581/1225] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:52 2022] GET /compute/v2.1/servers/7e523720-c162-4dac-a620-1e2325a63dfa => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:53:52.312660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b06e2904-ca42-432d-b739-dc64d25053bc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:52.313217 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b06e2904-ca42-432d-b739-dc64d25053bc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7763fa51-4518-440e-a663-f8dac78f536c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:52.323478 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b06e2904-ca42-432d-b739-dc64d25053bc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.324355 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b06e2904-ca42-432d-b739-dc64d25053bc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.325872 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b06e2904-ca42-432d-b739-dc64d25053bc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.326765 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b06e2904-ca42-432d-b739-dc64d25053bc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.368388 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b06e2904-ca42-432d-b739-dc64d25053bc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7763fa51-4518-440e-a663-f8dac78f536c] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:53:52.398064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-d012eabc-d5f4-4e2c-8380-1df74f065202 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:52.432535 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d012eabc-d5f4-4e2c-8380-1df74f065202 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1933 microversion: 2.75 time: 0.202727 Jul 12 11:53:52.434176 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 645/1226] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:52 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1933 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:52.529851 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b06e2904-ca42-432d-b739-dc64d25053bc tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c" status: 204 len: 0 microversion: 2.1 time: 0.221725 Jul 12 11:53:52.530878 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 582/1227] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:53:52 2022] DELETE /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 11:53:52.542064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e3612a72-7e2c-45a6-a465-46e569c6bfbe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:52.543009 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e3612a72-7e2c-45a6-a465-46e569c6bfbe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:52.554641 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e3612a72-7e2c-45a6-a465-46e569c6bfbe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.556304 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e3612a72-7e2c-45a6-a465-46e569c6bfbe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.558559 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e3612a72-7e2c-45a6-a465-46e569c6bfbe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.559722 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e3612a72-7e2c-45a6-a465-46e569c6bfbe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.602073 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e3612a72-7e2c-45a6-a465-46e569c6bfbe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:53:52.628693 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ce065263-910d-4506-ab38-5d767e945a56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:52.629406 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ce065263-910d-4506-ab38-5d767e945a56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:52.648624 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce065263-910d-4506-ab38-5d767e945a56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.649365 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce065263-910d-4506-ab38-5d767e945a56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.650805 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce065263-910d-4506-ab38-5d767e945a56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.651785 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce065263-910d-4506-ab38-5d767e945a56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.829230 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e3612a72-7e2c-45a6-a465-46e569c6bfbe tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 204 len: 0 microversion: 2.1 time: 0.286184 Jul 12 11:53:52.832792 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 646/1228] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:53:52 2022] DELETE /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:53:52.842375 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5ca9a0f9-674c-46b0-a978-ec08b51dd83c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:52.843109 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5ca9a0f9-674c-46b0-a978-ec08b51dd83c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:52.861628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5ca9a0f9-674c-46b0-a978-ec08b51dd83c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.862315 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5ca9a0f9-674c-46b0-a978-ec08b51dd83c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:52.863595 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5ca9a0f9-674c-46b0-a978-ec08b51dd83c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:52.864321 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5ca9a0f9-674c-46b0-a978-ec08b51dd83c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:53.096863 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5ca9a0f9-674c-46b0-a978-ec08b51dd83c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:53.108856 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5ca9a0f9-674c-46b0-a978-ec08b51dd83c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1318 microversion: 2.1 time: 0.271481 Jul 12 11:53:53.109461 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 647/1229] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:52 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:53.125285 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3bb5ecbe-c645-4f89-a7db-ec35194e6aec tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:53.127649 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3bb5ecbe-c645-4f89-a7db-ec35194e6aec tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7763fa51-4518-440e-a663-f8dac78f536c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:53.144590 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3bb5ecbe-c645-4f89-a7db-ec35194e6aec tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:53.145046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3bb5ecbe-c645-4f89-a7db-ec35194e6aec tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:53.145882 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3bb5ecbe-c645-4f89-a7db-ec35194e6aec tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:53.146322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3bb5ecbe-c645-4f89-a7db-ec35194e6aec tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:53.170411 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:53.284871 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ce065263-910d-4506-ab38-5d767e945a56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:53.298518 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ce065263-910d-4506-ab38-5d767e945a56 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1470 microversion: 2.1 time: 0.674322 Jul 12 11:53:53.299846 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 583/1230] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:52 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1470 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:53.307878 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ab2848d7-f896-4d49-a695-964f9ee3cbf6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:53.308988 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ab2848d7-f896-4d49-a695-964f9ee3cbf6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:53.324568 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ab2848d7-f896-4d49-a695-964f9ee3cbf6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:53.326505 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ab2848d7-f896-4d49-a695-964f9ee3cbf6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:53.328875 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ab2848d7-f896-4d49-a695-964f9ee3cbf6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:53.329855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ab2848d7-f896-4d49-a695-964f9ee3cbf6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:53.337503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3bb5ecbe-c645-4f89-a7db-ec35194e6aec tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:53.351229 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3bb5ecbe-c645-4f89-a7db-ec35194e6aec tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c" status: 200 len: 1474 microversion: 2.1 time: 0.234812 Jul 12 11:53:53.352437 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 648/1231] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:53 2022] GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c => generated 1474 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:53.371992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f8dc249c-e31f-4911-b540-db7f4698ba77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:53.373159 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f8dc249c-e31f-4911-b540-db7f4698ba77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:53.412024 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8dc249c-e31f-4911-b540-db7f4698ba77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:53.412809 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8dc249c-e31f-4911-b540-db7f4698ba77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:53.414240 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8dc249c-e31f-4911-b540-db7f4698ba77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:53.424607 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8dc249c-e31f-4911-b540-db7f4698ba77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:53.603518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=6 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:53.693117 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f8dc249c-e31f-4911-b540-db7f4698ba77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:53.702575 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f8dc249c-e31f-4911-b540-db7f4698ba77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1500 microversion: 2.1 time: 0.347440 Jul 12 11:53:53.704119 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 649/1232] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:53 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1500 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:53.715078 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4b2dd10b-e1e0-4903-a3a0-257597f5a050 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:53.715900 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4b2dd10b-e1e0-4903-a3a0-257597f5a050 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:53.722868 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b2dd10b-e1e0-4903-a3a0-257597f5a050 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:53.723679 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b2dd10b-e1e0-4903-a3a0-257597f5a050 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:53.725083 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b2dd10b-e1e0-4903-a3a0-257597f5a050 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:53.725825 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b2dd10b-e1e0-4903-a3a0-257597f5a050 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:53.812662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:53.838723 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b2dd10b-e1e0-4903-a3a0-257597f5a050 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:53.839188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b2dd10b-e1e0-4903-a3a0-257597f5a050 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:53.848888 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b2dd10b-e1e0-4903-a3a0-257597f5a050 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:53.849600 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b2dd10b-e1e0-4903-a3a0-257597f5a050 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:53.906721 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-4b2dd10b-e1e0-4903-a3a0-257597f5a050 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Getting quotas for project 4c6a6e22d13840698ada0866ea3f4913. Resources: {'cores', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:53:53.918111 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ab2848d7-f896-4d49-a695-964f9ee3cbf6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:53.922150 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-4b2dd10b-e1e0-4903-a3a0-257597f5a050 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Getting quotas for user d42140cf6bac4674ba0515ca28531222 and project 4c6a6e22d13840698ada0866ea3f4913. Resources: {'cores', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:53:53.928611 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ab2848d7-f896-4d49-a695-964f9ee3cbf6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.627343 Jul 12 11:53:53.929203 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 584/1233] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:53 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:53.936633 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9ee2e372-8d94-48e5-837e-67ca602b6ec5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:53.937252 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9ee2e372-8d94-48e5-837e-67ca602b6ec5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:53.953027 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ee2e372-8d94-48e5-837e-67ca602b6ec5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:53.953361 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ee2e372-8d94-48e5-837e-67ca602b6ec5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:53.957151 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ee2e372-8d94-48e5-837e-67ca602b6ec5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:53.962116 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ee2e372-8d94-48e5-837e-67ca602b6ec5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:54.162014 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4b2dd10b-e1e0-4903-a3a0-257597f5a050 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "POST /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c/action" status: 202 len: 0 microversion: 2.1 time: 0.455440 Jul 12 11:53:54.168061 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 650/1234] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:53:53 2022] POST /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:53:54.185100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-9ee2e372-8d94-48e5-837e-67ca602b6ec5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:54.192223 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e43d3151-a21c-44ff-85ab-7edbe8266c13 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:54.193031 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e43d3151-a21c-44ff-85ab-7edbe8266c13 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:54.204735 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e43d3151-a21c-44ff-85ab-7edbe8266c13 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:54.206437 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e43d3151-a21c-44ff-85ab-7edbe8266c13 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:54.209117 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e43d3151-a21c-44ff-85ab-7edbe8266c13 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:54.210567 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e43d3151-a21c-44ff-85ab-7edbe8266c13 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:54.225154 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9ee2e372-8d94-48e5-837e-67ca602b6ec5 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1933 microversion: 2.75 time: 0.294248 Jul 12 11:53:54.226030 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 585/1235] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:53 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1933 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:54.252183 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cf86506d-92bf-4976-b5d3-8c0b210418b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:54.253738 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cf86506d-92bf-4976-b5d3-8c0b210418b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:54.265396 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cf86506d-92bf-4976-b5d3-8c0b210418b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:54.265870 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cf86506d-92bf-4976-b5d3-8c0b210418b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:54.267624 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cf86506d-92bf-4976-b5d3-8c0b210418b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:54.268314 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cf86506d-92bf-4976-b5d3-8c0b210418b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:54.316664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=24 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:54.445316 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e43d3151-a21c-44ff-85ab-7edbe8266c13 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:54.453317 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e43d3151-a21c-44ff-85ab-7edbe8266c13 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1318 microversion: 2.1 time: 0.286812 Jul 12 11:53:54.464346 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 651/1236] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:54 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:54.470650 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3a0af2c3-eccb-458d-a895-c7e925667977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:54.471466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3a0af2c3-eccb-458d-a895-c7e925667977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7763fa51-4518-440e-a663-f8dac78f536c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:54.484159 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3a0af2c3-eccb-458d-a895-c7e925667977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:54.485016 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3a0af2c3-eccb-458d-a895-c7e925667977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:54.486233 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3a0af2c3-eccb-458d-a895-c7e925667977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:54.487196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3a0af2c3-eccb-458d-a895-c7e925667977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:54.744306 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3a0af2c3-eccb-458d-a895-c7e925667977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:54.759909 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3a0af2c3-eccb-458d-a895-c7e925667977 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c" status: 200 len: 1474 microversion: 2.1 time: 0.300965 Jul 12 11:53:54.762420 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 652/1237] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:54 2022] GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c => generated 1474 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:54.795543 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-cf86506d-92bf-4976-b5d3-8c0b210418b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:54.816007 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cf86506d-92bf-4976-b5d3-8c0b210418b3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1469 microversion: 2.1 time: 0.588444 Jul 12 11:53:54.816984 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 586/1238] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:54 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1469 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:54.955604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-35886b43-400e-43d9-897f-9d7e7abd9844 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:54.956805 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-35886b43-400e-43d9-897f-9d7e7abd9844 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:54.975381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-541dc53f-beab-40c3-82fb-8cf59c5ed810 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0428fd7b-c4ab-4c67-98fc-66e4951042fc", "device": "/dev/xvdb"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:54.979038 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-541dc53f-beab-40c3-82fb-8cf59c5ed810 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:54.979514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35886b43-400e-43d9-897f-9d7e7abd9844 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:54.980486 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35886b43-400e-43d9-897f-9d7e7abd9844 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:54.981832 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35886b43-400e-43d9-897f-9d7e7abd9844 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:54.982415 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35886b43-400e-43d9-897f-9d7e7abd9844 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:55.002043 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-541dc53f-beab-40c3-82fb-8cf59c5ed810 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:55.002690 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-541dc53f-beab-40c3-82fb-8cf59c5ed810 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:55.004078 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-541dc53f-beab-40c3-82fb-8cf59c5ed810 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:55.007613 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-541dc53f-beab-40c3-82fb-8cf59c5ed810 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:55.411958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:55.694604 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-541dc53f-beab-40c3-82fb-8cf59c5ed810 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "POST /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.724925 Jul 12 11:53:55.696195 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 587/1239] 10.222.0.50 () {60 vars in 1322 bytes} [Tue Jul 12 11:53:54 2022] POST /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments => generated 194 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:53:55.731146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9a93720a-fc9e-404d-92c6-9605250fb582 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:55.736222 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9a93720a-fc9e-404d-92c6-9605250fb582 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:55.767821 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9a93720a-fc9e-404d-92c6-9605250fb582 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:55.774974 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9a93720a-fc9e-404d-92c6-9605250fb582 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:55.797475 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9a93720a-fc9e-404d-92c6-9605250fb582 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:55.798629 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9a93720a-fc9e-404d-92c6-9605250fb582 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:55.998545 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-35886b43-400e-43d9-897f-9d7e7abd9844 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:56.020128 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-35886b43-400e-43d9-897f-9d7e7abd9844 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 1.068668 Jul 12 11:53:56.021151 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 653/1240] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:54 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:56.039339 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cd6559aa-479f-4e26-9d45-51f0d78eb5e6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:56.041118 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cd6559aa-479f-4e26-9d45-51f0d78eb5e6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:56.065745 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd6559aa-479f-4e26-9d45-51f0d78eb5e6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:56.066383 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd6559aa-479f-4e26-9d45-51f0d78eb5e6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:56.067597 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd6559aa-479f-4e26-9d45-51f0d78eb5e6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:56.077449 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd6559aa-479f-4e26-9d45-51f0d78eb5e6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:56.250832 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-9a93720a-fc9e-404d-92c6-9605250fb582 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:56.289818 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9a93720a-fc9e-404d-92c6-9605250fb582 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1933 microversion: 2.75 time: 0.590837 Jul 12 11:53:56.291331 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 588/1241] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:55 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1933 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:56.312443 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-084e80da-8bef-4315-9610-892db401808c req-7d6f6d19-a824-46a1-82ba-acef685e8232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c311469b-29d4-4011-b455-8fe3ffd81d3c", "name": "network-vif-plugged", "status": "completed", "tag": "4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:56.332652 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-084e80da-8bef-4315-9610-892db401808c req-7d6f6d19-a824-46a1-82ba-acef685e8232 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:56.333467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-084e80da-8bef-4315-9610-892db401808c req-7d6f6d19-a824-46a1-82ba-acef685e8232 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:56.395707 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-084e80da-8bef-4315-9610-892db401808c req-7d6f6d19-a824-46a1-82ba-acef685e8232 service nova] Creating event network-vif-plugged:4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec for instance c311469b-29d4-4011-b455-8fe3ffd81d3c on n-h1-849104-4 Jul 12 11:53:56.413600 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [req-084e80da-8bef-4315-9610-892db401808c req-7d6f6d19-a824-46a1-82ba-acef685e8232 service nova] Instance c311469b-29d4-4011-b455-8fe3ffd81d3c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849104-4', 'n-h1-849104-4'} {{(pid=125983) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 12 11:53:56.424678 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cd6559aa-479f-4e26-9d45-51f0d78eb5e6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:56.444800 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cd6559aa-479f-4e26-9d45-51f0d78eb5e6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1318 microversion: 2.1 time: 0.421925 Jul 12 11:53:56.455429 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 654/1242] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:56 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:56.457423 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-084e80da-8bef-4315-9610-892db401808c req-7d6f6d19-a824-46a1-82ba-acef685e8232 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150447 Jul 12 11:53:56.460909 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 589/1243] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:56.464691 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4aa7b0d7-7b42-4967-9a2a-b96ca8b2f3b4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:56.465923 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4aa7b0d7-7b42-4967-9a2a-b96ca8b2f3b4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7763fa51-4518-440e-a663-f8dac78f536c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:56.475114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bb92e1d9-a2eb-4b78-ad87-3a9fcf5196c9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:56.480259 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-bb92e1d9-a2eb-4b78-ad87-3a9fcf5196c9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:56.489986 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4aa7b0d7-7b42-4967-9a2a-b96ca8b2f3b4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:56.493766 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4aa7b0d7-7b42-4967-9a2a-b96ca8b2f3b4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:56.495213 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4aa7b0d7-7b42-4967-9a2a-b96ca8b2f3b4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:56.500274 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb92e1d9-a2eb-4b78-ad87-3a9fcf5196c9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:56.501117 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb92e1d9-a2eb-4b78-ad87-3a9fcf5196c9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:56.501540 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4aa7b0d7-7b42-4967-9a2a-b96ca8b2f3b4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:56.501925 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb92e1d9-a2eb-4b78-ad87-3a9fcf5196c9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:56.502355 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb92e1d9-a2eb-4b78-ad87-3a9fcf5196c9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:57.494436 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4aa7b0d7-7b42-4967-9a2a-b96ca8b2f3b4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:57.503436 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4aa7b0d7-7b42-4967-9a2a-b96ca8b2f3b4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c" status: 200 len: 1474 microversion: 2.1 time: 1.055173 Jul 12 11:53:57.505264 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 655/1244] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:56 2022] GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c => generated 1474 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:57.512709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-6bf48644-483b-4504-9c85-8a23f48d8ae9 req-249a51f8-2bc6-4a76-a568-b1fc8d9bc685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1104fd7-f466-4f7c-a7a4-522be44fac3e", "name": "network-vif-deleted", "tag": "73149cc5-5444-4d32-ae0a-bfbf4a70e8f3"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:57.527007 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-6bf48644-483b-4504-9c85-8a23f48d8ae9 req-249a51f8-2bc6-4a76-a568-b1fc8d9bc685 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:57.527852 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-6bf48644-483b-4504-9c85-8a23f48d8ae9 req-249a51f8-2bc6-4a76-a568-b1fc8d9bc685 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:57.542246 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-6bf48644-483b-4504-9c85-8a23f48d8ae9 req-249a51f8-2bc6-4a76-a568-b1fc8d9bc685 service nova] Creating event network-vif-deleted:73149cc5-5444-4d32-ae0a-bfbf4a70e8f3 for instance e1104fd7-f466-4f7c-a7a4-522be44fac3e on n-h1-849104-4 Jul 12 11:53:57.549325 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-6bf48644-483b-4504-9c85-8a23f48d8ae9 req-249a51f8-2bc6-4a76-a568-b1fc8d9bc685 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042521 Jul 12 11:53:57.550591 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 656/1245] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:57.556300 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-b336e22a-3ae5-4b21-a8c8-43168fee19f7 req-6351974b-74ac-4e37-9df3-77f0f686e2ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8de68ee-82f3-4e97-ac78-5be719aa8c6b", "tag": "ee43e19e-89da-41b2-a198-fd95b27a574a"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:57.568079 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b336e22a-3ae5-4b21-a8c8-43168fee19f7 req-6351974b-74ac-4e37-9df3-77f0f686e2ca service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:57.568722 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b336e22a-3ae5-4b21-a8c8-43168fee19f7 req-6351974b-74ac-4e37-9df3-77f0f686e2ca service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:57.582836 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-b336e22a-3ae5-4b21-a8c8-43168fee19f7 req-6351974b-74ac-4e37-9df3-77f0f686e2ca service nova] Creating event network-changed:ee43e19e-89da-41b2-a198-fd95b27a574a for instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b on n-h1-849104-4 Jul 12 11:53:57.589311 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-b336e22a-3ae5-4b21-a8c8-43168fee19f7 req-6351974b-74ac-4e37-9df3-77f0f686e2ca service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037052 Jul 12 11:53:57.590486 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 657/1246] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:57.596846 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c5b59938-6333-41e0-a006-907d4167da80 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92233d38-2590-4bd2-b8da-aed12a9b4620"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:57.598365 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c5b59938-6333-41e0-a006-907d4167da80 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:57.607030 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c5b59938-6333-41e0-a006-907d4167da80 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:57.607661 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c5b59938-6333-41e0-a006-907d4167da80 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:57.608887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c5b59938-6333-41e0-a006-907d4167da80 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:57.610774 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c5b59938-6333-41e0-a006-907d4167da80 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:57.641337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bb92e1d9-a2eb-4b78-ad87-3a9fcf5196c9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:57.653347 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bb92e1d9-a2eb-4b78-ad87-3a9fcf5196c9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1469 microversion: 2.1 time: 1.190763 Jul 12 11:53:57.666027 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 590/1247] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:56 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1469 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:57.668768 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a9b8050a-71a2-462c-99ce-f2251a988863 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:57.670887 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a9b8050a-71a2-462c-99ce-f2251a988863 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:57.696909 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a9b8050a-71a2-462c-99ce-f2251a988863 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:57.698120 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a9b8050a-71a2-462c-99ce-f2251a988863 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:57.699838 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a9b8050a-71a2-462c-99ce-f2251a988863 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:57.701009 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a9b8050a-71a2-462c-99ce-f2251a988863 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:58.235312 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c5b59938-6333-41e0-a006-907d4167da80 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "POST /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.642442 Jul 12 11:53:58.272427 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 658/1248] 10.222.0.50 () {60 vars in 1322 bytes} [Tue Jul 12 11:53:57 2022] POST /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64/os-volume_attachments => generated 194 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:58.340576 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f8ff65c1-557b-4b8f-861a-6d3ceb1d7286 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:58.341300 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f8ff65c1-557b-4b8f-861a-6d3ceb1d7286 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:58.378470 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8ff65c1-557b-4b8f-861a-6d3ceb1d7286 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:58.379066 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8ff65c1-557b-4b8f-861a-6d3ceb1d7286 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:58.380921 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8ff65c1-557b-4b8f-861a-6d3ceb1d7286 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:58.386165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f8ff65c1-557b-4b8f-861a-6d3ceb1d7286 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:58.596586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-f8ff65c1-557b-4b8f-861a-6d3ceb1d7286 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] Lazy-loading 'services' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:53:58.650945 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f8ff65c1-557b-4b8f-861a-6d3ceb1d7286 tempest-ServersAdmin275Test-557654538 tempest-ServersAdmin275Test-557654538-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1918 microversion: 2.75 time: 0.374346 Jul 12 11:53:58.651958 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 659/1249] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:58 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1918 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:58.660719 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fc970c20-5d3b-41aa-bded-8f835cfdb1f3 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:58.661896 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fc970c20-5d3b-41aa-bded-8f835cfdb1f3 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:58.692124 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc970c20-5d3b-41aa-bded-8f835cfdb1f3 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:58.695310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc970c20-5d3b-41aa-bded-8f835cfdb1f3 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:58.697013 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc970c20-5d3b-41aa-bded-8f835cfdb1f3 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:58.697568 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc970c20-5d3b-41aa-bded-8f835cfdb1f3 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:58.897712 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fc970c20-5d3b-41aa-bded-8f835cfdb1f3 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:58.907133 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fc970c20-5d3b-41aa-bded-8f835cfdb1f3 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1318 microversion: 2.1 time: 0.251450 Jul 12 11:53:58.917973 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 660/1250] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:58 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:58.933554 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1a59845e-a9aa-4f71-b2b9-b3bf115f9a9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:58.935034 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1a59845e-a9aa-4f71-b2b9-b3bf115f9a9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7763fa51-4518-440e-a663-f8dac78f536c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:58.943551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1a59845e-a9aa-4f71-b2b9-b3bf115f9a9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:58.944394 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1a59845e-a9aa-4f71-b2b9-b3bf115f9a9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:58.945679 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1a59845e-a9aa-4f71-b2b9-b3bf115f9a9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:58.946415 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1a59845e-a9aa-4f71-b2b9-b3bf115f9a9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:59.034872 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1a59845e-a9aa-4f71-b2b9-b3bf115f9a9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:59.037973 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:59.048249 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1a59845e-a9aa-4f71-b2b9-b3bf115f9a9b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c" status: 200 len: 1432 microversion: 2.1 time: 0.120405 Jul 12 11:53:59.048910 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 661/1251] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:58 2022] GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c => generated 1432 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:59.058598 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d95c5cfd-c97d-4ec5-b900-f9a98cf55dda tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:59.058598 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d95c5cfd-c97d-4ec5-b900-f9a98cf55dda tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:59.064693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d95c5cfd-c97d-4ec5-b900-f9a98cf55dda tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:59.064994 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d95c5cfd-c97d-4ec5-b900-f9a98cf55dda tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:59.065952 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d95c5cfd-c97d-4ec5-b900-f9a98cf55dda tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:59.066502 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d95c5cfd-c97d-4ec5-b900-f9a98cf55dda tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:59.099207 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a9b8050a-71a2-462c-99ce-f2251a988863 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:59.116518 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a9b8050a-71a2-462c-99ce-f2251a988863 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 1.457808 Jul 12 11:53:59.117794 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 591/1252] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:57 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:59.124879 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b2123ee2-3a31-4d38-a15e-75aead181be4 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:59.125798 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b2123ee2-3a31-4d38-a15e-75aead181be4 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:59.133399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b2123ee2-3a31-4d38-a15e-75aead181be4 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:59.134247 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b2123ee2-3a31-4d38-a15e-75aead181be4 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:59.135294 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b2123ee2-3a31-4d38-a15e-75aead181be4 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:59.135959 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b2123ee2-3a31-4d38-a15e-75aead181be4 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:59.196952 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b2123ee2-3a31-4d38-a15e-75aead181be4 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:53:59.357066 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d95c5cfd-c97d-4ec5-b900-f9a98cf55dda tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:59.373537 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d95c5cfd-c97d-4ec5-b900-f9a98cf55dda tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1469 microversion: 2.1 time: 0.319306 Jul 12 11:53:59.377688 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 662/1253] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:59 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1469 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:53:59.395826 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b2123ee2-3a31-4d38-a15e-75aead181be4 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 204 len: 0 microversion: 2.75 time: 0.275764 Jul 12 11:53:59.396821 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 592/1254] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 11:53:59 2022] DELETE /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 11:53:59.409368 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-828b1be0-3533-4c51-93f2-8941d7b655f2 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:59.411187 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-828b1be0-3533-4c51-93f2-8941d7b655f2 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:59.426336 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-828b1be0-3533-4c51-93f2-8941d7b655f2 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:59.426861 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-828b1be0-3533-4c51-93f2-8941d7b655f2 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:59.429794 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-828b1be0-3533-4c51-93f2-8941d7b655f2 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:59.431870 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-828b1be0-3533-4c51-93f2-8941d7b655f2 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:59.473495 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-a89e8289-0a1f-4ab1-96d9-93f038c42f4e req-5edabc02-ab81-419a-8b07-9c79f769e90a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f300ccc7-18ee-45d7-8d82-a23ddff013eb", "name": "network-vif-plugged", "status": "completed", "tag": "b51cdaef-49cb-475a-aa61-b858be6b5ca0"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:59.529001 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-a89e8289-0a1f-4ab1-96d9-93f038c42f4e req-5edabc02-ab81-419a-8b07-9c79f769e90a service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:59.530150 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-a89e8289-0a1f-4ab1-96d9-93f038c42f4e req-5edabc02-ab81-419a-8b07-9c79f769e90a service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:59.568381 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-a89e8289-0a1f-4ab1-96d9-93f038c42f4e req-5edabc02-ab81-419a-8b07-9c79f769e90a service nova] Creating event network-vif-plugged:b51cdaef-49cb-475a-aa61-b858be6b5ca0 for instance f300ccc7-18ee-45d7-8d82-a23ddff013eb on n-h2-849104-4 Jul 12 11:53:59.597633 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-a89e8289-0a1f-4ab1-96d9-93f038c42f4e req-5edabc02-ab81-419a-8b07-9c79f769e90a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142841 Jul 12 11:53:59.599975 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 593/1255] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:59.644820 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-828b1be0-3533-4c51-93f2-8941d7b655f2 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:59.658842 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-828b1be0-3533-4c51-93f2-8941d7b655f2 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:59.661425 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-828b1be0-3533-4c51-93f2-8941d7b655f2 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:53:59.668765 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-828b1be0-3533-4c51-93f2-8941d7b655f2 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1443 microversion: 2.75 time: 0.267456 Jul 12 11:53:59.669922 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 663/1256] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:53:59 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1443 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:53:59.704778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-32102bf5-81ed-407f-bc97-43385f3a4d9c req-f7331e94-4c56-4e73-bd5b-264b81f6bf67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7763fa51-4518-440e-a663-f8dac78f536c", "name": "network-vif-deleted", "tag": "d73d1c16-b3a0-4956-9a0d-4f206660a263"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:53:59.717019 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:53:59.720329 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-32102bf5-81ed-407f-bc97-43385f3a4d9c req-f7331e94-4c56-4e73-bd5b-264b81f6bf67 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:59.720953 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-32102bf5-81ed-407f-bc97-43385f3a4d9c req-f7331e94-4c56-4e73-bd5b-264b81f6bf67 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:59.737520 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-32102bf5-81ed-407f-bc97-43385f3a4d9c req-f7331e94-4c56-4e73-bd5b-264b81f6bf67 service nova] Creating event network-vif-deleted:d73d1c16-b3a0-4956-9a0d-4f206660a263 for instance 7763fa51-4518-440e-a663-f8dac78f536c on n-h2-849104-4 Jul 12 11:53:59.743489 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-32102bf5-81ed-407f-bc97-43385f3a4d9c req-f7331e94-4c56-4e73-bd5b-264b81f6bf67 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042659 Jul 12 11:53:59.744668 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 594/1257] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:53:59.927858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5e9710b8-b224-4dce-91bc-9d00af1a50b1 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:53:59.928760 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5e9710b8-b224-4dce-91bc-9d00af1a50b1 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:53:59.942547 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5e9710b8-b224-4dce-91bc-9d00af1a50b1 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:59.943327 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5e9710b8-b224-4dce-91bc-9d00af1a50b1 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:53:59.945508 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5e9710b8-b224-4dce-91bc-9d00af1a50b1 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:53:59.946155 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5e9710b8-b224-4dce-91bc-9d00af1a50b1 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:00.067116 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-dd52fa5c-1422-4796-8e12-bd542014cada tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:00.067814 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-dd52fa5c-1422-4796-8e12-bd542014cada tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7763fa51-4518-440e-a663-f8dac78f536c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:00.088235 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dd52fa5c-1422-4796-8e12-bd542014cada tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:00.088935 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dd52fa5c-1422-4796-8e12-bd542014cada tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:00.090774 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dd52fa5c-1422-4796-8e12-bd542014cada tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:00.091625 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dd52fa5c-1422-4796-8e12-bd542014cada tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:00.161347 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dd52fa5c-1422-4796-8e12-bd542014cada tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:00.162016 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dd52fa5c-1422-4796-8e12-bd542014cada tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:00.162397 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-dd52fa5c-1422-4796-8e12-bd542014cada tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lazy-loading 'fault' on Instance uuid 7763fa51-4518-440e-a663-f8dac78f536c {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:54:00.267595 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-dd52fa5c-1422-4796-8e12-bd542014cada tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:00.279932 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-dd52fa5c-1422-4796-8e12-bd542014cada tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c" status: 200 len: 1308 microversion: 2.1 time: 0.216873 Jul 12 11:54:00.294988 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 595/1258] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:00 2022] GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c => generated 1308 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:00.294988 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cee47c90-f52f-47bf-9af4-389badf4bbd3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:00.294988 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cee47c90-f52f-47bf-9af4-389badf4bbd3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:00.295499 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cee47c90-f52f-47bf-9af4-389badf4bbd3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:00.296333 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cee47c90-f52f-47bf-9af4-389badf4bbd3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:00.297158 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cee47c90-f52f-47bf-9af4-389badf4bbd3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:00.297885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cee47c90-f52f-47bf-9af4-389badf4bbd3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:00.339592 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5e9710b8-b224-4dce-91bc-9d00af1a50b1 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:00.350627 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5e9710b8-b224-4dce-91bc-9d00af1a50b1 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1318 microversion: 2.1 time: 0.429068 Jul 12 11:54:00.351466 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 664/1259] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:53:59 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:00.394881 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-490910a4-d954-43ab-982b-f00b639f4fcc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:00.395573 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-490910a4-d954-43ab-982b-f00b639f4fcc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:00.406296 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-490910a4-d954-43ab-982b-f00b639f4fcc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:00.407122 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-490910a4-d954-43ab-982b-f00b639f4fcc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:00.408309 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-490910a4-d954-43ab-982b-f00b639f4fcc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:00.409308 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-490910a4-d954-43ab-982b-f00b639f4fcc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:00.580416 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-cee47c90-f52f-47bf-9af4-389badf4bbd3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:00.591841 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cee47c90-f52f-47bf-9af4-389badf4bbd3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.309666 Jul 12 11:54:00.593029 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 596/1260] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:00 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:00.608720 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-490910a4-d954-43ab-982b-f00b639f4fcc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:00.616750 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-490910a4-d954-43ab-982b-f00b639f4fcc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1469 microversion: 2.1 time: 0.225978 Jul 12 11:54:00.617806 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 665/1261] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:00 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1469 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:00.695578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-94cfcd65-6d39-47b2-823d-94930186e316 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:00.697550 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-94cfcd65-6d39-47b2-823d-94930186e316 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:00.708436 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-94cfcd65-6d39-47b2-823d-94930186e316 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:00.709138 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-94cfcd65-6d39-47b2-823d-94930186e316 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:00.710681 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-94cfcd65-6d39-47b2-823d-94930186e316 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:00.711367 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-94cfcd65-6d39-47b2-823d-94930186e316 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:01.002996 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-94cfcd65-6d39-47b2-823d-94930186e316 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:01.014645 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-94cfcd65-6d39-47b2-823d-94930186e316 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:01.016295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-94cfcd65-6d39-47b2-823d-94930186e316 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:01.062956 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-94cfcd65-6d39-47b2-823d-94930186e316 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1443 microversion: 2.75 time: 0.363228 Jul 12 11:54:01.080484 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 597/1262] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:54:00 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1443 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:54:01.305546 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7ba5d0a5-fdc2-4cb8-9fd4-7bc8bdb29b2b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:01.308025 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7ba5d0a5-fdc2-4cb8-9fd4-7bc8bdb29b2b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 7763fa51-4518-440e-a663-f8dac78f536c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:01.323775 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ba5d0a5-fdc2-4cb8-9fd4-7bc8bdb29b2b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:01.324290 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ba5d0a5-fdc2-4cb8-9fd4-7bc8bdb29b2b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:01.325104 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ba5d0a5-fdc2-4cb8-9fd4-7bc8bdb29b2b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:01.325553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ba5d0a5-fdc2-4cb8-9fd4-7bc8bdb29b2b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:01.347220 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-7ba5d0a5-fdc2-4cb8-9fd4-7bc8bdb29b2b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] HTTP exception thrown: Instance 7763fa51-4518-440e-a663-f8dac78f536c could not be found. Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7ba5d0a5-fdc2-4cb8-9fd4-7bc8bdb29b2b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Request method failure captured: Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c HTTP/1.1 Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWAIsAjWusJZqZTqO-T5k7sF3XVQ_BVMWkgLAmSdn_h1MRycYbdcU7cykB4uGTStunIOo5ApPn465SO0jjUMYRsZwApvmb-AO14yFiVrUNdkrYxS017oV-XNhYB9rF-oG05Xyetaq0ERBw2wHAO_zCDvGtPTgwRLhQcDsw5foMYdahY Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/810246cfc801446599831d243d3a48dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_810246cfc801446599831d243d3a48dd", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 3e7eb4c715f04ea791384bcde9844fa7 Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 7763fa51-4518-440e-a663-f8dac78f536c could not be found. Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '7763fa51-4518-440e-a663-f8dac78f536c'} Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7763fa51-4518-440e-a663-f8dac78f536c could not be found. Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7763fa51-4518-440e-a663-f8dac78f536c could not be found. Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:01.349256 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:01.356883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:01.356883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:01.356883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:01.356883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:01.356883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:01.356883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7763fa51-4518-440e-a663-f8dac78f536c could not be found. Jul 12 11:54:01.356883 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:01.356883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7ba5d0a5-fdc2-4cb8-9fd4-7bc8bdb29b2b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Returning 404 to user: Instance 7763fa51-4518-440e-a663-f8dac78f536c could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:01.356883 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7ba5d0a5-fdc2-4cb8-9fd4-7bc8bdb29b2b tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c" status: 404 len: 111 microversion: 2.1 time: 0.052844 Jul 12 11:54:01.360840 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 666/1263] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:01 2022] GET /compute/v2.1/servers/7763fa51-4518-440e-a663-f8dac78f536c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:01.371149 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-212d74f2-ee5b-4966-878a-4c573d59767e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:01.372645 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-212d74f2-ee5b-4966-878a-4c573d59767e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: e1104fd7-f466-4f7c-a7a4-522be44fac3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:01.375244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-24d0ad9c-5ec3-4d2c-b8ac-a357a6abce67 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:01.375949 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-24d0ad9c-5ec3-4d2c-b8ac-a357a6abce67 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:01.381910 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-212d74f2-ee5b-4966-878a-4c573d59767e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:01.383061 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-212d74f2-ee5b-4966-878a-4c573d59767e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:01.384655 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24d0ad9c-5ec3-4d2c-b8ac-a357a6abce67 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:01.384994 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-212d74f2-ee5b-4966-878a-4c573d59767e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:01.385190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24d0ad9c-5ec3-4d2c-b8ac-a357a6abce67 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:01.386055 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-212d74f2-ee5b-4966-878a-4c573d59767e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:01.386205 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24d0ad9c-5ec3-4d2c-b8ac-a357a6abce67 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:01.386708 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24d0ad9c-5ec3-4d2c-b8ac-a357a6abce67 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:01.430495 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-212d74f2-ee5b-4966-878a-4c573d59767e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] HTTP exception thrown: Instance e1104fd7-f466-4f7c-a7a4-522be44fac3e could not be found. Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-212d74f2-ee5b-4966-878a-4c573d59767e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Request method failure captured: Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e HTTP/1.1 Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWAIsAjWusJZqZTqO-T5k7sF3XVQ_BVMWkgLAmSdn_h1MRycYbdcU7cykB4uGTStunIOo5ApPn465SO0jjUMYRsZwApvmb-AO14yFiVrUNdkrYxS017oV-XNhYB9rF-oG05Xyetaq0ERBw2wHAO_zCDvGtPTgwRLhQcDsw5foMYdahY Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/810246cfc801446599831d243d3a48dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_810246cfc801446599831d243d3a48dd", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 3e7eb4c715f04ea791384bcde9844fa7 Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance e1104fd7-f466-4f7c-a7a4-522be44fac3e could not be found. Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'e1104fd7-f466-4f7c-a7a4-522be44fac3e'} Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1104fd7-f466-4f7c-a7a4-522be44fac3e could not be found. Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1104fd7-f466-4f7c-a7a4-522be44fac3e could not be found. Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:01.436292 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:01.444595 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:01.444595 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:01.444595 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:01.444595 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:01.444595 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:01.444595 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1104fd7-f466-4f7c-a7a4-522be44fac3e could not be found. Jul 12 11:54:01.444595 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:01.448843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-212d74f2-ee5b-4966-878a-4c573d59767e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Returning 404 to user: Instance e1104fd7-f466-4f7c-a7a4-522be44fac3e could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:01.453181 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-212d74f2-ee5b-4966-878a-4c573d59767e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e" status: 404 len: 111 microversion: 2.1 time: 0.092159 Jul 12 11:54:01.454641 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 598/1264] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:01 2022] GET /compute/v2.1/servers/e1104fd7-f466-4f7c-a7a4-522be44fac3e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:01.467685 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b7c0a7c4-5796-45ce-9b75-2fd949de3746 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:01.515775 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b7c0a7c4-5796-45ce-9b75-2fd949de3746 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/d859ea45-6a4e-4de9-aef3-6a8c9812cb9a" status: 204 len: 0 microversion: 2.1 time: 0.056446 Jul 12 11:54:01.516802 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 599/1265] 10.222.0.50 () {58 vars in 1265 bytes} [Tue Jul 12 11:54:01 2022] DELETE /compute/v2.1/os-server-groups/d859ea45-6a4e-4de9-aef3-6a8c9812cb9a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:54:01.534902 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d8b5e86e-d45f-4c52-9a58-e0685d9cf2be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:01.536176 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d8b5e86e-d45f-4c52-9a58-e0685d9cf2be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 19c7d0ce-ac82-402c-b58a-e62d1f5eb767] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:01.547396 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d8b5e86e-d45f-4c52-9a58-e0685d9cf2be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:01.548645 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d8b5e86e-d45f-4c52-9a58-e0685d9cf2be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:01.550466 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d8b5e86e-d45f-4c52-9a58-e0685d9cf2be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:01.551637 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d8b5e86e-d45f-4c52-9a58-e0685d9cf2be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:01.591421 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d8b5e86e-d45f-4c52-9a58-e0685d9cf2be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 19c7d0ce-ac82-402c-b58a-e62d1f5eb767] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:54:01.735717 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-24d0ad9c-5ec3-4d2c-b8ac-a357a6abce67 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:01.747912 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-24d0ad9c-5ec3-4d2c-b8ac-a357a6abce67 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1318 microversion: 2.1 time: 0.377148 Jul 12 11:54:01.748845 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 667/1266] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:01 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:01.751113 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d8b5e86e-d45f-4c52-9a58-e0685d9cf2be tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "DELETE /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767" status: 204 len: 0 microversion: 2.1 time: 0.228238 Jul 12 11:54:01.752454 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 600/1267] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:54:01 2022] DELETE /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:54:01.760020 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e03f0282-cc7d-4aaf-8bc8-71b454e3dfa1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:01.760984 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e03f0282-cc7d-4aaf-8bc8-71b454e3dfa1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:01.771506 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e03f0282-cc7d-4aaf-8bc8-71b454e3dfa1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:01.771971 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e03f0282-cc7d-4aaf-8bc8-71b454e3dfa1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:01.773057 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e03f0282-cc7d-4aaf-8bc8-71b454e3dfa1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:01.773416 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-69a64999-7a05-4e82-b05d-cd81a0e39f78 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:01.773610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e03f0282-cc7d-4aaf-8bc8-71b454e3dfa1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:01.774784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-69a64999-7a05-4e82-b05d-cd81a0e39f78 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:01.783149 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-69a64999-7a05-4e82-b05d-cd81a0e39f78 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:01.783596 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-69a64999-7a05-4e82-b05d-cd81a0e39f78 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:01.784422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-69a64999-7a05-4e82-b05d-cd81a0e39f78 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:01.785043 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-69a64999-7a05-4e82-b05d-cd81a0e39f78 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:02.000063 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-69a64999-7a05-4e82-b05d-cd81a0e39f78 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:02.023223 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-69a64999-7a05-4e82-b05d-cd81a0e39f78 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.272101 Jul 12 11:54:02.025469 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 668/1268] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:01 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:02.034248 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-b91b2390-da1b-47df-be41-fdef09d1ec9e req-dd654321-da2f-4feb-85f4-77b79c66d479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8de68ee-82f3-4e97-ac78-5be719aa8c6b", "tag": "99a0b5ce-e578-495f-b132-8d76185a41b7"}, {"name": "network-changed", "server_uuid": "c8de68ee-82f3-4e97-ac78-5be719aa8c6b", "tag": "e9841222-41fd-4fae-86a1-ee22db4e210f"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:02.053703 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b91b2390-da1b-47df-be41-fdef09d1ec9e req-dd654321-da2f-4feb-85f4-77b79c66d479 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:02.054850 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b91b2390-da1b-47df-be41-fdef09d1ec9e req-dd654321-da2f-4feb-85f4-77b79c66d479 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:02.058101 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e03f0282-cc7d-4aaf-8bc8-71b454e3dfa1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:02.075130 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e03f0282-cc7d-4aaf-8bc8-71b454e3dfa1 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1469 microversion: 2.1 time: 0.320716 Jul 12 11:54:02.086021 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 601/1269] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:01 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1469 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:02.086021 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-35705111-467a-49c7-bad6-3e4ce8096b04 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:02.086021 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-35705111-467a-49c7-bad6-3e4ce8096b04 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:02.094839 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-b91b2390-da1b-47df-be41-fdef09d1ec9e req-dd654321-da2f-4feb-85f4-77b79c66d479 service nova] Creating event network-changed:99a0b5ce-e578-495f-b132-8d76185a41b7 for instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b on n-h1-849104-4 Jul 12 11:54:02.094839 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-b91b2390-da1b-47df-be41-fdef09d1ec9e req-dd654321-da2f-4feb-85f4-77b79c66d479 service nova] Creating event network-changed:e9841222-41fd-4fae-86a1-ee22db4e210f for instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b on n-h1-849104-4 Jul 12 11:54:02.100471 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-b91b2390-da1b-47df-be41-fdef09d1ec9e req-dd654321-da2f-4feb-85f4-77b79c66d479 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.073508 Jul 12 11:54:02.101115 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 669/1270] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:02.107064 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35705111-467a-49c7-bad6-3e4ce8096b04 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:02.111069 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35705111-467a-49c7-bad6-3e4ce8096b04 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:02.111995 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-50046496-137a-41c4-a512-c260d22b9af9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:02.112741 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-50046496-137a-41c4-a512-c260d22b9af9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:02.113929 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35705111-467a-49c7-bad6-3e4ce8096b04 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:02.115009 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35705111-467a-49c7-bad6-3e4ce8096b04 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:02.120759 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-50046496-137a-41c4-a512-c260d22b9af9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:02.121217 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-50046496-137a-41c4-a512-c260d22b9af9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:02.122463 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-50046496-137a-41c4-a512-c260d22b9af9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:02.123196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-50046496-137a-41c4-a512-c260d22b9af9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:02.158572 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-35705111-467a-49c7-bad6-3e4ce8096b04 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:54:02.176686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:02.203240 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-50046496-137a-41c4-a512-c260d22b9af9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:02.211945 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-50046496-137a-41c4-a512-c260d22b9af9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:02.213994 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-50046496-137a-41c4-a512-c260d22b9af9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:02.221726 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-50046496-137a-41c4-a512-c260d22b9af9 tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1443 microversion: 2.75 time: 0.115196 Jul 12 11:54:02.222903 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 670/1271] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:54:02 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1443 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:54:02.268938 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-35705111-467a-49c7-bad6-3e4ce8096b04 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e" status: 204 len: 0 microversion: 2.1 time: 0.191177 Jul 12 11:54:02.270008 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 602/1272] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:54:02 2022] DELETE /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:54:02.277850 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-64123753-c6bc-4f68-8731-6999c46b9690 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:02.278575 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-64123753-c6bc-4f68-8731-6999c46b9690 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 19c7d0ce-ac82-402c-b58a-e62d1f5eb767] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:02.284967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-64123753-c6bc-4f68-8731-6999c46b9690 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:02.285411 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-64123753-c6bc-4f68-8731-6999c46b9690 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:02.286190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-64123753-c6bc-4f68-8731-6999c46b9690 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:02.286626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-64123753-c6bc-4f68-8731-6999c46b9690 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:02.440668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-64123753-c6bc-4f68-8731-6999c46b9690 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:02.448628 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-64123753-c6bc-4f68-8731-6999c46b9690 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767" status: 200 len: 1474 microversion: 2.1 time: 0.174591 Jul 12 11:54:02.449243 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 671/1273] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:02 2022] GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767 => generated 1474 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:02.779844 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a82da366-fd29-47ce-b3bc-adc39aaca49a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:02.782110 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a82da366-fd29-47ce-b3bc-adc39aaca49a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:02.794647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a82da366-fd29-47ce-b3bc-adc39aaca49a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:02.795395 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a82da366-fd29-47ce-b3bc-adc39aaca49a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:02.796610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a82da366-fd29-47ce-b3bc-adc39aaca49a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:02.797170 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a82da366-fd29-47ce-b3bc-adc39aaca49a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:03.011115 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a82da366-fd29-47ce-b3bc-adc39aaca49a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:03.021352 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a82da366-fd29-47ce-b3bc-adc39aaca49a tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1318 microversion: 2.1 time: 0.250556 Jul 12 11:54:03.021934 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 603/1274] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:02 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:03.042719 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-613c3af8-7ad6-4197-885b-ca4ea68fffb1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:03.043466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-613c3af8-7ad6-4197-885b-ca4ea68fffb1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:03.050844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-613c3af8-7ad6-4197-885b-ca4ea68fffb1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:03.051347 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-613c3af8-7ad6-4197-885b-ca4ea68fffb1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:03.052379 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-613c3af8-7ad6-4197-885b-ca4ea68fffb1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:03.052757 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-613c3af8-7ad6-4197-885b-ca4ea68fffb1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:03.099992 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-91abc085-fc8d-4e09-a481-2bfa14987c59 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:03.100666 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-91abc085-fc8d-4e09-a481-2bfa14987c59 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:03.108784 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-91abc085-fc8d-4e09-a481-2bfa14987c59 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:03.109391 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-91abc085-fc8d-4e09-a481-2bfa14987c59 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:03.110498 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-91abc085-fc8d-4e09-a481-2bfa14987c59 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:03.111057 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-91abc085-fc8d-4e09-a481-2bfa14987c59 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:03.294041 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-613c3af8-7ad6-4197-885b-ca4ea68fffb1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:03.304664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-91abc085-fc8d-4e09-a481-2bfa14987c59 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:03.304916 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-613c3af8-7ad6-4197-885b-ca4ea68fffb1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.267439 Jul 12 11:54:03.305509 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 672/1275] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:03 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:03.311544 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-69afc186-0e6f-4e99-b78c-b3e1afc6a64a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:03.312554 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-69afc186-0e6f-4e99-b78c-b3e1afc6a64a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:03.314947 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-91abc085-fc8d-4e09-a481-2bfa14987c59 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1535 microversion: 2.1 time: 0.219457 Jul 12 11:54:03.315618 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 604/1276] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:03 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1535 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:03.321748 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-69afc186-0e6f-4e99-b78c-b3e1afc6a64a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:03.322657 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-69afc186-0e6f-4e99-b78c-b3e1afc6a64a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:03.324149 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-69afc186-0e6f-4e99-b78c-b3e1afc6a64a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:03.325263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-69afc186-0e6f-4e99-b78c-b3e1afc6a64a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:03.394341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-69afc186-0e6f-4e99-b78c-b3e1afc6a64a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:03.395269 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-69afc186-0e6f-4e99-b78c-b3e1afc6a64a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:03.396076 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-69afc186-0e6f-4e99-b78c-b3e1afc6a64a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lazy-loading 'fault' on Instance uuid f4fe7f72-85cc-49d4-b1a5-3a6287719724 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:54:03.477331 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-55808a94-257e-40c8-b236-64e7d6f4f8ca tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:03.478085 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-55808a94-257e-40c8-b236-64e7d6f4f8ca tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 19c7d0ce-ac82-402c-b58a-e62d1f5eb767] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:03.479745 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-69afc186-0e6f-4e99-b78c-b3e1afc6a64a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:03.490624 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-69afc186-0e6f-4e99-b78c-b3e1afc6a64a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:03.491756 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55808a94-257e-40c8-b236-64e7d6f4f8ca tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:03.492393 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55808a94-257e-40c8-b236-64e7d6f4f8ca tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:03.493563 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-69afc186-0e6f-4e99-b78c-b3e1afc6a64a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b3ae8187fcb48639945e6c72ec89117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06300144fd974eb3b3003142345c7e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:03.495184 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55808a94-257e-40c8-b236-64e7d6f4f8ca tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:03.497220 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55808a94-257e-40c8-b236-64e7d6f4f8ca tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:03.504468 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-69afc186-0e6f-4e99-b78c-b3e1afc6a64a tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 200 len: 1448 microversion: 2.75 time: 0.197469 Jul 12 11:54:03.507022 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 673/1277] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:54:03 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 1448 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:54:03.668958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c581206c-afe6-431d-afee-36375e6565cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:03.669536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c581206c-afe6-431d-afee-36375e6565cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:03.676925 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c581206c-afe6-431d-afee-36375e6565cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:03.677385 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c581206c-afe6-431d-afee-36375e6565cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:03.678762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c581206c-afe6-431d-afee-36375e6565cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:03.679213 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c581206c-afe6-431d-afee-36375e6565cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:03.715840 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c581206c-afe6-431d-afee-36375e6565cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:54:03.739070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-55808a94-257e-40c8-b236-64e7d6f4f8ca tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:03.748843 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-55808a94-257e-40c8-b236-64e7d6f4f8ca tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767" status: 200 len: 1474 microversion: 2.1 time: 0.278134 Jul 12 11:54:03.749436 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 605/1278] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:03 2022] GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767 => generated 1474 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:03.829727 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c581206c-afe6-431d-afee-36375e6565cb tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "DELETE /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 204 len: 0 microversion: 2.1 time: 0.164931 Jul 12 11:54:03.831346 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 674/1279] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:54:03 2022] DELETE /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:54:03.841510 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-97cc3942-103c-445e-8352-c9866d7e8a29 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:03.845616 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-97cc3942-103c-445e-8352-c9866d7e8a29 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:03.854645 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-97cc3942-103c-445e-8352-c9866d7e8a29 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:03.855346 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-97cc3942-103c-445e-8352-c9866d7e8a29 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:03.856333 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-97cc3942-103c-445e-8352-c9866d7e8a29 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:03.856847 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-97cc3942-103c-445e-8352-c9866d7e8a29 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:04.034936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-5e20a129-6d53-4c37-aa2f-1449465df965 req-313f020b-d346-4374-a5ee-67a6cc14fe3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c311469b-29d4-4011-b455-8fe3ffd81d3c", "name": "network-vif-unplugged", "status": "completed", "tag": "4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:04.042008 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=5 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:04.052914 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-5e20a129-6d53-4c37-aa2f-1449465df965 req-313f020b-d346-4374-a5ee-67a6cc14fe3c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:04.053553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-5e20a129-6d53-4c37-aa2f-1449465df965 req-313f020b-d346-4374-a5ee-67a6cc14fe3c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:04.094804 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-5e20a129-6d53-4c37-aa2f-1449465df965 req-313f020b-d346-4374-a5ee-67a6cc14fe3c service nova] Creating event network-vif-unplugged:4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec for instance c311469b-29d4-4011-b455-8fe3ffd81d3c on n-h2-849104-4 Jul 12 11:54:04.099022 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-97cc3942-103c-445e-8352-c9866d7e8a29 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:04.116615 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [req-5e20a129-6d53-4c37-aa2f-1449465df965 req-313f020b-d346-4374-a5ee-67a6cc14fe3c service nova] Instance c311469b-29d4-4011-b455-8fe3ffd81d3c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849104-4', 'n-h1-849104-4'} {{(pid=125984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 12 11:54:04.124705 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-97cc3942-103c-445e-8352-c9866d7e8a29 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1715 microversion: 2.1 time: 0.284590 Jul 12 11:54:04.129158 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 606/1280] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:03 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1715 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:04.142558 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e230122c-d768-476b-8831-026dd7e9c1e9 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:04.143189 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e230122c-d768-476b-8831-026dd7e9c1e9 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:04.145273 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-5e20a129-6d53-4c37-aa2f-1449465df965 req-313f020b-d346-4374-a5ee-67a6cc14fe3c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115652 Jul 12 11:54:04.146281 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 675/1281] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:54:04.152507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e230122c-d768-476b-8831-026dd7e9c1e9 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:04.152980 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e230122c-d768-476b-8831-026dd7e9c1e9 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:04.153787 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e230122c-d768-476b-8831-026dd7e9c1e9 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:04.154233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e230122c-d768-476b-8831-026dd7e9c1e9 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:04.324856 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dba60ab8-e3c2-421c-b33c-1defc1969628 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:04.326584 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dba60ab8-e3c2-421c-b33c-1defc1969628 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:04.339493 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dba60ab8-e3c2-421c-b33c-1defc1969628 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:04.339932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dba60ab8-e3c2-421c-b33c-1defc1969628 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:04.340686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dba60ab8-e3c2-421c-b33c-1defc1969628 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:04.341265 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dba60ab8-e3c2-421c-b33c-1defc1969628 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:04.754102 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e230122c-d768-476b-8831-026dd7e9c1e9 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:04.775478 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e230122c-d768-476b-8831-026dd7e9c1e9 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1509 microversion: 2.1 time: 0.645487 Jul 12 11:54:04.776773 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 607/1282] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:04 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1509 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:04.785508 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0b39fdfa-1d39-4b42-912c-3db49ea74607 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:04.792453 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0b39fdfa-1d39-4b42-912c-3db49ea74607 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:04.801319 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dba60ab8-e3c2-421c-b33c-1defc1969628 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:04.815316 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dba60ab8-e3c2-421c-b33c-1defc1969628 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.496473 Jul 12 11:54:04.816438 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 676/1283] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:04 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:04.822852 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0b39fdfa-1d39-4b42-912c-3db49ea74607 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:04.823432 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1cf61990-2dfb-47f2-b3f8-f76a4fdcafdb tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:04.824076 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0b39fdfa-1d39-4b42-912c-3db49ea74607 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:04.825780 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1cf61990-2dfb-47f2-b3f8-f76a4fdcafdb tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] [instance: f4fe7f72-85cc-49d4-b1a5-3a6287719724] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:04.826685 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0b39fdfa-1d39-4b42-912c-3db49ea74607 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:04.827291 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0b39fdfa-1d39-4b42-912c-3db49ea74607 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:04.846283 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1cf61990-2dfb-47f2-b3f8-f76a4fdcafdb tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:04.846764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1cf61990-2dfb-47f2-b3f8-f76a4fdcafdb tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:04.848494 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1cf61990-2dfb-47f2-b3f8-f76a4fdcafdb tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:04.848494 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1cf61990-2dfb-47f2-b3f8-f76a4fdcafdb tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-1cf61990-2dfb-47f2-b3f8-f76a4fdcafdb tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] HTTP exception thrown: Instance f4fe7f72-85cc-49d4-b1a5-3a6287719724 could not be found. Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1cf61990-2dfb-47f2-b3f8-f76a4fdcafdb tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Request method failure captured: Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 HTTP/1.1 Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWBiXtid-uxE8ZAiGd1Gt0R9oOkHW_ef9Sk6IchhbrL2WHKjwCPkkYGuWC_kpfA9Hc4xU1B3rXs3b3IG-9ypnRdmiIRv_BTEumMBnYVEN8I-97U2N0UPpU9boYQtV6jgKvhgBbPVx0fwLqiimbwckT6pT7gsNm2bnfkMobYOc7AZSa0 Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Openstack-Nova-Api-Version: 2.75 Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 06300144fd974eb3b3003142345c7e07 Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersAdmin275Test-719895639 Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/06300144fd974eb3b3003142345c7e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/06300144fd974eb3b3003142345c7e07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/06300144fd974eb3b3003142345c7e07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_06300144fd974eb3b3003142345c7e07", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersAdmin275Test-719895639 Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 06300144fd974eb3b3003142345c7e07 Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersAdmin275Test-719895639 Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersAdmin275Test-719895639-project Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0b3ae8187fcb48639945e6c72ec89117 Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersAdmin275Test-719895639-project Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance f4fe7f72-85cc-49d4-b1a5-3a6287719724 could not be found. Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'f4fe7f72-85cc-49d4-b1a5-3a6287719724'} Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4fe7f72-85cc-49d4-b1a5-3a6287719724 could not be found. Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:04.881118 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:04.890305 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4fe7f72-85cc-49d4-b1a5-3a6287719724 could not be found. Jul 12 11:54:04.890305 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:04.890305 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:04.890305 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:04.890305 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:04.890305 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:04.890305 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:04.890305 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:04.890305 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:04.890305 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4fe7f72-85cc-49d4-b1a5-3a6287719724 could not be found. Jul 12 11:54:04.890305 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:04.890305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1cf61990-2dfb-47f2-b3f8-f76a4fdcafdb tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] Returning 404 to user: Instance f4fe7f72-85cc-49d4-b1a5-3a6287719724 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:04.890305 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1cf61990-2dfb-47f2-b3f8-f76a4fdcafdb tempest-ServersAdmin275Test-719895639 tempest-ServersAdmin275Test-719895639-project] 10.222.0.50 "GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724" status: 404 len: 111 microversion: 2.75 time: 0.064169 Jul 12 11:54:04.890305 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 677/1284] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:54:04 2022] GET /compute/v2.1/servers/f4fe7f72-85cc-49d4-b1a5-3a6287719724 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:54:04.901142 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-79f05e50-7d4d-49c8-b4c5-edcd7a9f19d4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:04.901654 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-79f05e50-7d4d-49c8-b4c5-edcd7a9f19d4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 19c7d0ce-ac82-402c-b58a-e62d1f5eb767] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:04.917381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-79f05e50-7d4d-49c8-b4c5-edcd7a9f19d4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:04.918083 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-79f05e50-7d4d-49c8-b4c5-edcd7a9f19d4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:04.921183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-79f05e50-7d4d-49c8-b4c5-edcd7a9f19d4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:04.921663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-79f05e50-7d4d-49c8-b4c5-edcd7a9f19d4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:05.270103 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-79f05e50-7d4d-49c8-b4c5-edcd7a9f19d4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:05.272347 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:05.275743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0b39fdfa-1d39-4b42-912c-3db49ea74607 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:05.280470 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-79f05e50-7d4d-49c8-b4c5-edcd7a9f19d4 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767" status: 200 len: 1474 microversion: 2.1 time: 0.396773 Jul 12 11:54:05.281084 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 678/1285] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:04 2022] GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767 => generated 1474 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:05.289118 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0b39fdfa-1d39-4b42-912c-3db49ea74607 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1535 microversion: 2.1 time: 0.510457 Jul 12 11:54:05.294998 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 608/1286] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:04 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1535 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:05.306190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c971180b-dc6d-4a9d-9f30-86a0cf5424ef tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:05.306190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c971180b-dc6d-4a9d-9f30-86a0cf5424ef tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:05.317288 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c971180b-dc6d-4a9d-9f30-86a0cf5424ef tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:05.317810 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c971180b-dc6d-4a9d-9f30-86a0cf5424ef tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:05.319091 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c971180b-dc6d-4a9d-9f30-86a0cf5424ef tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:05.319631 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c971180b-dc6d-4a9d-9f30-86a0cf5424ef tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:05.839899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2b4d4053-0a99-4031-84f6-a5cc46acbcab tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:05.840860 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2b4d4053-0a99-4031-84f6-a5cc46acbcab tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:05.860341 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2b4d4053-0a99-4031-84f6-a5cc46acbcab tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:05.861100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2b4d4053-0a99-4031-84f6-a5cc46acbcab tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:05.862124 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2b4d4053-0a99-4031-84f6-a5cc46acbcab tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:05.862758 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2b4d4053-0a99-4031-84f6-a5cc46acbcab tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:05.949425 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c971180b-dc6d-4a9d-9f30-86a0cf5424ef tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:05.962681 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c971180b-dc6d-4a9d-9f30-86a0cf5424ef tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1715 microversion: 2.1 time: 0.658333 Jul 12 11:54:05.963664 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 679/1287] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:05 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1715 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:05.977684 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-8616be24-872e-4ce8-a897-22b65e6e4fc7 req-7190564a-8367-4cb3-b905-ec2ad71b5a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c7d0ce-ac82-402c-b58a-e62d1f5eb767", "name": "network-vif-deleted", "tag": "07eed80d-641f-4b46-953e-3bb05cb86283"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:06.005932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-8616be24-872e-4ce8-a897-22b65e6e4fc7 req-7190564a-8367-4cb3-b905-ec2ad71b5a26 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:06.006819 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-8616be24-872e-4ce8-a897-22b65e6e4fc7 req-7190564a-8367-4cb3-b905-ec2ad71b5a26 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:06.042353 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-8616be24-872e-4ce8-a897-22b65e6e4fc7 req-7190564a-8367-4cb3-b905-ec2ad71b5a26 service nova] Creating event network-vif-deleted:07eed80d-641f-4b46-953e-3bb05cb86283 for instance 19c7d0ce-ac82-402c-b58a-e62d1f5eb767 on n-h1-849104-4 Jul 12 11:54:06.066990 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-8616be24-872e-4ce8-a897-22b65e6e4fc7 req-7190564a-8367-4cb3-b905-ec2ad71b5a26 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094977 Jul 12 11:54:06.067730 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 680/1288] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:06.189821 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-9c615ceb-e361-47a7-b8a8-314a5d09acc5 req-7040d294-923d-4b78-bc04-31b50440dfae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c311469b-29d4-4011-b455-8fe3ffd81d3c", "tag": "4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec"}, {"server_uuid": "ab6f463a-4dd8-4d96-9092-f41f16f1e13e", "name": "network-vif-deleted", "tag": "a41f8d53-2f24-43d5-b2b8-7a611037f182"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:06.206492 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-9c615ceb-e361-47a7-b8a8-314a5d09acc5 req-7040d294-923d-4b78-bc04-31b50440dfae service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:06.206964 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-9c615ceb-e361-47a7-b8a8-314a5d09acc5 req-7040d294-923d-4b78-bc04-31b50440dfae service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:06.235508 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-9c615ceb-e361-47a7-b8a8-314a5d09acc5 req-7040d294-923d-4b78-bc04-31b50440dfae service nova] Creating event network-changed:4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec for instance c311469b-29d4-4011-b455-8fe3ffd81d3c on n-h2-849104-4 Jul 12 11:54:06.236067 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-9c615ceb-e361-47a7-b8a8-314a5d09acc5 req-7040d294-923d-4b78-bc04-31b50440dfae service nova] Creating event network-vif-deleted:a41f8d53-2f24-43d5-b2b8-7a611037f182 for instance ab6f463a-4dd8-4d96-9092-f41f16f1e13e on n-h1-849104-4 Jul 12 11:54:06.243631 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [req-9c615ceb-e361-47a7-b8a8-314a5d09acc5 req-7040d294-923d-4b78-bc04-31b50440dfae service nova] Instance c311469b-29d4-4011-b455-8fe3ffd81d3c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849104-4', 'n-h1-849104-4'} {{(pid=125984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 12 11:54:06.272502 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-9c615ceb-e361-47a7-b8a8-314a5d09acc5 req-7040d294-923d-4b78-bc04-31b50440dfae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.093345 Jul 12 11:54:06.277428 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 681/1289] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:06.300796 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-529d19cd-ae41-4287-8891-f487615ebc4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:06.301552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-529d19cd-ae41-4287-8891-f487615ebc4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 19c7d0ce-ac82-402c-b58a-e62d1f5eb767] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:06.322688 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-529d19cd-ae41-4287-8891-f487615ebc4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:06.324089 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-529d19cd-ae41-4287-8891-f487615ebc4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:06.325367 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-529d19cd-ae41-4287-8891-f487615ebc4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:06.326017 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-529d19cd-ae41-4287-8891-f487615ebc4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:06.381142 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-529d19cd-ae41-4287-8891-f487615ebc4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:06.381614 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-529d19cd-ae41-4287-8891-f487615ebc4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:06.382095 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-529d19cd-ae41-4287-8891-f487615ebc4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lazy-loading 'fault' on Instance uuid 19c7d0ce-ac82-402c-b58a-e62d1f5eb767 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:54:06.487275 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-529d19cd-ae41-4287-8891-f487615ebc4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:06.505357 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-529d19cd-ae41-4287-8891-f487615ebc4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767" status: 200 len: 1309 microversion: 2.1 time: 0.206950 Jul 12 11:54:06.506790 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 682/1290] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:06 2022] GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767 => generated 1309 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:06.522846 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0ff4ea61-8370-4c0d-a3fb-a72ba628a368 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:06.526389 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0ff4ea61-8370-4c0d-a3fb-a72ba628a368 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:06.538560 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ff4ea61-8370-4c0d-a3fb-a72ba628a368 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:06.545854 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ff4ea61-8370-4c0d-a3fb-a72ba628a368 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:06.547032 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ff4ea61-8370-4c0d-a3fb-a72ba628a368 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:06.547702 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ff4ea61-8370-4c0d-a3fb-a72ba628a368 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:06.607957 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2b4d4053-0a99-4031-84f6-a5cc46acbcab tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:06.617156 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2b4d4053-0a99-4031-84f6-a5cc46acbcab tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.785937 Jul 12 11:54:06.618626 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 609/1291] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:05 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:06.992707 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-69111189-0404-419c-b532-b4a8fbb40cba tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:06.993556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-69111189-0404-419c-b532-b4a8fbb40cba tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:07.002509 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-69111189-0404-419c-b532-b4a8fbb40cba tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:07.002977 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-69111189-0404-419c-b532-b4a8fbb40cba tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:07.009274 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-69111189-0404-419c-b532-b4a8fbb40cba tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:07.009741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-69111189-0404-419c-b532-b4a8fbb40cba tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:07.307220 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0ff4ea61-8370-4c0d-a3fb-a72ba628a368 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:07.315290 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0ff4ea61-8370-4c0d-a3fb-a72ba628a368 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1535 microversion: 2.1 time: 0.807176 Jul 12 11:54:07.325809 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 683/1292] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:06 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1535 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:07.541662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9a600bac-73bb-428f-bc39-f2c710ab9905 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:07.542882 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9a600bac-73bb-428f-bc39-f2c710ab9905 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: 19c7d0ce-ac82-402c-b58a-e62d1f5eb767] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:07.556633 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9a600bac-73bb-428f-bc39-f2c710ab9905 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:07.557760 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9a600bac-73bb-428f-bc39-f2c710ab9905 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:07.559510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9a600bac-73bb-428f-bc39-f2c710ab9905 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:07.560723 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9a600bac-73bb-428f-bc39-f2c710ab9905 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:07.589520 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-9a600bac-73bb-428f-bc39-f2c710ab9905 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] HTTP exception thrown: Instance 19c7d0ce-ac82-402c-b58a-e62d1f5eb767 could not be found. Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9a600bac-73bb-428f-bc39-f2c710ab9905 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Request method failure captured: Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767 HTTP/1.1 Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWAIsAjWusJZqZTqO-T5k7sF3XVQ_BVMWkgLAmSdn_h1MRycYbdcU7cykB4uGTStunIOo5ApPn465SO0jjUMYRsZwApvmb-AO14yFiVrUNdkrYxS017oV-XNhYB9rF-oG05Xyetaq0ERBw2wHAO_zCDvGtPTgwRLhQcDsw5foMYdahY Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/810246cfc801446599831d243d3a48dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_810246cfc801446599831d243d3a48dd", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 3e7eb4c715f04ea791384bcde9844fa7 Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 19c7d0ce-ac82-402c-b58a-e62d1f5eb767 could not be found. Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '19c7d0ce-ac82-402c-b58a-e62d1f5eb767'} Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c7d0ce-ac82-402c-b58a-e62d1f5eb767 could not be found. Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c7d0ce-ac82-402c-b58a-e62d1f5eb767 could not be found. Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:07.593292 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:07.601748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:07.601748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:07.601748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:07.601748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:07.601748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:07.601748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c7d0ce-ac82-402c-b58a-e62d1f5eb767 could not be found. Jul 12 11:54:07.601748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:07.604888 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9a600bac-73bb-428f-bc39-f2c710ab9905 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Returning 404 to user: Instance 19c7d0ce-ac82-402c-b58a-e62d1f5eb767 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:07.606694 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9a600bac-73bb-428f-bc39-f2c710ab9905 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767" status: 404 len: 111 microversion: 2.1 time: 0.072720 Jul 12 11:54:07.608543 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 684/1293] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:07 2022] GET /compute/v2.1/servers/19c7d0ce-ac82-402c-b58a-e62d1f5eb767 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:07.623199 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2ceb5250-96c2-4319-b3af-f18b20e6352c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:07.623832 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2ceb5250-96c2-4319-b3af-f18b20e6352c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: ab6f463a-4dd8-4d96-9092-f41f16f1e13e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:07.630823 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:07.632874 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2ceb5250-96c2-4319-b3af-f18b20e6352c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:07.633404 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2ceb5250-96c2-4319-b3af-f18b20e6352c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:07.635212 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2ceb5250-96c2-4319-b3af-f18b20e6352c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:07.636011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2ceb5250-96c2-4319-b3af-f18b20e6352c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:07.658735 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-2ceb5250-96c2-4319-b3af-f18b20e6352c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] HTTP exception thrown: Instance ab6f463a-4dd8-4d96-9092-f41f16f1e13e could not be found. Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2ceb5250-96c2-4319-b3af-f18b20e6352c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Request method failure captured: Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e HTTP/1.1 Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWAIsAjWusJZqZTqO-T5k7sF3XVQ_BVMWkgLAmSdn_h1MRycYbdcU7cykB4uGTStunIOo5ApPn465SO0jjUMYRsZwApvmb-AO14yFiVrUNdkrYxS017oV-XNhYB9rF-oG05Xyetaq0ERBw2wHAO_zCDvGtPTgwRLhQcDsw5foMYdahY Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/810246cfc801446599831d243d3a48dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_810246cfc801446599831d243d3a48dd", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 3e7eb4c715f04ea791384bcde9844fa7 Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance ab6f463a-4dd8-4d96-9092-f41f16f1e13e could not be found. Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'ab6f463a-4dd8-4d96-9092-f41f16f1e13e'} Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6f463a-4dd8-4d96-9092-f41f16f1e13e could not be found. Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6f463a-4dd8-4d96-9092-f41f16f1e13e could not be found. Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:07.660929 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:07.665075 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:07.665075 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:07.665075 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:07.665075 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:07.665075 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:07.665075 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6f463a-4dd8-4d96-9092-f41f16f1e13e could not be found. Jul 12 11:54:07.665075 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:07.667252 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2ceb5250-96c2-4319-b3af-f18b20e6352c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Returning 404 to user: Instance ab6f463a-4dd8-4d96-9092-f41f16f1e13e could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:07.668860 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2ceb5250-96c2-4319-b3af-f18b20e6352c tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e" status: 404 len: 111 microversion: 2.1 time: 0.051665 Jul 12 11:54:07.670191 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 685/1294] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:07 2022] GET /compute/v2.1/servers/ab6f463a-4dd8-4d96-9092-f41f16f1e13e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:07.675931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a3b87e9c-fbb9-469d-81a5-1522a8d33031 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:07.677560 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a3b87e9c-fbb9-469d-81a5-1522a8d33031 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:07.688536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3b87e9c-fbb9-469d-81a5-1522a8d33031 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:07.689973 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3b87e9c-fbb9-469d-81a5-1522a8d33031 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:07.691262 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3b87e9c-fbb9-469d-81a5-1522a8d33031 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:07.692058 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3b87e9c-fbb9-469d-81a5-1522a8d33031 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:07.900455 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a3b87e9c-fbb9-469d-81a5-1522a8d33031 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:07.915387 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a3b87e9c-fbb9-469d-81a5-1522a8d33031 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.243454 Jul 12 11:54:07.924895 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 686/1295] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:07 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:07.932793 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3a56e831-0088-4298-a99c-2c353bca694a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:07.997851 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3a56e831-0088-4298-a99c-2c353bca694a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/3643958b-855b-4467-9146-3988921502d5" status: 204 len: 0 microversion: 2.1 time: 0.080021 Jul 12 11:54:07.999376 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 687/1296] 10.222.0.50 () {58 vars in 1265 bytes} [Tue Jul 12 11:54:07 2022] DELETE /compute/v2.1/os-server-groups/3643958b-855b-4467-9146-3988921502d5 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:54:08.011662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6d674116-b1d1-487a-bcd4-e85c975a25df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:08.012567 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6d674116-b1d1-487a-bcd4-e85c975a25df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:08.023473 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d674116-b1d1-487a-bcd4-e85c975a25df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:08.024240 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d674116-b1d1-487a-bcd4-e85c975a25df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:08.026373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d674116-b1d1-487a-bcd4-e85c975a25df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:08.028264 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d674116-b1d1-487a-bcd4-e85c975a25df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:08.081236 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6d674116-b1d1-487a-bcd4-e85c975a25df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:54:08.213902 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-69111189-0404-419c-b532-b4a8fbb40cba tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:08.241007 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-69111189-0404-419c-b532-b4a8fbb40cba tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1715 microversion: 2.1 time: 1.252140 Jul 12 11:54:08.242050 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 610/1297] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:06 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1715 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:08.255650 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6d674116-b1d1-487a-bcd4-e85c975a25df tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "DELETE /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 204 len: 0 microversion: 2.1 time: 0.250361 Jul 12 11:54:08.261681 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 688/1298] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:54:08 2022] DELETE /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:54:08.280273 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e9e6f712-7776-4f8c-8d90-54a5b034b8b9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:08.281281 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e9e6f712-7776-4f8c-8d90-54a5b034b8b9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:08.299831 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9e6f712-7776-4f8c-8d90-54a5b034b8b9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:08.300428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9e6f712-7776-4f8c-8d90-54a5b034b8b9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:08.301306 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9e6f712-7776-4f8c-8d90-54a5b034b8b9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:08.301769 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9e6f712-7776-4f8c-8d90-54a5b034b8b9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:08.335373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-176ce7eb-20c0-457d-9f59-6300b7f63645 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:08.336262 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-176ce7eb-20c0-457d-9f59-6300b7f63645 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:08.349265 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-176ce7eb-20c0-457d-9f59-6300b7f63645 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:08.349803 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-176ce7eb-20c0-457d-9f59-6300b7f63645 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:08.350675 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-176ce7eb-20c0-457d-9f59-6300b7f63645 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:08.354751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-176ce7eb-20c0-457d-9f59-6300b7f63645 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:08.541172 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-176ce7eb-20c0-457d-9f59-6300b7f63645 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:08.549999 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-176ce7eb-20c0-457d-9f59-6300b7f63645 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1535 microversion: 2.1 time: 0.218930 Jul 12 11:54:08.549999 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 689/1299] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:08 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1535 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:08.718690 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e9e6f712-7776-4f8c-8d90-54a5b034b8b9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:08.730312 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e9e6f712-7776-4f8c-8d90-54a5b034b8b9 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1472 microversion: 2.1 time: 0.465966 Jul 12 11:54:08.739092 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 611/1300] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:08 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1472 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:08.934065 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-da221a0c-6b82-4208-91dc-fda372d41699 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:08.934506 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-da221a0c-6b82-4208-91dc-fda372d41699 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:08.953143 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da221a0c-6b82-4208-91dc-fda372d41699 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:08.953616 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da221a0c-6b82-4208-91dc-fda372d41699 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:08.954563 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da221a0c-6b82-4208-91dc-fda372d41699 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:08.955048 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da221a0c-6b82-4208-91dc-fda372d41699 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:09.242203 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-da221a0c-6b82-4208-91dc-fda372d41699 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:09.260088 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-da221a0c-6b82-4208-91dc-fda372d41699 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.329884 Jul 12 11:54:09.268507 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 690/1301] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:08 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:09.272408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c6f6ddbe-0086-4fe0-9917-090a10bf38ac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:09.274484 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c6f6ddbe-0086-4fe0-9917-090a10bf38ac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:09.287892 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c6f6ddbe-0086-4fe0-9917-090a10bf38ac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:09.288845 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c6f6ddbe-0086-4fe0-9917-090a10bf38ac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:09.290697 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c6f6ddbe-0086-4fe0-9917-090a10bf38ac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:09.292248 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c6f6ddbe-0086-4fe0-9917-090a10bf38ac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:09.410465 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c6f6ddbe-0086-4fe0-9917-090a10bf38ac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:09.428827 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c6f6ddbe-0086-4fe0-9917-090a10bf38ac tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1648 microversion: 2.1 time: 0.160439 Jul 12 11:54:09.434024 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 612/1302] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:09 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1648 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:09.572723 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f34ae2ca-2d5b-4861-aa9e-2850400a0f22 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:09.573569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f34ae2ca-2d5b-4861-aa9e-2850400a0f22 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:09.591403 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f34ae2ca-2d5b-4861-aa9e-2850400a0f22 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:09.591905 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f34ae2ca-2d5b-4861-aa9e-2850400a0f22 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:09.592766 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f34ae2ca-2d5b-4861-aa9e-2850400a0f22 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:09.593224 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f34ae2ca-2d5b-4861-aa9e-2850400a0f22 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:09.762124 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ee5c3181-5c9a-472b-aa63-8d84d5c34c5e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:09.762748 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ee5c3181-5c9a-472b-aa63-8d84d5c34c5e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:09.781554 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee5c3181-5c9a-472b-aa63-8d84d5c34c5e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:09.787818 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee5c3181-5c9a-472b-aa63-8d84d5c34c5e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:09.794693 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee5c3181-5c9a-472b-aa63-8d84d5c34c5e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:09.795169 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee5c3181-5c9a-472b-aa63-8d84d5c34c5e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:10.112562 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f34ae2ca-2d5b-4861-aa9e-2850400a0f22 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:10.128394 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ee5c3181-5c9a-472b-aa63-8d84d5c34c5e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:10.140939 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ee5c3181-5c9a-472b-aa63-8d84d5c34c5e tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1472 microversion: 2.1 time: 0.383645 Jul 12 11:54:10.142112 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 613/1303] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:09 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1472 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:10.147052 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f34ae2ca-2d5b-4861-aa9e-2850400a0f22 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1535 microversion: 2.1 time: 0.580273 Jul 12 11:54:10.150204 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 691/1304] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:09 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1535 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:10.156670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-ba779f50-8e17-4997-be2e-a91a75699000 req-7e9ee4b8-5d09-4b9d-861b-50cb29972b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46032186-539a-44ea-83fd-fd87925589d9", "name": "network-vif-deleted", "tag": "8260de2a-72b7-4bc9-a2c3-b6cf940c5fa7"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:10.170381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-ba779f50-8e17-4997-be2e-a91a75699000 req-7e9ee4b8-5d09-4b9d-861b-50cb29972b09 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:10.171190 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-ba779f50-8e17-4997-be2e-a91a75699000 req-7e9ee4b8-5d09-4b9d-861b-50cb29972b09 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:10.197451 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-ba779f50-8e17-4997-be2e-a91a75699000 req-7e9ee4b8-5d09-4b9d-861b-50cb29972b09 service nova] Creating event network-vif-deleted:8260de2a-72b7-4bc9-a2c3-b6cf940c5fa7 for instance 46032186-539a-44ea-83fd-fd87925589d9 on n-h2-849104-4 Jul 12 11:54:10.205759 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-ba779f50-8e17-4997-be2e-a91a75699000 req-7e9ee4b8-5d09-4b9d-861b-50cb29972b09 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060734 Jul 12 11:54:10.212630 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 614/1305] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:10.292942 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-753657e8-2387-442d-8c76-13f96b3db73b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:10.293573 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-753657e8-2387-442d-8c76-13f96b3db73b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:10.307501 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-753657e8-2387-442d-8c76-13f96b3db73b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:10.310927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-753657e8-2387-442d-8c76-13f96b3db73b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:10.314125 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-753657e8-2387-442d-8c76-13f96b3db73b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:10.314689 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-753657e8-2387-442d-8c76-13f96b3db73b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:10.452435 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-27e912fb-ec32-47ef-afc9-1487622f2ed9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:10.454038 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-27e912fb-ec32-47ef-afc9-1487622f2ed9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:10.475026 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27e912fb-ec32-47ef-afc9-1487622f2ed9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:10.476109 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27e912fb-ec32-47ef-afc9-1487622f2ed9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:10.481315 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27e912fb-ec32-47ef-afc9-1487622f2ed9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:10.483690 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27e912fb-ec32-47ef-afc9-1487622f2ed9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:10.554291 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27e912fb-ec32-47ef-afc9-1487622f2ed9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:10.554969 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27e912fb-ec32-47ef-afc9-1487622f2ed9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:10.556843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-27e912fb-ec32-47ef-afc9-1487622f2ed9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lazy-loading 'fault' on Instance uuid 46032186-539a-44ea-83fd-fd87925589d9 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:54:10.660253 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-753657e8-2387-442d-8c76-13f96b3db73b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:10.663648 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-27e912fb-ec32-47ef-afc9-1487622f2ed9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fcbf37964b49dfb597a4a1e95a299c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1394824ad6fd4ef686fafb5fb3c0b4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:10.673869 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-753657e8-2387-442d-8c76-13f96b3db73b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.384020 Jul 12 11:54:10.677267 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-27e912fb-ec32-47ef-afc9-1487622f2ed9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 200 len: 1355 microversion: 2.1 time: 0.229334 Jul 12 11:54:10.689646 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 692/1306] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:10 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:10.692243 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 615/1307] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:10 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 1355 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:10.703184 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4aafac9b-8148-41dc-aad8-c6db429fab39 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "201076b4-e9f6-4bb6-9949-0da00587fec0"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:10.708451 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4aafac9b-8148-41dc-aad8-c6db429fab39 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:10.722064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4aafac9b-8148-41dc-aad8-c6db429fab39 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:10.724622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4aafac9b-8148-41dc-aad8-c6db429fab39 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:10.728192 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4aafac9b-8148-41dc-aad8-c6db429fab39 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:10.729026 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4aafac9b-8148-41dc-aad8-c6db429fab39 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:10.865114 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-4aafac9b-8148-41dc-aad8-c6db429fab39 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] HTTP exception thrown: Volume 7b77aad4-312b-4d76-bc7b-3469c728f932 could not be found. Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4aafac9b-8148-41dc-aad8-c6db429fab39 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] Request method failure captured: Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: request: PUT /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb/os-volume_attachments/7b77aad4-312b-4d76-bc7b-3469c728f932 HTTP/1.1 Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 74 Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWBBhprt3k5C0vxBR4t430Uaa_sKPL4IfttVXhfiLMmYOM3qDX2Bzzhku70B4WH3ToJBPzyqbJ7L1py6DaycJRv8hemWW-PnXYWdP_1wmwVHFxmVM2mQr0rB4uzkiHaEGcyJeu2GpLMetU6IqON0j5bWWH1CJQbQtp_sfc6G7ykhzqQ Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 72d697d522c2412abfe1e7a183186c5e Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-VolumesAdminNegativeTest-1019490232 Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72d697d522c2412abfe1e7a183186c5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/72d697d522c2412abfe1e7a183186c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/72d697d522c2412abfe1e7a183186c5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_72d697d522c2412abfe1e7a183186c5e", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-VolumesAdminNegativeTest-1019490232 Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 72d697d522c2412abfe1e7a183186c5e Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1019490232 Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-VolumesAdminNegativeTest-1019490232-project-admin Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 654cc31838d8437f9ac2d3e50e44b877 Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-VolumesAdminNegativeTest-1019490232-project-admin Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: {"volumeAttachment": {"volumeId": "201076b4-e9f6-4bb6-9949-0da00587fec0"}} Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: exception: Volume 7b77aad4-312b-4d76-bc7b-3469c728f932 could not be found. Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'server_id': 'f300ccc7-18ee-45d7-8d82-a23ddff013eb', 'id': '7b77aad4-312b-4d76-bc7b-3469c728f932', 'body': {'volumeAttachment': {'volumeId': '201076b4-e9f6-4bb6-9949-0da00587fec0'}}} Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b77aad4-312b-4d76-bc7b-3469c728f932 could not be found. (HTTP 404) (Request-ID: req-da7009fe-8060-4087-a486-987000146d5a) Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 11:54:10.872528 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b77aad4-312b-4d76-bc7b-3469c728f932 could not be found. Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b77aad4-312b-4d76-bc7b-3469c728f932 could not be found. Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b77aad4-312b-4d76-bc7b-3469c728f932 could not be found. Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4aafac9b-8148-41dc-aad8-c6db429fab39 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] Returning 404 to user: Volume 7b77aad4-312b-4d76-bc7b-3469c728f932 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:10.878383 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4aafac9b-8148-41dc-aad8-c6db429fab39 tempest-VolumesAdminNegativeTest-1019490232 tempest-VolumesAdminNegativeTest-1019490232-project-admin] 10.222.0.50 "PUT /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb/os-volume_attachments/7b77aad4-312b-4d76-bc7b-3469c728f932" status: 404 len: 109 microversion: 2.1 time: 0.187306 Jul 12 11:54:10.907820 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 693/1308] 10.222.0.50 () {60 vars in 1432 bytes} [Tue Jul 12 11:54:10 2022] PUT /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb/os-volume_attachments/7b77aad4-312b-4d76-bc7b-3469c728f932 => generated 109 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:11.156859 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-64b746f5-3a35-4c63-8043-f2571aae2f1e tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:11.159893 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0851384b-0f5b-4b0f-a508-10fc443779ef tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:11.160581 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0851384b-0f5b-4b0f-a508-10fc443779ef tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:11.178843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0851384b-0f5b-4b0f-a508-10fc443779ef tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:11.179320 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0851384b-0f5b-4b0f-a508-10fc443779ef tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:11.180700 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0851384b-0f5b-4b0f-a508-10fc443779ef tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:11.181354 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0851384b-0f5b-4b0f-a508-10fc443779ef tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:11.182871 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-64b746f5-3a35-4c63-8043-f2571aae2f1e tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.281257 Jul 12 11:54:11.195623 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 616/1309] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:54:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:11.212597 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ec1f4ada-a030-42a4-b4fc-8fc068efbb7c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:11.214560 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ec1f4ada-a030-42a4-b4fc-8fc068efbb7c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:11.234103 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ec1f4ada-a030-42a4-b4fc-8fc068efbb7c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:11.244776 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ec1f4ada-a030-42a4-b4fc-8fc068efbb7c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:11.245856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ec1f4ada-a030-42a4-b4fc-8fc068efbb7c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:11.246452 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ec1f4ada-a030-42a4-b4fc-8fc068efbb7c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:11.496536 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ec1f4ada-a030-42a4-b4fc-8fc068efbb7c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:11.508517 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ec1f4ada-a030-42a4-b4fc-8fc068efbb7c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1528 microversion: 2.1 time: 0.310870 Jul 12 11:54:11.509458 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 617/1310] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:11 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1528 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:11.523554 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ca2a0582-db63-43c3-b0ab-8c5957014bbd tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:11.564739 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ca2a0582-db63-43c3-b0ab-8c5957014bbd tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3078 microversion: 2.1 time: 0.053930 Jul 12 11:54:11.579330 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 618/1311] 10.222.0.50 () {58 vars in 1124 bytes} [Tue Jul 12 11:54:11 2022] GET /compute/v2.1/flavors => generated 3078 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:11.589533 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-af56446c-1cc8-4de9-bfe3-13266b95e755 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:11.591011 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-af56446c-1cc8-4de9-bfe3-13266b95e755 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:11.598119 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-af56446c-1cc8-4de9-bfe3-13266b95e755 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:11.598857 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-af56446c-1cc8-4de9-bfe3-13266b95e755 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:11.599798 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-af56446c-1cc8-4de9-bfe3-13266b95e755 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:11.600484 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-af56446c-1cc8-4de9-bfe3-13266b95e755 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:11.719663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0851384b-0f5b-4b0f-a508-10fc443779ef tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:11.740369 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0851384b-0f5b-4b0f-a508-10fc443779ef tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1472 microversion: 2.1 time: 0.583075 Jul 12 11:54:11.741766 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 694/1312] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:11 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1472 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:11.750234 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0fc3a793-679c-491e-b4cd-d8c12b6a1f75 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:11.760835 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0fc3a793-679c-491e-b4cd-d8c12b6a1f75 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017457 Jul 12 11:54:11.764011 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 695/1313] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:54:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:11.784270 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6e964ce4-8f14-4656-83da-976732b5be5f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:11.785458 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6e964ce4-8f14-4656-83da-976732b5be5f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:11.793226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6e964ce4-8f14-4656-83da-976732b5be5f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:11.794641 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6e964ce4-8f14-4656-83da-976732b5be5f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:11.796161 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6e964ce4-8f14-4656-83da-976732b5be5f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:11.797899 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6e964ce4-8f14-4656-83da-976732b5be5f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:11.918846 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-af56446c-1cc8-4de9-bfe3-13266b95e755 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:11.932262 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-af56446c-1cc8-4de9-bfe3-13266b95e755 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1528 microversion: 2.1 time: 0.349650 Jul 12 11:54:11.932857 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 619/1314] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:11 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1528 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:11.949119 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d4cc69bd-f1a1-4eca-a230-fd6b62566eb9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:11.950062 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d4cc69bd-f1a1-4eca-a230-fd6b62566eb9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:11.962456 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d4cc69bd-f1a1-4eca-a230-fd6b62566eb9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:11.963212 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d4cc69bd-f1a1-4eca-a230-fd6b62566eb9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:11.964280 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d4cc69bd-f1a1-4eca-a230-fd6b62566eb9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:11.973976 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d4cc69bd-f1a1-4eca-a230-fd6b62566eb9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:12.018729 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-d4cc69bd-f1a1-4eca-a230-fd6b62566eb9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] HTTP exception thrown: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d4cc69bd-f1a1-4eca-a230-fd6b62566eb9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Request method failure captured: Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 HTTP/1.1 Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWACcLRPzmLYkRFHIKwc7UtHB95fy9flewSA-SHZA2z6IXJw1PyUvZwyX3lDoJDBPexCrEEyOwDTLyxHHt8oNKkxrxJAsTZ7QNgw_dmKVhYgBtGR8UozQGBAatJ8MEnEn99oospENiiLPgn62izXOkvkmLYK6-rV5bPevnofZXrt1oc Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 1394824ad6fd4ef686fafb5fb3c0b4e1 Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1394824ad6fd4ef686fafb5fb3c0b4e1", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 1394824ad6fd4ef686fafb5fb3c0b4e1 Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1618440225-project Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 02fcbf37964b49dfb597a4a1e95a299c Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225-project Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '46032186-539a-44ea-83fd-fd87925589d9'} Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.021348 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:12.026784 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.026784 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:12.026784 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:12.026784 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:12.026784 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:12.026784 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:12.026784 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:12.026784 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.042981 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d4cc69bd-f1a1-4eca-a230-fd6b62566eb9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Returning 404 to user: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:12.046513 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d4cc69bd-f1a1-4eca-a230-fd6b62566eb9 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 404 len: 111 microversion: 2.1 time: 0.112578 Jul 12 11:54:12.047598 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 620/1315] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:11 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:12.064807 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-10c98ac7-6f29-46e2-ad47-0b07b2bee899 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.092285 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-10c98ac7-6f29-46e2-ad47-0b07b2bee899 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038957 Jul 12 11:54:12.093476 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 621/1316] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:12.100268 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1d23f6a9-8338-435e-86a2-90d9da9a1b2e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.101424 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:12.101424 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:54:12.111498 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-1d23f6a9-8338-435e-86a2-90d9da9a1b2e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] HTTP exception thrown: Flavor 99584907-24af-440f-aca4-b873a3768d9a could not be found. Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1d23f6a9-8338-435e-86a2-90d9da9a1b2e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Request method failure captured: Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/flavors/99584907-24af-440f-aca4-b873a3768d9a HTTP/1.1 Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_NTUKX8ETkrD38E5H-qt8MVTARQJTGmZNqQsgNCcVbKd2l7yUlR0RpwHfRYvXX7psmCONAoF8btmGCmWXiW9SNvX5_IuZILBUTVts83y57f4weP-mytEfzjtBvvnHoS8N_WWX5Hw8KMo4_hk-R76C5l6k_uGgxCR6Go6QSuq2RLW4 Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 4edf9834df214506be223369a506d00e Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-MigrationsAdminTest-376677138 Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4edf9834df214506be223369a506d00e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4edf9834df214506be223369a506d00e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4edf9834df214506be223369a506d00e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4edf9834df214506be223369a506d00e", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-MigrationsAdminTest-376677138 Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 4edf9834df214506be223369a506d00e Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-MigrationsAdminTest-376677138 Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-MigrationsAdminTest-376677138-project-admin Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 7e394152cbc64b698118836521f3e4fc Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-MigrationsAdminTest-376677138-project-admin Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: exception: Flavor 99584907-24af-440f-aca4-b873a3768d9a could not be found. Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '99584907-24af-440f-aca4-b873a3768d9a'} Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 99584907-24af-440f-aca4-b873a3768d9a could not be found. Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 99584907-24af-440f-aca4-b873a3768d9a could not be found. Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.116980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:12.125127 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.125127 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:12.125127 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:12.125127 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:12.125127 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:12.125127 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:12.125127 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 99584907-24af-440f-aca4-b873a3768d9a could not be found. Jul 12 11:54:12.125127 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.125127 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1d23f6a9-8338-435e-86a2-90d9da9a1b2e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Returning 404 to user: Flavor 99584907-24af-440f-aca4-b873a3768d9a could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:12.127168 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6e964ce4-8f14-4656-83da-976732b5be5f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:12.134716 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1d23f6a9-8338-435e-86a2-90d9da9a1b2e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/99584907-24af-440f-aca4-b873a3768d9a" status: 404 len: 109 microversion: 2.1 time: 0.026176 Jul 12 11:54:12.136365 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 622/1317] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:54:12 2022] DELETE /compute/v2.1/flavors/99584907-24af-440f-aca4-b873a3768d9a => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:12.151189 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-721183bb-5c6e-4945-8121-98fd91177760 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.154235 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-721183bb-5c6e-4945-8121-98fd91177760 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:12.154546 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6e964ce4-8f14-4656-83da-976732b5be5f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.389138 Jul 12 11:54:12.155154 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 696/1318] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:11 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:12.171102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c4d5b7de-ee3e-4590-8f1f-c780207e7d95 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.175757 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-721183bb-5c6e-4945-8121-98fd91177760 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:12.176413 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-721183bb-5c6e-4945-8121-98fd91177760 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:12.193354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-721183bb-5c6e-4945-8121-98fd91177760 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:12.197115 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-721183bb-5c6e-4945-8121-98fd91177760 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:12.209997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:12.229161 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-721183bb-5c6e-4945-8121-98fd91177760 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] HTTP exception thrown: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-721183bb-5c6e-4945-8121-98fd91177760 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Request method failure captured: Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e HTTP/1.1 Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWACcLRPzmLYkRFHIKwc7UtHB95fy9flewSA-SHZA2z6IXJw1PyUvZwyX3lDoJDBPexCrEEyOwDTLyxHHt8oNKkxrxJAsTZ7QNgw_dmKVhYgBtGR8UozQGBAatJ8MEnEn99oospENiiLPgn62izXOkvkmLYK6-rV5bPevnofZXrt1oc Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 1394824ad6fd4ef686fafb5fb3c0b4e1 Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1394824ad6fd4ef686fafb5fb3c0b4e1", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 1394824ad6fd4ef686fafb5fb3c0b4e1 Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1618440225-project Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 02fcbf37964b49dfb597a4a1e95a299c Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225-project Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'c809d104-cbc0-4f60-bd08-d9b669685f5e'} Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:12.235607 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:12.240224 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:12.240224 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.240224 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:12.240224 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.240224 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:12.240224 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:12.240224 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:12.240224 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:12.240224 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:12.240224 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:12.240224 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.240224 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-721183bb-5c6e-4945-8121-98fd91177760 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Returning 404 to user: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:12.240224 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-721183bb-5c6e-4945-8121-98fd91177760 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 404 len: 111 microversion: 2.1 time: 0.098403 Jul 12 11:54:12.244416 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 623/1319] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:54:12 2022] DELETE /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:12.256093 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f2079bad-ba36-4897-85c5-dd17e8df954a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.257277 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f2079bad-ba36-4897-85c5-dd17e8df954a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:12.267157 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c4d5b7de-ee3e-4590-8f1f-c780207e7d95 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.094121 Jul 12 11:54:12.268227 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 697/1320] 10.222.0.50 () {58 vars in 1164 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:12.269011 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f2079bad-ba36-4897-85c5-dd17e8df954a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:12.269476 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f2079bad-ba36-4897-85c5-dd17e8df954a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:12.270270 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f2079bad-ba36-4897-85c5-dd17e8df954a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:12.270723 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f2079bad-ba36-4897-85c5-dd17e8df954a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:12.287995 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-99af8f09-7690-4ec8-8bd8-79c0048703c7 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.291140 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-f2079bad-ba36-4897-85c5-dd17e8df954a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] HTTP exception thrown: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f2079bad-ba36-4897-85c5-dd17e8df954a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Request method failure captured: Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e HTTP/1.1 Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWACcLRPzmLYkRFHIKwc7UtHB95fy9flewSA-SHZA2z6IXJw1PyUvZwyX3lDoJDBPexCrEEyOwDTLyxHHt8oNKkxrxJAsTZ7QNgw_dmKVhYgBtGR8UozQGBAatJ8MEnEn99oospENiiLPgn62izXOkvkmLYK6-rV5bPevnofZXrt1oc Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 1394824ad6fd4ef686fafb5fb3c0b4e1 Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1394824ad6fd4ef686fafb5fb3c0b4e1", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 1394824ad6fd4ef686fafb5fb3c0b4e1 Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1618440225-project Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 02fcbf37964b49dfb597a4a1e95a299c Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225-project Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'c809d104-cbc0-4f60-bd08-d9b669685f5e'} Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.297129 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:12.301306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.301306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:12.301306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:12.301306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:12.301306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:12.301306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:12.301306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:12.301306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:12.310304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f2079bad-ba36-4897-85c5-dd17e8df954a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Returning 404 to user: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:12.310964 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-99af8f09-7690-4ec8-8bd8-79c0048703c7 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026713 Jul 12 11:54:12.311183 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f2079bad-ba36-4897-85c5-dd17e8df954a tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 404 len: 111 microversion: 2.1 time: 0.065646 Jul 12 11:54:12.311894 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 698/1321] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:12.317760 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 624/1322] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:12.325164 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-495bc6df-84f1-4ec6-adf3-17950af686df tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.334738 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-de9d5b17-d064-471d-b09f-31ca8eb39335 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '.version_select at 0x7f5e0a7265e0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.351242 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-495bc6df-84f1-4ec6-adf3-17950af686df tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.031199 Jul 12 11:54:12.357094 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 699/1323] 10.222.0.50 () {58 vars in 1168 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:12.377993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-30d94ac5-d328-4f22-928c-e9cc6dd998e9 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.386178 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-de9d5b17-d064-471d-b09f-31ca8eb39335 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689767150" status: 202 len: 0 microversion: 2.1 time: 0.066813 Jul 12 11:54:12.403799 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 625/1324] 10.222.0.50 () {58 vars in 1220 bytes} [Tue Jul 12 11:54:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689767150 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:54:12.414927 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-30d94ac5-d328-4f22-928c-e9cc6dd998e9 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.041720 Jul 12 11:54:12.431324 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 700/1325] 10.222.0.50 () {58 vars in 1160 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:12.432679 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e59775a4-c2c1-4d29-8c05-e46735d26a81 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.454923 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e59775a4-c2c1-4d29-8c05-e46735d26a81 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030863 Jul 12 11:54:12.455891 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 626/1326] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:54:12.468949 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1532605258", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:12.475691 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fdaceb5a-9f29-4fd5-b5d9-b34b460cc70b tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.547465 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fdaceb5a-9f29-4fd5-b5d9-b34b460cc70b tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.076125 Jul 12 11:54:12.554812 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 627/1327] 10.222.0.50 () {58 vars in 1166 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:12.568164 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] validate_networks() for None {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:54:12.574647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-96045e54-43e9-4b9b-bdea-792c7639195e req-5819b361-596c-4037-ba44-022ac0d9b5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df49a9f0-90aa-4bd7-91c8-1df741ab59a3", "name": "network-vif-deleted", "tag": "88b8b92e-2020-4be2-b13b-31bb1eee241a"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:12.585277 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-96045e54-43e9-4b9b-bdea-792c7639195e req-5819b361-596c-4037-ba44-022ac0d9b5a5 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:12.586106 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-96045e54-43e9-4b9b-bdea-792c7639195e req-5819b361-596c-4037-ba44-022ac0d9b5a5 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:12.600110 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-96045e54-43e9-4b9b-bdea-792c7639195e req-5819b361-596c-4037-ba44-022ac0d9b5a5 service nova] Creating event network-vif-deleted:88b8b92e-2020-4be2-b13b-31bb1eee241a for instance df49a9f0-90aa-4bd7-91c8-1df741ab59a3 on n-h1-849104-4 Jul 12 11:54:12.616311 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-96045e54-43e9-4b9b-bdea-792c7639195e req-5819b361-596c-4037-ba44-022ac0d9b5a5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057323 Jul 12 11:54:12.617346 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 628/1328] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:12.624173 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-154a877a-563b-4e10-bf05-84276f5436a8 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.634701 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-154a877a-563b-4e10-bf05-84276f5436a8 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013887 Jul 12 11:54:12.635831 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 629/1329] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:12.651703 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-01bb6984-b73b-4178-b0f9-fbcd8f862073 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.680119 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:12.685625 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-01bb6984-b73b-4178-b0f9-fbcd8f862073 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.038623 Jul 12 11:54:12.686727 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 630/1330] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:12.699144 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6f4b05eb-1c3a-4294-bb6e-0b0b03186791 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.711953 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6f4b05eb-1c3a-4294-bb6e-0b0b03186791 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016865 Jul 12 11:54:12.722039 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 631/1331] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:12.729260 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-de00e2f6-e9b9-47e0-993f-7dafe7bcbe1c tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.755626 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-de00e2f6-e9b9-47e0-993f-7dafe7bcbe1c tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.031734 Jul 12 11:54:12.756235 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 632/1332] 10.222.0.50 () {58 vars in 1147 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:12.761421 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d76beccb-203a-4ee6-be81-12dd0ff1ba38 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.762330 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d76beccb-203a-4ee6-be81-12dd0ff1ba38 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:12.772665 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d76beccb-203a-4ee6-be81-12dd0ff1ba38 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:12.773203 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d76beccb-203a-4ee6-be81-12dd0ff1ba38 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:12.774041 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d76beccb-203a-4ee6-be81-12dd0ff1ba38 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:12.774474 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d76beccb-203a-4ee6-be81-12dd0ff1ba38 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:12.828388 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d76beccb-203a-4ee6-be81-12dd0ff1ba38 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:12.829420 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d76beccb-203a-4ee6-be81-12dd0ff1ba38 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:12.830238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-d76beccb-203a-4ee6-be81-12dd0ff1ba38 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lazy-loading 'fault' on Instance uuid df49a9f0-90aa-4bd7-91c8-1df741ab59a3 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:54:12.897215 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d76beccb-203a-4ee6-be81-12dd0ff1ba38 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7eb4c715f04ea791384bcde9844fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810246cfc801446599831d243d3a48dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:12.911932 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d76beccb-203a-4ee6-be81-12dd0ff1ba38 tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 200 len: 1306 microversion: 2.1 time: 0.153876 Jul 12 11:54:12.914778 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 633/1333] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 1306 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:12.923561 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-387bf7e0-665a-40f1-885f-117eac2b9b9e tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.958696 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-387bf7e0-665a-40f1-885f-117eac2b9b9e tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.039581 Jul 12 11:54:12.965711 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 634/1334] 10.222.0.50 () {58 vars in 1139 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:12.973880 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3ee29ca9-0c53-4eb0-b5c7-392b0e0e5e81 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:12.985525 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3ee29ca9-0c53-4eb0-b5c7-392b0e0e5e81 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015857 Jul 12 11:54:12.986857 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 635/1335] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:12.991493 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:54:12.992015 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:54:12.992695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:54:12.994108 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:54:12.994536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:54:13.018942 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8b6b062c-b8c6-4b2b-ae1e-1c0602fbaa0b tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:13.031199 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:13.031976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:13.033538 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:13.034286 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:13.079210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Getting quotas for project 4c6a6e22d13840698ada0866ea3f4913. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:54:13.086310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Getting quotas for user d42140cf6bac4674ba0515ca28531222 and project 4c6a6e22d13840698ada0866ea3f4913. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:54:13.091503 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8b6b062c-b8c6-4b2b-ae1e-1c0602fbaa0b tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.090647 Jul 12 11:54:13.094535 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 636/1336] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:54:12 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:13.110265 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:54:13.110520 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1f607eed-8eb5-4e50-8bc6-58ece0bf2501 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:13.113081 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:54:13.183906 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1f607eed-8eb5-4e50-8bc6-58ece0bf2501 tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.082247 Jul 12 11:54:13.187919 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 637/1337] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:54:13 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:13.193790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3f2524cb-245f-4a65-9d2a-bff9ffaa229f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:13.198332 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-90aec060-274a-4f7d-92e7-639bcfc31e90 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745562 Jul 12 11:54:13.200190 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 701/1338] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:54:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 11:54:13.206590 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-da25a331-df7b-4974-90dd-d0fcedaf769f tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:13.215680 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3f2524cb-245f-4a65-9d2a-bff9ffaa229f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:13.230655 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-da25a331-df7b-4974-90dd-d0fcedaf769f tempest-FlavorsV2TestJSON-298812971 tempest-FlavorsV2TestJSON-298812971-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025728 Jul 12 11:54:13.237407 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 702/1339] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:54:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:13.250677 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-85a36aaa-826e-47a9-bdc9-531aeddf6e67 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:13.252978 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-85a36aaa-826e-47a9-bdc9-531aeddf6e67 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:13.261846 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3f2524cb-245f-4a65-9d2a-bff9ffaa229f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:13.262607 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3f2524cb-245f-4a65-9d2a-bff9ffaa229f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:13.265871 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3f2524cb-245f-4a65-9d2a-bff9ffaa229f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:13.269498 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3f2524cb-245f-4a65-9d2a-bff9ffaa229f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:13.410361 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-85a36aaa-826e-47a9-bdc9-531aeddf6e67 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:13.428943 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-85a36aaa-826e-47a9-bdc9-531aeddf6e67 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1213 microversion: 2.1 time: 0.192005 Jul 12 11:54:13.430652 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 703/1340] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:13 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1213 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:13.764892 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3f2524cb-245f-4a65-9d2a-bff9ffaa229f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:13.776356 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3f2524cb-245f-4a65-9d2a-bff9ffaa229f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.588194 Jul 12 11:54:13.776938 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 638/1341] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:13 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:13.931850 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-45c9f264-651d-421a-a8f6-c968c9902d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:13.932518 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-45c9f264-651d-421a-a8f6-c968c9902d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] [instance: df49a9f0-90aa-4bd7-91c8-1df741ab59a3] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:13.947843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-45c9f264-651d-421a-a8f6-c968c9902d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:13.948327 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-45c9f264-651d-421a-a8f6-c968c9902d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:13.949309 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-45c9f264-651d-421a-a8f6-c968c9902d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:13.949763 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-45c9f264-651d-421a-a8f6-c968c9902d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:13.998676 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-45c9f264-651d-421a-a8f6-c968c9902d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] HTTP exception thrown: Instance df49a9f0-90aa-4bd7-91c8-1df741ab59a3 could not be found. Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-45c9f264-651d-421a-a8f6-c968c9902d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Request method failure captured: Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 HTTP/1.1 Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWAIsAjWusJZqZTqO-T5k7sF3XVQ_BVMWkgLAmSdn_h1MRycYbdcU7cykB4uGTStunIOo5ApPn465SO0jjUMYRsZwApvmb-AO14yFiVrUNdkrYxS017oV-XNhYB9rF-oG05Xyetaq0ERBw2wHAO_zCDvGtPTgwRLhQcDsw5foMYdahY Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/810246cfc801446599831d243d3a48dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/810246cfc801446599831d243d3a48dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_810246cfc801446599831d243d3a48dd", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 810246cfc801446599831d243d3a48dd Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2097610819 Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 3e7eb4c715f04ea791384bcde9844fa7 Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersOnMultiNodesTest-2097610819-project Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance df49a9f0-90aa-4bd7-91c8-1df741ab59a3 could not be found. Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'df49a9f0-90aa-4bd7-91c8-1df741ab59a3'} Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df49a9f0-90aa-4bd7-91c8-1df741ab59a3 could not be found. Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df49a9f0-90aa-4bd7-91c8-1df741ab59a3 could not be found. Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:14.001738 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.007502 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:14.007502 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:14.007502 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:14.007502 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:14.007502 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:14.007502 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df49a9f0-90aa-4bd7-91c8-1df741ab59a3 could not be found. Jul 12 11:54:14.007502 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.010897 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-45c9f264-651d-421a-a8f6-c968c9902d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] Returning 404 to user: Instance df49a9f0-90aa-4bd7-91c8-1df741ab59a3 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:14.016809 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-45c9f264-651d-421a-a8f6-c968c9902d4a tempest-ServersOnMultiNodesTest-2097610819 tempest-ServersOnMultiNodesTest-2097610819-project] 10.222.0.50 "GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3" status: 404 len: 111 microversion: 2.1 time: 0.085966 Jul 12 11:54:14.028153 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 704/1342] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:13 2022] GET /compute/v2.1/servers/df49a9f0-90aa-4bd7-91c8-1df741ab59a3 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:14.140286 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1e1f1427-4ca0-46d6-951a-5d450ea56302 tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:14.142016 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:14.142016 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:54:14.181195 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1e1f1427-4ca0-46d6-951a-5d450ea56302 tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/284031101" status: 202 len: 0 microversion: 2.1 time: 0.044850 Jul 12 11:54:14.182500 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 639/1343] 10.222.0.50 () {58 vars in 1157 bytes} [Tue Jul 12 11:54:14 2022] DELETE /compute/v2.1/flavors/284031101 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:54:14.192322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-61a3da42-12f9-4de0-ab64-2535b56b6a2f tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:14.250132 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-61a3da42-12f9-4de0-ab64-2535b56b6a2f tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.059323 Jul 12 11:54:14.253106 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 705/1344] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:54:14 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:14.276166 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d0cf4d3a-934b-452e-9dc1-7818bbc579a1 tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:14.340194 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d0cf4d3a-934b-452e-9dc1-7818bbc579a1 tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1512588295" status: 202 len: 0 microversion: 2.1 time: 0.073381 Jul 12 11:54:14.357372 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8b9315cc-d930-4abe-9c2f-2789ed5ce887 tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:14.366045 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 640/1345] 10.222.0.50 () {58 vars in 1160 bytes} [Tue Jul 12 11:54:14 2022] DELETE /compute/v2.1/flavors/1512588295 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:54:14.417952 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-1f9eb9eb-1524-443c-9a77-06e4575d6acb req-6dcd6e84-e549-41d0-a33d-1d751e1c2298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c311469b-29d4-4011-b455-8fe3ffd81d3c", "name": "network-vif-plugged", "status": "completed", "tag": "4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:14.491181 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8b9315cc-d930-4abe-9c2f-2789ed5ce887 tempest-ServersWithSpecificFlavorTestJSON-1134215261 tempest-ServersWithSpecificFlavorTestJSON-1134215261-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.137801 Jul 12 11:54:14.495958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-1f9eb9eb-1524-443c-9a77-06e4575d6acb req-6dcd6e84-e549-41d0-a33d-1d751e1c2298 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:14.496387 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-1f9eb9eb-1524-443c-9a77-06e4575d6acb req-6dcd6e84-e549-41d0-a33d-1d751e1c2298 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:14.497685 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 706/1346] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:54:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:14.518342 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8b4a3f29-131f-4c08-bab8-994b6c4ad74d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:14.545659 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8b4a3f29-131f-4c08-bab8-994b6c4ad74d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:14.574688 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-1f9eb9eb-1524-443c-9a77-06e4575d6acb req-6dcd6e84-e549-41d0-a33d-1d751e1c2298 service nova] Creating event network-vif-plugged:4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec for instance c311469b-29d4-4011-b455-8fe3ffd81d3c on n-h2-849104-4 Jul 12 11:54:14.597498 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-1f9eb9eb-1524-443c-9a77-06e4575d6acb req-6dcd6e84-e549-41d0-a33d-1d751e1c2298 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186652 Jul 12 11:54:14.599929 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 641/1347] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:14.625796 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-260f794a-1762-40cc-8f96-543e5da21360 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:14.626410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-260f794a-1762-40cc-8f96-543e5da21360 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:14.672958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-260f794a-1762-40cc-8f96-543e5da21360 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:14.674617 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-260f794a-1762-40cc-8f96-543e5da21360 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:14.676933 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-260f794a-1762-40cc-8f96-543e5da21360 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:14.686067 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-260f794a-1762-40cc-8f96-543e5da21360 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:14.739819 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-260f794a-1762-40cc-8f96-543e5da21360 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] HTTP exception thrown: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-260f794a-1762-40cc-8f96-543e5da21360 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Request method failure captured: Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 HTTP/1.1 Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWACcLRPzmLYkRFHIKwc7UtHB95fy9flewSA-SHZA2z6IXJw1PyUvZwyX3lDoJDBPexCrEEyOwDTLyxHHt8oNKkxrxJAsTZ7QNgw_dmKVhYgBtGR8UozQGBAatJ8MEnEn99oospENiiLPgn62izXOkvkmLYK6-rV5bPevnofZXrt1oc Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 1394824ad6fd4ef686fafb5fb3c0b4e1 Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1394824ad6fd4ef686fafb5fb3c0b4e1", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 1394824ad6fd4ef686fafb5fb3c0b4e1 Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1618440225-project Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 02fcbf37964b49dfb597a4a1e95a299c Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225-project Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '46032186-539a-44ea-83fd-fd87925589d9'} Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:14.741898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:14.756824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:14.756824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.756824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:14.756824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.756824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:14.756824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:14.756824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:14.756824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:14.756824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:14.756824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:14.756824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.756824 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-260f794a-1762-40cc-8f96-543e5da21360 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Returning 404 to user: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:14.756824 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-260f794a-1762-40cc-8f96-543e5da21360 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "DELETE /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 404 len: 111 microversion: 2.1 time: 0.152178 Jul 12 11:54:14.760857 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8b4a3f29-131f-4c08-bab8-994b6c4ad74d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:14.769588 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 642/1348] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:54:14 2022] DELETE /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:14.779469 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8b4a3f29-131f-4c08-bab8-994b6c4ad74d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1213 microversion: 2.1 time: 0.279404 Jul 12 11:54:14.781380 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 707/1349] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:14 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1213 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:14.796080 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-89ec4f87-955e-4656-ade3-94a950a3939b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:14.807269 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-89ec4f87-955e-4656-ade3-94a950a3939b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: 46032186-539a-44ea-83fd-fd87925589d9] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:14.813245 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1c69ec38-2979-4397-9133-2328fea16b5a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:14.819887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1c69ec38-2979-4397-9133-2328fea16b5a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:14.825062 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89ec4f87-955e-4656-ade3-94a950a3939b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:14.827798 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89ec4f87-955e-4656-ade3-94a950a3939b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:14.828911 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89ec4f87-955e-4656-ade3-94a950a3939b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:14.830344 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89ec4f87-955e-4656-ade3-94a950a3939b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:14.858184 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c69ec38-2979-4397-9133-2328fea16b5a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:14.858651 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c69ec38-2979-4397-9133-2328fea16b5a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:14.859453 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c69ec38-2979-4397-9133-2328fea16b5a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:14.859898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c69ec38-2979-4397-9133-2328fea16b5a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:14.872847 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-89ec4f87-955e-4656-ade3-94a950a3939b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] HTTP exception thrown: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-89ec4f87-955e-4656-ade3-94a950a3939b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Request method failure captured: Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 HTTP/1.1 Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWACcLRPzmLYkRFHIKwc7UtHB95fy9flewSA-SHZA2z6IXJw1PyUvZwyX3lDoJDBPexCrEEyOwDTLyxHHt8oNKkxrxJAsTZ7QNgw_dmKVhYgBtGR8UozQGBAatJ8MEnEn99oospENiiLPgn62izXOkvkmLYK6-rV5bPevnofZXrt1oc Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 1394824ad6fd4ef686fafb5fb3c0b4e1 Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1394824ad6fd4ef686fafb5fb3c0b4e1", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 1394824ad6fd4ef686fafb5fb3c0b4e1 Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1618440225-project Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 02fcbf37964b49dfb597a4a1e95a299c Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225-project Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '46032186-539a-44ea-83fd-fd87925589d9'} Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.876670 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:14.881405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.881405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:14.881405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:14.881405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:14.881405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:14.881405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:14.881405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. Jul 12 11:54:14.881405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:14.883764 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-89ec4f87-955e-4656-ade3-94a950a3939b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Returning 404 to user: Instance 46032186-539a-44ea-83fd-fd87925589d9 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:14.885652 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-89ec4f87-955e-4656-ade3-94a950a3939b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9" status: 404 len: 111 microversion: 2.1 time: 0.113633 Jul 12 11:54:14.894893 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 643/1350] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:14 2022] GET /compute/v2.1/servers/46032186-539a-44ea-83fd-fd87925589d9 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 11:54:14.907026 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2d657d09-c5ca-48ad-a16a-6eadc99fb16b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:14.908061 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2d657d09-c5ca-48ad-a16a-6eadc99fb16b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:14.921649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d657d09-c5ca-48ad-a16a-6eadc99fb16b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:14.922603 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d657d09-c5ca-48ad-a16a-6eadc99fb16b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:14.926049 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d657d09-c5ca-48ad-a16a-6eadc99fb16b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:14.927068 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d657d09-c5ca-48ad-a16a-6eadc99fb16b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:14.932175 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:14.992741 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-2d657d09-c5ca-48ad-a16a-6eadc99fb16b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] HTTP exception thrown: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2d657d09-c5ca-48ad-a16a-6eadc99fb16b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Request method failure captured: Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e HTTP/1.1 Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWACcLRPzmLYkRFHIKwc7UtHB95fy9flewSA-SHZA2z6IXJw1PyUvZwyX3lDoJDBPexCrEEyOwDTLyxHHt8oNKkxrxJAsTZ7QNgw_dmKVhYgBtGR8UozQGBAatJ8MEnEn99oospENiiLPgn62izXOkvkmLYK6-rV5bPevnofZXrt1oc Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 1394824ad6fd4ef686fafb5fb3c0b4e1 Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1394824ad6fd4ef686fafb5fb3c0b4e1", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 1394824ad6fd4ef686fafb5fb3c0b4e1 Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1618440225-project Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 02fcbf37964b49dfb597a4a1e95a299c Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225-project Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'c809d104-cbc0-4f60-bd08-d9b669685f5e'} Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:15.000054 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:15.023457 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:15.023457 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:15.023457 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:15.023457 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:15.023457 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:15.023457 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:15.023457 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:15.023457 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:15.023457 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:15.023457 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:15.023457 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:15.023457 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2d657d09-c5ca-48ad-a16a-6eadc99fb16b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Returning 404 to user: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:15.023457 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2d657d09-c5ca-48ad-a16a-6eadc99fb16b tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 404 len: 111 microversion: 2.1 time: 0.105167 Jul 12 11:54:15.023457 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 644/1351] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:54:14 2022] DELETE /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:15.077492 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cf920587-693a-44e7-bbc7-a3630459e327 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:15.080418 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cf920587-693a-44e7-bbc7-a3630459e327 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] [instance: c809d104-cbc0-4f60-bd08-d9b669685f5e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:15.136976 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cf920587-693a-44e7-bbc7-a3630459e327 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:15.140537 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cf920587-693a-44e7-bbc7-a3630459e327 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:15.144843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cf920587-693a-44e7-bbc7-a3630459e327 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:15.146832 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cf920587-693a-44e7-bbc7-a3630459e327 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:15.198148 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-cf920587-693a-44e7-bbc7-a3630459e327 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] HTTP exception thrown: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cf920587-693a-44e7-bbc7-a3630459e327 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Request method failure captured: Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e HTTP/1.1 Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWACcLRPzmLYkRFHIKwc7UtHB95fy9flewSA-SHZA2z6IXJw1PyUvZwyX3lDoJDBPexCrEEyOwDTLyxHHt8oNKkxrxJAsTZ7QNgw_dmKVhYgBtGR8UozQGBAatJ8MEnEn99oospENiiLPgn62izXOkvkmLYK6-rV5bPevnofZXrt1oc Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 1394824ad6fd4ef686fafb5fb3c0b4e1 Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1394824ad6fd4ef686fafb5fb3c0b4e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1394824ad6fd4ef686fafb5fb3c0b4e1", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 1394824ad6fd4ef686fafb5fb3c0b4e1 Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225 Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1618440225-project Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 02fcbf37964b49dfb597a4a1e95a299c Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1618440225-project Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'c809d104-cbc0-4f60-bd08-d9b669685f5e'} Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:15.201150 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:15.206102 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:15.206102 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:15.206102 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:15.206102 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:15.206102 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:15.206102 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:15.206102 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. Jul 12 11:54:15.206102 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:15.210562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cf920587-693a-44e7-bbc7-a3630459e327 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] Returning 404 to user: Instance c809d104-cbc0-4f60-bd08-d9b669685f5e could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:15.217264 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cf920587-693a-44e7-bbc7-a3630459e327 tempest-ServersWithSpecificFlavorTestJSON-1618440225 tempest-ServersWithSpecificFlavorTestJSON-1618440225-project] 10.222.0.50 "GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e" status: 404 len: 111 microversion: 2.1 time: 0.183440 Jul 12 11:54:15.217992 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 645/1352] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:15 2022] GET /compute/v2.1/servers/c809d104-cbc0-4f60-bd08-d9b669685f5e => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:15.414895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1c69ec38-2979-4397-9133-2328fea16b5a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:15.425430 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1c69ec38-2979-4397-9133-2328fea16b5a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.634326 Jul 12 11:54:15.426092 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 708/1353] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:14 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:15.798671 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c61f0db1-7e3d-4a54-83b1-9cbd153161e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:15.800706 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c61f0db1-7e3d-4a54-83b1-9cbd153161e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:15.810545 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c61f0db1-7e3d-4a54-83b1-9cbd153161e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:15.811123 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c61f0db1-7e3d-4a54-83b1-9cbd153161e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:15.812189 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c61f0db1-7e3d-4a54-83b1-9cbd153161e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:15.812900 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c61f0db1-7e3d-4a54-83b1-9cbd153161e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:15.853119 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-520bc90e-13a9-4134-8681-6c18e55161ed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:15.853805 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-520bc90e-13a9-4134-8681-6c18e55161ed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:15.868163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-520bc90e-13a9-4134-8681-6c18e55161ed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:15.868562 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-520bc90e-13a9-4134-8681-6c18e55161ed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:15.871098 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-520bc90e-13a9-4134-8681-6c18e55161ed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:15.873529 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-520bc90e-13a9-4134-8681-6c18e55161ed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:15.943689 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-520bc90e-13a9-4134-8681-6c18e55161ed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:54:16.022947 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c61f0db1-7e3d-4a54-83b1-9cbd153161e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:16.032830 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c61f0db1-7e3d-4a54-83b1-9cbd153161e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1265 microversion: 2.1 time: 0.238840 Jul 12 11:54:16.040236 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 646/1354] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:15 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:16.130206 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e0e20f8b-5c3b-43e8-afa6-0f1d69a14745 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:16.131296 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e0e20f8b-5c3b-43e8-afa6-0f1d69a14745 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:16.139339 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0e20f8b-5c3b-43e8-afa6-0f1d69a14745 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:16.140200 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0e20f8b-5c3b-43e8-afa6-0f1d69a14745 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:16.141236 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0e20f8b-5c3b-43e8-afa6-0f1d69a14745 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:16.141971 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0e20f8b-5c3b-43e8-afa6-0f1d69a14745 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:16.178367 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-520bc90e-13a9-4134-8681-6c18e55161ed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 204 len: 0 microversion: 2.1 time: 0.329024 Jul 12 11:54:16.179005 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 709/1355] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:54:15 2022] DELETE /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:54:16.217433 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-40fa3828-a4b4-4bc3-82e3-d01f225a5fb6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:16.218675 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-40fa3828-a4b4-4bc3-82e3-d01f225a5fb6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:16.233180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40fa3828-a4b4-4bc3-82e3-d01f225a5fb6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:16.234203 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40fa3828-a4b4-4bc3-82e3-d01f225a5fb6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:16.237957 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40fa3828-a4b4-4bc3-82e3-d01f225a5fb6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:16.239026 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40fa3828-a4b4-4bc3-82e3-d01f225a5fb6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:16.482818 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e0e20f8b-5c3b-43e8-afa6-0f1d69a14745 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1859 microversion: 2.1 time: 0.357669 Jul 12 11:54:16.484694 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 647/1356] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:16 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1859 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:16.512790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-de22da42-206c-4a96-b317-965e6d061ee0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:16.513416 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-de22da42-206c-4a96-b317-965e6d061ee0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:16.543820 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-de22da42-206c-4a96-b317-965e6d061ee0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:16.545909 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-de22da42-206c-4a96-b317-965e6d061ee0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:16.546766 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-de22da42-206c-4a96-b317-965e6d061ee0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:16.547221 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-de22da42-206c-4a96-b317-965e6d061ee0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:16.791702 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-40fa3828-a4b4-4bc3-82e3-d01f225a5fb6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:16.803588 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-40fa3828-a4b4-4bc3-82e3-d01f225a5fb6 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1515 microversion: 2.1 time: 0.606406 Jul 12 11:54:16.805567 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 710/1357] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:16 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1515 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:16.810690 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-41331651-7052-4e94-b830-add2d5d127ce tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-849104-4", "block_migration": true, "disk_over_commit": false}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:16.812426 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-41331651-7052-4e94-b830-add2d5d127ce tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:16.819816 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-41331651-7052-4e94-b830-add2d5d127ce tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:16.821195 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-41331651-7052-4e94-b830-add2d5d127ce tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:16.822207 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-41331651-7052-4e94-b830-add2d5d127ce tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:16.822865 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-41331651-7052-4e94-b830-add2d5d127ce tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:16.876378 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-41331651-7052-4e94-b830-add2d5d127ce tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lazy-loading 'flavor' on Instance uuid dec6989c-9a01-4cd9-a91b-421af9130b46 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:54:16.911404 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-41331651-7052-4e94-b830-add2d5d127ce tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Going to try to live migrate instance to n-h1-849104-4 {{(pid=125984) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 12 11:54:17.147101 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-de22da42-206c-4a96-b317-965e6d061ee0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:17.160752 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-de22da42-206c-4a96-b317-965e6d061ee0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.655613 Jul 12 11:54:17.161343 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 648/1358] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:16 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:17.189284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7fb06838-e67b-4a9e-9078-ee8ab7d9a9fd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:17.191030 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7fb06838-e67b-4a9e-9078-ee8ab7d9a9fd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:17.213560 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7fb06838-e67b-4a9e-9078-ee8ab7d9a9fd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:17.215295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7fb06838-e67b-4a9e-9078-ee8ab7d9a9fd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:17.217922 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7fb06838-e67b-4a9e-9078-ee8ab7d9a9fd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:17.222615 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7fb06838-e67b-4a9e-9078-ee8ab7d9a9fd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:17.436549 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7fb06838-e67b-4a9e-9078-ee8ab7d9a9fd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:17.450010 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7fb06838-e67b-4a9e-9078-ee8ab7d9a9fd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1283 microversion: 2.1 time: 0.284450 Jul 12 11:54:17.450932 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 649/1359] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:17 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1283 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:17.833732 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4d7bd5c8-0297-448e-befe-9b34b1246b1c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:17.835482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4d7bd5c8-0297-448e-befe-9b34b1246b1c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:17.881442 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4d7bd5c8-0297-448e-befe-9b34b1246b1c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:17.881892 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4d7bd5c8-0297-448e-befe-9b34b1246b1c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:17.882721 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4d7bd5c8-0297-448e-befe-9b34b1246b1c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:17.888676 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4d7bd5c8-0297-448e-befe-9b34b1246b1c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:18.762768 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4d7bd5c8-0297-448e-befe-9b34b1246b1c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:18.776880 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4d7bd5c8-0297-448e-befe-9b34b1246b1c tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1515 microversion: 2.1 time: 0.947181 Jul 12 11:54:18.777597 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 650/1360] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:17 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1515 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:18.791863 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ca0d6e13-7114-444e-951c-08100f5e2e9f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:18.797672 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ca0d6e13-7114-444e-951c-08100f5e2e9f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:18.814012 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca0d6e13-7114-444e-951c-08100f5e2e9f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:18.814849 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca0d6e13-7114-444e-951c-08100f5e2e9f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:18.815847 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca0d6e13-7114-444e-951c-08100f5e2e9f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:18.816537 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca0d6e13-7114-444e-951c-08100f5e2e9f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:19.302799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ca0d6e13-7114-444e-951c-08100f5e2e9f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:19.317882 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ca0d6e13-7114-444e-951c-08100f5e2e9f tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.527898 Jul 12 11:54:19.321458 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 651/1361] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:18 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:19.337524 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c334b315-1d7b-4cd1-8432-956244ad6036 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:19.342103 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c334b315-1d7b-4cd1-8432-956244ad6036 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:19.359305 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c334b315-1d7b-4cd1-8432-956244ad6036 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:19.363885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c334b315-1d7b-4cd1-8432-956244ad6036 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:19.365439 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c334b315-1d7b-4cd1-8432-956244ad6036 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:19.367046 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c334b315-1d7b-4cd1-8432-956244ad6036 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:19.447832 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c334b315-1d7b-4cd1-8432-956244ad6036 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:54:19.606518 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c334b315-1d7b-4cd1-8432-956244ad6036 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 204 len: 0 microversion: 2.1 time: 0.282775 Jul 12 11:54:19.607426 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 652/1362] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:54:19 2022] DELETE /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:54:19.621879 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-42b26274-6a2b-457c-8b63-6ef90bcb89e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:19.622786 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-42b26274-6a2b-457c-8b63-6ef90bcb89e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:19.644972 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-42b26274-6a2b-457c-8b63-6ef90bcb89e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:19.645696 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-42b26274-6a2b-457c-8b63-6ef90bcb89e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:19.646681 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-42b26274-6a2b-457c-8b63-6ef90bcb89e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:19.647395 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-42b26274-6a2b-457c-8b63-6ef90bcb89e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:19.980915 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-42b26274-6a2b-457c-8b63-6ef90bcb89e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:19.998078 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-42b26274-6a2b-457c-8b63-6ef90bcb89e2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1271 microversion: 2.1 time: 0.386126 Jul 12 11:54:20.000261 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 653/1363] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:19 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1271 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:20.015098 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-45a3152d-3cc7-49e5-8df4-8f1b51175f9f req-cf826f79-8170-4dbf-b397-dd17bf172018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8de68ee-82f3-4e97-ac78-5be719aa8c6b", "name": "network-vif-plugged", "status": "completed", "tag": "e9841222-41fd-4fae-86a1-ee22db4e210f"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:20.053392 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-45a3152d-3cc7-49e5-8df4-8f1b51175f9f req-cf826f79-8170-4dbf-b397-dd17bf172018 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:20.055862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-45a3152d-3cc7-49e5-8df4-8f1b51175f9f req-cf826f79-8170-4dbf-b397-dd17bf172018 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:20.094573 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-45a3152d-3cc7-49e5-8df4-8f1b51175f9f req-cf826f79-8170-4dbf-b397-dd17bf172018 service nova] Creating event network-vif-plugged:e9841222-41fd-4fae-86a1-ee22db4e210f for instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b on n-h1-849104-4 Jul 12 11:54:20.110484 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-45a3152d-3cc7-49e5-8df4-8f1b51175f9f req-cf826f79-8170-4dbf-b397-dd17bf172018 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107921 Jul 12 11:54:20.113320 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 654/1364] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:20.128413 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ca8fbbc7-0ca0-4f8e-aa34-4c229a945fce tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:20.129723 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ca8fbbc7-0ca0-4f8e-aa34-4c229a945fce tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:20.141882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca8fbbc7-0ca0-4f8e-aa34-4c229a945fce tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:20.147976 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca8fbbc7-0ca0-4f8e-aa34-4c229a945fce tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:20.149063 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca8fbbc7-0ca0-4f8e-aa34-4c229a945fce tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:20.149946 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca8fbbc7-0ca0-4f8e-aa34-4c229a945fce tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:20.416583 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-41331651-7052-4e94-b830-add2d5d127ce tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/action" status: 202 len: 0 microversion: 2.1 time: 3.609221 Jul 12 11:54:20.417675 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 711/1365] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:54:16 2022] POST /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/action => generated 0 bytes in 3611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:54:20.440634 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fef4646c-f239-4387-9d22-7f674c651ebe tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:20.442176 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fef4646c-f239-4387-9d22-7f674c651ebe tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:20.457523 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fef4646c-f239-4387-9d22-7f674c651ebe tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:20.459122 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fef4646c-f239-4387-9d22-7f674c651ebe tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:20.460844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fef4646c-f239-4387-9d22-7f674c651ebe tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:20.461958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fef4646c-f239-4387-9d22-7f674c651ebe tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:20.658636 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fef4646c-f239-4387-9d22-7f674c651ebe tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:20.660430 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fef4646c-f239-4387-9d22-7f674c651ebe tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:20.662186 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-fef4646c-f239-4387-9d22-7f674c651ebe tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lazy-loading 'fault' on Instance uuid f300ccc7-18ee-45d7-8d82-a23ddff013eb {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:54:20.870399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ca8fbbc7-0ca0-4f8e-aa34-4c229a945fce tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:20.883547 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fef4646c-f239-4387-9d22-7f674c651ebe tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:20.886485 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ca8fbbc7-0ca0-4f8e-aa34-4c229a945fce tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1552 microversion: 2.1 time: 0.771765 Jul 12 11:54:20.887339 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 655/1366] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:20 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1552 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:20.895115 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fef4646c-f239-4387-9d22-7f674c651ebe tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 200 len: 1308 microversion: 2.1 time: 0.463812 Jul 12 11:54:20.896156 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 712/1367] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:20 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:21.227885 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-303dcb1a-ecc5-4fb7-ad3d-028bb2db9da4 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:21.229897 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:21.229897 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:54:21.231436 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-303dcb1a-ecc5-4fb7-ad3d-028bb2db9da4 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:21.231882 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-303dcb1a-ecc5-4fb7-ad3d-028bb2db9da4 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:21.235000 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-303dcb1a-ecc5-4fb7-ad3d-028bb2db9da4 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:21.235755 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-303dcb1a-ecc5-4fb7-ad3d-028bb2db9da4 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:21.236517 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-54b0a96b-bb51-4fe9-8661-7e02d8364b6f req-0bb88664-3c1d-4380-af3e-cbc6c6dfae63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f300ccc7-18ee-45d7-8d82-a23ddff013eb", "name": "network-vif-deleted", "tag": "b51cdaef-49cb-475a-aa61-b858be6b5ca0"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:21.258998 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-54b0a96b-bb51-4fe9-8661-7e02d8364b6f req-0bb88664-3c1d-4380-af3e-cbc6c6dfae63 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:21.259438 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-54b0a96b-bb51-4fe9-8661-7e02d8364b6f req-0bb88664-3c1d-4380-af3e-cbc6c6dfae63 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:21.286565 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-54b0a96b-bb51-4fe9-8661-7e02d8364b6f req-0bb88664-3c1d-4380-af3e-cbc6c6dfae63 service nova] Creating event network-vif-deleted:b51cdaef-49cb-475a-aa61-b858be6b5ca0 for instance f300ccc7-18ee-45d7-8d82-a23ddff013eb on n-h2-849104-4 Jul 12 11:54:21.292893 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-303dcb1a-ecc5-4fb7-ad3d-028bb2db9da4 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.394231 Jul 12 11:54:21.296274 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 713/1368] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:54:20 2022] GET /compute/v2.1/os-services => generated 944 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:21.310278 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-46cd9310-1620-4726-a50e-cb34daecb814 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:21.312455 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-54b0a96b-bb51-4fe9-8661-7e02d8364b6f req-0bb88664-3c1d-4380-af3e-cbc6c6dfae63 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.418515 Jul 12 11:54:21.312936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-46cd9310-1620-4726-a50e-cb34daecb814 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:21.314365 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 656/1369] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:21.318919 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:21.326846 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-93f7c3ee-6c6e-447f-b6d3-3f18372a7957 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:21.328277 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-93f7c3ee-6c6e-447f-b6d3-3f18372a7957 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:21.338610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93f7c3ee-6c6e-447f-b6d3-3f18372a7957 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:21.340478 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93f7c3ee-6c6e-447f-b6d3-3f18372a7957 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:21.342842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93f7c3ee-6c6e-447f-b6d3-3f18372a7957 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:21.343231 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46cd9310-1620-4726-a50e-cb34daecb814 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:21.344876 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46cd9310-1620-4726-a50e-cb34daecb814 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:21.347890 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46cd9310-1620-4726-a50e-cb34daecb814 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:21.348425 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93f7c3ee-6c6e-447f-b6d3-3f18372a7957 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:21.350236 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46cd9310-1620-4726-a50e-cb34daecb814 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:21.399424 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:21.823872 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-93f7c3ee-6c6e-447f-b6d3-3f18372a7957 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:21.844714 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-93f7c3ee-6c6e-447f-b6d3-3f18372a7957 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.528878 Jul 12 11:54:21.847697 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 657/1370] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:21 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:21.861362 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ef2caf5f-dc66-4e6d-a65d-4c47e5261826 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:21.865514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ef2caf5f-dc66-4e6d-a65d-4c47e5261826 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:21.881343 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ef2caf5f-dc66-4e6d-a65d-4c47e5261826 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:21.885105 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ef2caf5f-dc66-4e6d-a65d-4c47e5261826 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:21.886974 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ef2caf5f-dc66-4e6d-a65d-4c47e5261826 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:21.887618 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ef2caf5f-dc66-4e6d-a65d-4c47e5261826 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:22.012182 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-46cd9310-1620-4726-a50e-cb34daecb814 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:22.021110 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-46cd9310-1620-4726-a50e-cb34daecb814 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.723502 Jul 12 11:54:22.041667 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 714/1371] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:21 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:22.046740 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b073d1cb-cab1-4100-8e20-70d3ebcee5af tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:22.047883 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:22.047883 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:54:22.049433 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b073d1cb-cab1-4100-8e20-70d3ebcee5af tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:22.050088 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b073d1cb-cab1-4100-8e20-70d3ebcee5af tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:22.051299 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b073d1cb-cab1-4100-8e20-70d3ebcee5af tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:22.051909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b073d1cb-cab1-4100-8e20-70d3ebcee5af tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:22.109758 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b073d1cb-cab1-4100-8e20-70d3ebcee5af tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-849104-4" status: 200 len: 578 microversion: 2.1 time: 0.075420 Jul 12 11:54:22.110963 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 715/1372] 10.222.0.50 () {58 vars in 1171 bytes} [Tue Jul 12 11:54:22 2022] GET /compute/v2.1/os-services?host=n-d-849104-4 => generated 578 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:22.121951 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-05a4991f-5550-42b3-bd1a-a178c8754b2d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:22.123138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-05a4991f-5550-42b3-bd1a-a178c8754b2d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:22.139797 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05a4991f-5550-42b3-bd1a-a178c8754b2d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:22.140631 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05a4991f-5550-42b3-bd1a-a178c8754b2d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:22.141438 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05a4991f-5550-42b3-bd1a-a178c8754b2d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:22.142727 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05a4991f-5550-42b3-bd1a-a178c8754b2d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:22.279284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ef2caf5f-dc66-4e6d-a65d-4c47e5261826 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:22.294142 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ef2caf5f-dc66-4e6d-a65d-4c47e5261826 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1313 microversion: 2.1 time: 0.444367 Jul 12 11:54:22.295122 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 658/1373] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:21 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:22.313724 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0eebd347-84de-4827-969b-f77d815f1704 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:22.315148 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0eebd347-84de-4827-969b-f77d815f1704 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: f300ccc7-18ee-45d7-8d82-a23ddff013eb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:22.325410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0eebd347-84de-4827-969b-f77d815f1704 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:22.326337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0eebd347-84de-4827-969b-f77d815f1704 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:22.327740 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0eebd347-84de-4827-969b-f77d815f1704 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:22.328438 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0eebd347-84de-4827-969b-f77d815f1704 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:22.351091 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-0eebd347-84de-4827-969b-f77d815f1704 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] HTTP exception thrown: Instance f300ccc7-18ee-45d7-8d82-a23ddff013eb could not be found. Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0eebd347-84de-4827-969b-f77d815f1704 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Request method failure captured: Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb HTTP/1.1 Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWAr1EOgxbxpUalD2MtNKCdH5u0OkY2B7iGecusfTQ8KX4v1ufn8aY6EYeZ0GMRoBkXJDlfgKBSST4mYbDJYMORdxD26FROiIfSk4VrCi9xxp2yHsDjJsF-bq_lytxQqjPQ3dKAmGs57bjJ4y52cd3CX8pU2QnklKcf3gyXQOZbEMZI Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: bd080a7dad6c4a6ebf684e44bf7a6e76 Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-VolumesAdminNegativeTest-1169315287 Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd080a7dad6c4a6ebf684e44bf7a6e76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd080a7dad6c4a6ebf684e44bf7a6e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bd080a7dad6c4a6ebf684e44bf7a6e76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bd080a7dad6c4a6ebf684e44bf7a6e76", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-VolumesAdminNegativeTest-1169315287 Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: bd080a7dad6c4a6ebf684e44bf7a6e76 Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1169315287 Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-VolumesAdminNegativeTest-1169315287-project Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 5a7ca463d55047caa749c514a3e1499d Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-VolumesAdminNegativeTest-1169315287-project Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance f300ccc7-18ee-45d7-8d82-a23ddff013eb could not be found. Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'f300ccc7-18ee-45d7-8d82-a23ddff013eb'} Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f300ccc7-18ee-45d7-8d82-a23ddff013eb could not be found. Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f300ccc7-18ee-45d7-8d82-a23ddff013eb could not be found. Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:22.356214 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:22.360980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:22.360980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:22.360980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:22.360980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:22.360980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:22.360980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f300ccc7-18ee-45d7-8d82-a23ddff013eb could not be found. Jul 12 11:54:22.360980 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:22.374777 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0eebd347-84de-4827-969b-f77d815f1704 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Returning 404 to user: Instance f300ccc7-18ee-45d7-8d82-a23ddff013eb could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:22.375999 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0eebd347-84de-4827-969b-f77d815f1704 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb" status: 404 len: 111 microversion: 2.1 time: 0.066402 Jul 12 11:54:22.377835 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 659/1374] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:22 2022] GET /compute/v2.1/servers/f300ccc7-18ee-45d7-8d82-a23ddff013eb => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:22.385056 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-66f37daa-b37f-4e61-a270-3e3b6ecf9884 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:22.386809 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:22.386809 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:54:22.389433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66f37daa-b37f-4e61-a270-3e3b6ecf9884 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:22.390797 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66f37daa-b37f-4e61-a270-3e3b6ecf9884 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:22.392127 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66f37daa-b37f-4e61-a270-3e3b6ecf9884 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:22.392817 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66f37daa-b37f-4e61-a270-3e3b6ecf9884 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:22.443381 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-66f37daa-b37f-4e61-a270-3e3b6ecf9884 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.064167 Jul 12 11:54:22.446065 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 660/1375] 10.222.0.50 () {58 vars in 1175 bytes} [Tue Jul 12 11:54:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:22.453575 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-cd04062f-f204-4838-a173-53440779eaba req-50a73e86-74b1-4ebf-bd54-bdfde526aee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8de68ee-82f3-4e97-ac78-5be719aa8c6b", "name": "network-vif-plugged", "status": "completed", "tag": "99a0b5ce-e578-495f-b132-8d76185a41b7"}, {"server_uuid": "c8de68ee-82f3-4e97-ac78-5be719aa8c6b", "name": "network-vif-plugged", "status": "completed", "tag": "ee43e19e-89da-41b2-a198-fd95b27a574a"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:22.466660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-cd04062f-f204-4838-a173-53440779eaba req-50a73e86-74b1-4ebf-bd54-bdfde526aee6 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:22.468854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-cd04062f-f204-4838-a173-53440779eaba req-50a73e86-74b1-4ebf-bd54-bdfde526aee6 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:22.489550 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-cd04062f-f204-4838-a173-53440779eaba req-50a73e86-74b1-4ebf-bd54-bdfde526aee6 service nova] Creating event network-vif-plugged:99a0b5ce-e578-495f-b132-8d76185a41b7 for instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b on n-h1-849104-4 Jul 12 11:54:22.491336 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-cd04062f-f204-4838-a173-53440779eaba req-50a73e86-74b1-4ebf-bd54-bdfde526aee6 service nova] Creating event network-vif-plugged:ee43e19e-89da-41b2-a198-fd95b27a574a for instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b on n-h1-849104-4 Jul 12 11:54:22.503601 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-cd04062f-f204-4838-a173-53440779eaba req-50a73e86-74b1-4ebf-bd54-bdfde526aee6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052276 Jul 12 11:54:22.504768 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 661/1376] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:22.528897 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b616af0c-a83e-4f09-b824-88af034c6e95 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:22.531799 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:22.531799 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:54:22.533843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b616af0c-a83e-4f09-b824-88af034c6e95 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:22.534589 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b616af0c-a83e-4f09-b824-88af034c6e95 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:22.535824 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b616af0c-a83e-4f09-b824-88af034c6e95 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:22.536549 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b616af0c-a83e-4f09-b824-88af034c6e95 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:22.613724 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b616af0c-a83e-4f09-b824-88af034c6e95 tempest-ServicesAdminTestJSON-138644556 tempest-ServicesAdminTestJSON-138644556-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.107157 Jul 12 11:54:22.628230 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 662/1377] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:54:22 2022] GET /compute/v2.1/os-services => generated 944 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:22.866964 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f43907fe-26f5-40b1-ae7f-67fc264b5a0e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:22.868553 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f43907fe-26f5-40b1-ae7f-67fc264b5a0e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:22.885392 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f43907fe-26f5-40b1-ae7f-67fc264b5a0e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:22.891868 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f43907fe-26f5-40b1-ae7f-67fc264b5a0e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:22.893111 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f43907fe-26f5-40b1-ae7f-67fc264b5a0e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:22.898996 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f43907fe-26f5-40b1-ae7f-67fc264b5a0e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:22.923815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-05a4991f-5550-42b3-bd1a-a178c8754b2d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:22.961506 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-05a4991f-5550-42b3-bd1a-a178c8754b2d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1552 microversion: 2.1 time: 0.848040 Jul 12 11:54:22.972108 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 716/1378] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:22 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1552 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:23.050557 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a23ffd3b-0292-48a8-8866-4ccdfddd9bc5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:23.051651 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a23ffd3b-0292-48a8-8866-4ccdfddd9bc5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:23.065308 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a23ffd3b-0292-48a8-8866-4ccdfddd9bc5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:23.067426 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a23ffd3b-0292-48a8-8866-4ccdfddd9bc5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:23.069486 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a23ffd3b-0292-48a8-8866-4ccdfddd9bc5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:23.071659 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a23ffd3b-0292-48a8-8866-4ccdfddd9bc5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:23.520901 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a23ffd3b-0292-48a8-8866-4ccdfddd9bc5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:23.533431 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a23ffd3b-0292-48a8-8866-4ccdfddd9bc5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1353 microversion: 2.1 time: 0.485291 Jul 12 11:54:23.536956 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 717/1379] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:23 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1353 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:23.551045 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bc13da4e-8318-4573-8e65-a9e5e988b140 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:23.553752 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bc13da4e-8318-4573-8e65-a9e5e988b140 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:23.567485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc13da4e-8318-4573-8e65-a9e5e988b140 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:23.568286 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc13da4e-8318-4573-8e65-a9e5e988b140 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:23.569327 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc13da4e-8318-4573-8e65-a9e5e988b140 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:23.569987 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc13da4e-8318-4573-8e65-a9e5e988b140 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:23.983440 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f43907fe-26f5-40b1-ae7f-67fc264b5a0e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:24.015558 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f43907fe-26f5-40b1-ae7f-67fc264b5a0e tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 1.152361 Jul 12 11:54:24.024495 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 663/1380] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:22 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:24.265086 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bc13da4e-8318-4573-8e65-a9e5e988b140 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:24.279218 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bc13da4e-8318-4573-8e65-a9e5e988b140 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1313 microversion: 2.1 time: 0.739964 Jul 12 11:54:24.285355 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 718/1381] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:23 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1313 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:24.294382 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-557afc37-a6ba-426f-ba3b-abea7217eb2b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:24.295306 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-557afc37-a6ba-426f-ba3b-abea7217eb2b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:24.335110 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-557afc37-a6ba-426f-ba3b-abea7217eb2b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:24.341270 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-557afc37-a6ba-426f-ba3b-abea7217eb2b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:24.342530 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-557afc37-a6ba-426f-ba3b-abea7217eb2b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:24.342999 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-557afc37-a6ba-426f-ba3b-abea7217eb2b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:24.355229 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-c8055a06-1850-449b-951a-ccbca8bbe2e4 req-8dc7878b-3bc5-4aec-9888-252aed4c9612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be284e8-364a-45aa-97d4-944bfb60fc64", "name": "network-vif-deleted", "tag": "8ffbdeea-3f69-4b50-9b87-39003070cf5a"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:24.405300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-c8055a06-1850-449b-951a-ccbca8bbe2e4 req-8dc7878b-3bc5-4aec-9888-252aed4c9612 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:24.405300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-c8055a06-1850-449b-951a-ccbca8bbe2e4 req-8dc7878b-3bc5-4aec-9888-252aed4c9612 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:24.462798 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-c8055a06-1850-449b-951a-ccbca8bbe2e4 req-8dc7878b-3bc5-4aec-9888-252aed4c9612 service nova] Creating event network-vif-deleted:8ffbdeea-3f69-4b50-9b87-39003070cf5a for instance 6be284e8-364a-45aa-97d4-944bfb60fc64 on n-h1-849104-4 Jul 12 11:54:24.482807 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-c8055a06-1850-449b-951a-ccbca8bbe2e4 req-8dc7878b-3bc5-4aec-9888-252aed4c9612 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.456459 Jul 12 11:54:24.497087 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 664/1382] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:24.564178 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-89d86eea-308f-4550-8235-c357107bf1b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:24.565474 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-89d86eea-308f-4550-8235-c357107bf1b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:24.579145 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89d86eea-308f-4550-8235-c357107bf1b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:24.582904 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89d86eea-308f-4550-8235-c357107bf1b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:24.584300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89d86eea-308f-4550-8235-c357107bf1b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:24.592045 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89d86eea-308f-4550-8235-c357107bf1b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:24.766035 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=10 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:25.309214 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-89d86eea-308f-4550-8235-c357107bf1b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:25.325017 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-89d86eea-308f-4550-8235-c357107bf1b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1802 microversion: 2.1 time: 0.767236 Jul 12 11:54:25.329840 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 665/1383] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:24 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1802 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:25.360859 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e1637720-59f2-4f4c-9536-0becc7f39191 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:25.361513 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e1637720-59f2-4f4c-9536-0becc7f39191 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:25.384566 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1637720-59f2-4f4c-9536-0becc7f39191 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:25.385955 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1637720-59f2-4f4c-9536-0becc7f39191 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:25.389070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1637720-59f2-4f4c-9536-0becc7f39191 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:25.391805 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1637720-59f2-4f4c-9536-0becc7f39191 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:25.437738 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-557afc37-a6ba-426f-ba3b-abea7217eb2b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:25.448271 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-557afc37-a6ba-426f-ba3b-abea7217eb2b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1345 microversion: 2.1 time: 1.161237 Jul 12 11:54:25.456639 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 719/1384] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:24 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1345 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:25.468834 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-90d4a089-cf7f-4bff-bd5e-5936bf515d23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:25.469959 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-90d4a089-cf7f-4bff-bd5e-5936bf515d23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:25.511477 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90d4a089-cf7f-4bff-bd5e-5936bf515d23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:25.511947 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90d4a089-cf7f-4bff-bd5e-5936bf515d23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:25.521177 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90d4a089-cf7f-4bff-bd5e-5936bf515d23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:25.521726 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90d4a089-cf7f-4bff-bd5e-5936bf515d23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:26.196657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e1637720-59f2-4f4c-9536-0becc7f39191 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:26.200415 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-90d4a089-cf7f-4bff-bd5e-5936bf515d23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:26.208595 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-90d4a089-cf7f-4bff-bd5e-5936bf515d23 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1313 microversion: 2.1 time: 0.750302 Jul 12 11:54:26.219405 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 720/1385] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:25 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1313 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:26.239996 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-78078394-4221-4943-a868-a807ba0ee36a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:26.240870 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-78078394-4221-4943-a868-a807ba0ee36a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:26.246562 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e1637720-59f2-4f4c-9536-0becc7f39191 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.899404 Jul 12 11:54:26.250258 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 666/1386] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:25 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:26.270374 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78078394-4221-4943-a868-a807ba0ee36a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:26.274468 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78078394-4221-4943-a868-a807ba0ee36a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:26.276345 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78078394-4221-4943-a868-a807ba0ee36a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:26.284977 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78078394-4221-4943-a868-a807ba0ee36a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:26.354396 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-78078394-4221-4943-a868-a807ba0ee36a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b/ips" status: 200 len: 217 microversion: 2.1 time: 0.132623 Jul 12 11:54:26.365731 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 721/1387] 10.222.0.50 () {58 vars in 1247 bytes} [Tue Jul 12 11:54:26 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b/ips => generated 217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:26.388240 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5b3bbf49-f43d-4a73-9920-022ffa85e440 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:26.392934 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5b3bbf49-f43d-4a73-9920-022ffa85e440 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:26.429025 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5b3bbf49-f43d-4a73-9920-022ffa85e440 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:26.436771 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5b3bbf49-f43d-4a73-9920-022ffa85e440 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:26.439932 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5b3bbf49-f43d-4a73-9920-022ffa85e440 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:26.441018 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5b3bbf49-f43d-4a73-9920-022ffa85e440 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:26.474217 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-81fd39f7-2f78-4780-bc53-f2d60d0b1df0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:26.475102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-81fd39f7-2f78-4780-bc53-f2d60d0b1df0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:26.484452 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5b3bbf49-f43d-4a73-9920-022ffa85e440 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:54:26.497294 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-81fd39f7-2f78-4780-bc53-f2d60d0b1df0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:26.500562 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-81fd39f7-2f78-4780-bc53-f2d60d0b1df0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:26.501561 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-81fd39f7-2f78-4780-bc53-f2d60d0b1df0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:26.502116 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-81fd39f7-2f78-4780-bc53-f2d60d0b1df0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:26.690555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:26.719251 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5b3bbf49-f43d-4a73-9920-022ffa85e440 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 204 len: 0 microversion: 2.1 time: 0.345121 Jul 12 11:54:26.720254 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 667/1388] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:54:26 2022] DELETE /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:54:26.728492 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-81fd39f7-2f78-4780-bc53-f2d60d0b1df0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:26.734469 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-696decea-2f51-4fb0-9084-fc1911c43aed req-28a352a8-1de2-4cfe-8309-fab53888b995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69bfc910-f0c8-4290-a296-881b4381b84e", "tag": "9888919a-4e04-47ae-b8f2-1a4693dcc22a"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:26.743031 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:26.751831 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-81fd39f7-2f78-4780-bc53-f2d60d0b1df0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1345 microversion: 2.1 time: 0.280670 Jul 12 11:54:26.763103 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-696decea-2f51-4fb0-9084-fc1911c43aed req-28a352a8-1de2-4cfe-8309-fab53888b995 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:26.763103 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-696decea-2f51-4fb0-9084-fc1911c43aed req-28a352a8-1de2-4cfe-8309-fab53888b995 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:26.764290 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 722/1389] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:26 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1345 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:26.780842 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5e206ecb-d9a8-4abe-b73d-e361cf777437 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:26.782553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5e206ecb-d9a8-4abe-b73d-e361cf777437 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:26.787884 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-696decea-2f51-4fb0-9084-fc1911c43aed req-28a352a8-1de2-4cfe-8309-fab53888b995 service nova] Creating event network-changed:9888919a-4e04-47ae-b8f2-1a4693dcc22a for instance 69bfc910-f0c8-4290-a296-881b4381b84e on n-h2-849104-4 Jul 12 11:54:26.799099 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5e206ecb-d9a8-4abe-b73d-e361cf777437 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:26.800496 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5e206ecb-d9a8-4abe-b73d-e361cf777437 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:26.803290 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5e206ecb-d9a8-4abe-b73d-e361cf777437 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:26.804311 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-696decea-2f51-4fb0-9084-fc1911c43aed req-28a352a8-1de2-4cfe-8309-fab53888b995 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075071 Jul 12 11:54:26.805359 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 668/1390] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:26.806616 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5e206ecb-d9a8-4abe-b73d-e361cf777437 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:27.227338 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-701feb1a-7553-4b23-963c-4048cd922ef5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:27.228180 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-701feb1a-7553-4b23-963c-4048cd922ef5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:27.256288 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-701feb1a-7553-4b23-963c-4048cd922ef5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:27.257065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-701feb1a-7553-4b23-963c-4048cd922ef5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:27.259649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-701feb1a-7553-4b23-963c-4048cd922ef5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:27.265193 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-701feb1a-7553-4b23-963c-4048cd922ef5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:27.651293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5e206ecb-d9a8-4abe-b73d-e361cf777437 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:27.664620 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5e206ecb-d9a8-4abe-b73d-e361cf777437 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1808 microversion: 2.1 time: 0.892554 Jul 12 11:54:27.668560 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 723/1391] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:26 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1808 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:27.686133 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d9cc0065-ff54-48b0-bc7a-0cf9383d1072 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:27.690756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d9cc0065-ff54-48b0-bc7a-0cf9383d1072 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:27.723802 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9cc0065-ff54-48b0-bc7a-0cf9383d1072 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:27.724285 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9cc0065-ff54-48b0-bc7a-0cf9383d1072 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:27.725076 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9cc0065-ff54-48b0-bc7a-0cf9383d1072 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:27.725512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9cc0065-ff54-48b0-bc7a-0cf9383d1072 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:28.241719 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-701feb1a-7553-4b23-963c-4048cd922ef5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:28.257746 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-701feb1a-7553-4b23-963c-4048cd922ef5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1313 microversion: 2.1 time: 1.035192 Jul 12 11:54:28.260609 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 669/1392] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:27 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1313 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:28.293746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c08bf2fa-4069-4a33-b069-590f9954cccc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:28.295962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c08bf2fa-4069-4a33-b069-590f9954cccc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:28.311518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c08bf2fa-4069-4a33-b069-590f9954cccc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:28.315132 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c08bf2fa-4069-4a33-b069-590f9954cccc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:28.316307 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c08bf2fa-4069-4a33-b069-590f9954cccc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:28.316974 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c08bf2fa-4069-4a33-b069-590f9954cccc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:28.717809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c08bf2fa-4069-4a33-b069-590f9954cccc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:28.729677 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c08bf2fa-4069-4a33-b069-590f9954cccc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1345 microversion: 2.1 time: 0.463851 Jul 12 11:54:28.736570 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 670/1393] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:28 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1345 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:28.890915 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d9cc0065-ff54-48b0-bc7a-0cf9383d1072 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:28.902091 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d9cc0065-ff54-48b0-bc7a-0cf9383d1072 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 1.230794 Jul 12 11:54:28.903918 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3e98046a-5258-49b6-bc60-756c2e170472 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] 10.222.0.50 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.160340 Jul 12 11:54:28.904643 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 671/1394] 10.222.0.50 () {58 vars in 1127 bytes} [Tue Jul 12 11:54:28 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 11:54:28.911921 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0d2fb329-65f5-4604-9bbb-eeda7f4763b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:28.913385 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 724/1395] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:27 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:28.923221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ccbf9513-f0f0-4d3b-b4e3-b8ea2026e9b8 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Calling method '.version_select at 0x7f5e0a6fdaf0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:28.931350 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0d2fb329-65f5-4604-9bbb-eeda7f4763b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:28.953304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0d2fb329-65f5-4604-9bbb-eeda7f4763b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:28.955179 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0d2fb329-65f5-4604-9bbb-eeda7f4763b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:28.956986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0d2fb329-65f5-4604-9bbb-eeda7f4763b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:28.960233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0d2fb329-65f5-4604-9bbb-eeda7f4763b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:28.979765 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-ccbf9513-f0f0-4d3b-b4e3-b8ea2026e9b8 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] HTTP exception thrown: Image not found. Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ccbf9513-f0f0-4d3b-b4e3-b8ea2026e9b8 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Request method failure captured: Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWD0ALnMqnRfov5ws3NrTBsy9IFIM_Zk9Sm3Mnk-4HBvbcn3K0DiLhab8CfkKeIn4fN-wej_eh0xUqf7EvmYBGc8KmKnL8Y29C-TdCwz4W11IKSaAW0aUdLQinaIQB-zau9pOeCU_xwiyI0p_OsNWPT6AfyDW46WmGraWdmiMr1tBkk Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a27a8ef6708e4da2a8e6fdcfd17f865d Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a27a8ef6708e4da2a8e6fdcfd17f865d", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a27a8ef6708e4da2a8e6fdcfd17f865d Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ImagesDeleteNegativeTestJSON-294790562-project Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4758bf3301a44de9ae8cc3a08d1051b8 Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-294790562-project Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: exception: Image not found. Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '-1'} Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:28.989113 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ccbf9513-f0f0-4d3b-b4e3-b8ea2026e9b8 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Returning 404 to user: Image not found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:28.995734 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ccbf9513-f0f0-4d3b-b4e3-b8ea2026e9b8 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] 10.222.0.50 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.076250 Jul 12 11:54:28.998068 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 725/1396] 10.222.0.50 () {58 vars in 1133 bytes} [Tue Jul 12 11:54:28 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:54:29.001809 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4ccfd359-aca5-4e9f-b8ca-3dbf09d2ab38 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Calling method '.version_select at 0x7f5e09c5ee50>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:29.042844 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-4ccfd359-aca5-4e9f-b8ca-3dbf09d2ab38 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] HTTP exception thrown: Image not found. Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4ccfd359-aca5-4e9f-b8ca-3dbf09d2ab38 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Request method failure captured: Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/images/927c5c99-98d6-4adb-9722-34dc1f33218j HTTP/1.1 Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWD0ALnMqnRfov5ws3NrTBsy9IFIM_Zk9Sm3Mnk-4HBvbcn3K0DiLhab8CfkKeIn4fN-wej_eh0xUqf7EvmYBGc8KmKnL8Y29C-TdCwz4W11IKSaAW0aUdLQinaIQB-zau9pOeCU_xwiyI0p_OsNWPT6AfyDW46WmGraWdmiMr1tBkk Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a27a8ef6708e4da2a8e6fdcfd17f865d Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a27a8ef6708e4da2a8e6fdcfd17f865d", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a27a8ef6708e4da2a8e6fdcfd17f865d Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ImagesDeleteNegativeTestJSON-294790562-project Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4758bf3301a44de9ae8cc3a08d1051b8 Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-294790562-project Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: exception: Image not found. Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '927c5c99-98d6-4adb-9722-34dc1f33218j'} Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 927c5c99-98d6-4adb-9722-34dc1f33218j to delete Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 927c5c99-98d6-4adb-9722-34dc1f33218j could not be found. Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:29.045373 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 12 11:54:29.049889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.054851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4ccfd359-aca5-4e9f-b8ca-3dbf09d2ab38 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Returning 404 to user: Image not found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:29.056479 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4ccfd359-aca5-4e9f-b8ca-3dbf09d2ab38 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] 10.222.0.50 "DELETE /compute/v2.1/images/927c5c99-98d6-4adb-9722-34dc1f33218j" status: 404 len: 62 microversion: 2.1 time: 0.058498 Jul 12 11:54:29.057355 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 726/1397] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:28 2022] DELETE /compute/v2.1/images/927c5c99-98d6-4adb-9722-34dc1f33218j => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:54:29.068309 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-597bbec3-e6de-4e6d-89e2-26c8f4761c91 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Calling method '.version_select at 0x7f5e09c6eb80>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:29.091158 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-597bbec3-e6de-4e6d-89e2-26c8f4761c91 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] HTTP exception thrown: Image not found. Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-597bbec3-e6de-4e6d-89e2-26c8f4761c91 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Request method failure captured: Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/images/604052c7-222b-4f4e-bc22-df1d4991afe21 HTTP/1.1 Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWD0ALnMqnRfov5ws3NrTBsy9IFIM_Zk9Sm3Mnk-4HBvbcn3K0DiLhab8CfkKeIn4fN-wej_eh0xUqf7EvmYBGc8KmKnL8Y29C-TdCwz4W11IKSaAW0aUdLQinaIQB-zau9pOeCU_xwiyI0p_OsNWPT6AfyDW46WmGraWdmiMr1tBkk Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a27a8ef6708e4da2a8e6fdcfd17f865d Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a27a8ef6708e4da2a8e6fdcfd17f865d", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a27a8ef6708e4da2a8e6fdcfd17f865d Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ImagesDeleteNegativeTestJSON-294790562-project Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4758bf3301a44de9ae8cc3a08d1051b8 Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-294790562-project Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: exception: Image not found. Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '604052c7-222b-4f4e-bc22-df1d4991afe21'} Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 604052c7-222b-4f4e-bc22-df1d4991afe21 to delete Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 604052c7-222b-4f4e-bc22-df1d4991afe21 could not be found. Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:29.093354 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 12 11:54:29.098494 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.101703 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-597bbec3-e6de-4e6d-89e2-26c8f4761c91 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Returning 404 to user: Image not found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:29.103482 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-597bbec3-e6de-4e6d-89e2-26c8f4761c91 tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] 10.222.0.50 "DELETE /compute/v2.1/images/604052c7-222b-4f4e-bc22-df1d4991afe21" status: 404 len: 62 microversion: 2.1 time: 0.038599 Jul 12 11:54:29.104294 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 727/1398] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:54:29 2022] DELETE /compute/v2.1/images/604052c7-222b-4f4e-bc22-df1d4991afe21 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:54:29.115351 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bf2a49b3-c6bb-4293-80b4-18ab2a9e4bcf tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Calling method '.version_select at 0x7f5e09c74160>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:29.144958 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-bf2a49b3-c6bb-4293-80b4-18ab2a9e4bcf tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] HTTP exception thrown: Image not found. Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bf2a49b3-c6bb-4293-80b4-18ab2a9e4bcf tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Request method failure captured: Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/images/tempest-invalid-1844350102 HTTP/1.1 Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWD0ALnMqnRfov5ws3NrTBsy9IFIM_Zk9Sm3Mnk-4HBvbcn3K0DiLhab8CfkKeIn4fN-wej_eh0xUqf7EvmYBGc8KmKnL8Y29C-TdCwz4W11IKSaAW0aUdLQinaIQB-zau9pOeCU_xwiyI0p_OsNWPT6AfyDW46WmGraWdmiMr1tBkk Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a27a8ef6708e4da2a8e6fdcfd17f865d Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a27a8ef6708e4da2a8e6fdcfd17f865d", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a27a8ef6708e4da2a8e6fdcfd17f865d Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ImagesDeleteNegativeTestJSON-294790562-project Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4758bf3301a44de9ae8cc3a08d1051b8 Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-294790562-project Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: exception: Image not found. Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'tempest-invalid-1844350102'} Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1844350102 to delete Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1844350102 could not be found. Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.147150 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 12 11:54:29.151567 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.154606 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bf2a49b3-c6bb-4293-80b4-18ab2a9e4bcf tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Returning 404 to user: Image not found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:29.155689 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bf2a49b3-c6bb-4293-80b4-18ab2a9e4bcf tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] 10.222.0.50 "DELETE /compute/v2.1/images/tempest-invalid-1844350102" status: 404 len: 62 microversion: 2.1 time: 0.045979 Jul 12 11:54:29.156937 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 728/1399] 10.222.0.50 () {58 vars in 1205 bytes} [Tue Jul 12 11:54:29 2022] DELETE /compute/v2.1/images/tempest-invalid-1844350102 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:54:29.174213 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-11de162b-20f3-43e7-bcc2-5ee3c1d4678b tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Calling method '.version_select at 0x7f5e09d14820>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:29.210046 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-11de162b-20f3-43e7-bcc2-5ee3c1d4678b tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] HTTP exception thrown: Image not found. Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-11de162b-20f3-43e7-bcc2-5ee3c1d4678b tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Request method failure captured: Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/images/716f70d7-9be1-4835-89e1-aed1277a5715 HTTP/1.1 Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWD0ALnMqnRfov5ws3NrTBsy9IFIM_Zk9Sm3Mnk-4HBvbcn3K0DiLhab8CfkKeIn4fN-wej_eh0xUqf7EvmYBGc8KmKnL8Y29C-TdCwz4W11IKSaAW0aUdLQinaIQB-zau9pOeCU_xwiyI0p_OsNWPT6AfyDW46WmGraWdmiMr1tBkk Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: a27a8ef6708e4da2a8e6fdcfd17f865d Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a27a8ef6708e4da2a8e6fdcfd17f865d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a27a8ef6708e4da2a8e6fdcfd17f865d", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: a27a8ef6708e4da2a8e6fdcfd17f865d Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-294790562 Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ImagesDeleteNegativeTestJSON-294790562-project Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4758bf3301a44de9ae8cc3a08d1051b8 Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-294790562-project Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: exception: Image not found. Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '716f70d7-9be1-4835-89e1-aed1277a5715'} Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 716f70d7-9be1-4835-89e1-aed1277a5715 to delete Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 716f70d7-9be1-4835-89e1-aed1277a5715 could not be found. Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:29.212236 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 12 11:54:29.218884 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:29.225508 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-11de162b-20f3-43e7-bcc2-5ee3c1d4678b tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] Returning 404 to user: Image not found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:29.227236 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-11de162b-20f3-43e7-bcc2-5ee3c1d4678b tempest-ImagesDeleteNegativeTestJSON-294790562 tempest-ImagesDeleteNegativeTestJSON-294790562-project] 10.222.0.50 "DELETE /compute/v2.1/images/716f70d7-9be1-4835-89e1-aed1277a5715" status: 404 len: 62 microversion: 2.1 time: 0.065081 Jul 12 11:54:29.228048 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 729/1400] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:29 2022] DELETE /compute/v2.1/images/716f70d7-9be1-4835-89e1-aed1277a5715 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 12 11:54:29.289537 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-20656856-98dd-45a0-99a9-8c2d92badc6d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:29.290905 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-20656856-98dd-45a0-99a9-8c2d92badc6d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:29.301883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20656856-98dd-45a0-99a9-8c2d92badc6d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:29.302681 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20656856-98dd-45a0-99a9-8c2d92badc6d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:29.303743 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20656856-98dd-45a0-99a9-8c2d92badc6d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:29.305154 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20656856-98dd-45a0-99a9-8c2d92badc6d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:29.654590 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0d2fb329-65f5-4604-9bbb-eeda7f4763b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:29.667735 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0d2fb329-65f5-4604-9bbb-eeda7f4763b5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1808 microversion: 2.1 time: 0.761874 Jul 12 11:54:29.671182 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 672/1401] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:28 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1808 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:29.753653 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-76f2fc1a-e1c5-4188-bca9-f472b9300501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:29.754407 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-76f2fc1a-e1c5-4188-bca9-f472b9300501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:29.770937 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76f2fc1a-e1c5-4188-bca9-f472b9300501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:29.772668 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76f2fc1a-e1c5-4188-bca9-f472b9300501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:29.774389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76f2fc1a-e1c5-4188-bca9-f472b9300501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:29.776316 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76f2fc1a-e1c5-4188-bca9-f472b9300501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:29.959881 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-20656856-98dd-45a0-99a9-8c2d92badc6d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:29.971583 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-20656856-98dd-45a0-99a9-8c2d92badc6d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1313 microversion: 2.1 time: 0.692740 Jul 12 11:54:29.988219 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 730/1402] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:29 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1313 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:29.997533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-994801ba-01fb-49ac-9d15-970f3cae80fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:30.000010 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-994801ba-01fb-49ac-9d15-970f3cae80fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:30.012587 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-994801ba-01fb-49ac-9d15-970f3cae80fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:30.017729 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-994801ba-01fb-49ac-9d15-970f3cae80fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:30.019375 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-994801ba-01fb-49ac-9d15-970f3cae80fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:30.019844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-994801ba-01fb-49ac-9d15-970f3cae80fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:30.149247 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-76f2fc1a-e1c5-4188-bca9-f472b9300501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:30.159626 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-76f2fc1a-e1c5-4188-bca9-f472b9300501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1345 microversion: 2.1 time: 0.409903 Jul 12 11:54:30.165343 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 673/1403] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:29 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1345 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:30.287556 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-994801ba-01fb-49ac-9d15-970f3cae80fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:30.299612 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-994801ba-01fb-49ac-9d15-970f3cae80fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.310080 Jul 12 11:54:30.304122 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 731/1404] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:29 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:30.505428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-3a1e1979-4d72-4329-9152-54fa3544ccbd req-167e52c6-ecfd-42e2-92ff-4aa94104a738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8de68ee-82f3-4e97-ac78-5be719aa8c6b", "name": "network-vif-deleted", "tag": "ee43e19e-89da-41b2-a198-fd95b27a574a"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:30.575116 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-3a1e1979-4d72-4329-9152-54fa3544ccbd req-167e52c6-ecfd-42e2-92ff-4aa94104a738 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:30.578663 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-3a1e1979-4d72-4329-9152-54fa3544ccbd req-167e52c6-ecfd-42e2-92ff-4aa94104a738 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:30.609901 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-3a1e1979-4d72-4329-9152-54fa3544ccbd req-167e52c6-ecfd-42e2-92ff-4aa94104a738 service nova] Creating event network-vif-deleted:ee43e19e-89da-41b2-a198-fd95b27a574a for instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b on n-h1-849104-4 Jul 12 11:54:30.630052 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-3a1e1979-4d72-4329-9152-54fa3544ccbd req-167e52c6-ecfd-42e2-92ff-4aa94104a738 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137743 Jul 12 11:54:30.632998 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 674/1405] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:30.689814 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8e79f9b3-bc9a-4581-a5a6-cca917147488 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:30.690826 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8e79f9b3-bc9a-4581-a5a6-cca917147488 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:30.716932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8e79f9b3-bc9a-4581-a5a6-cca917147488 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:30.717482 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8e79f9b3-bc9a-4581-a5a6-cca917147488 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:30.722986 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8e79f9b3-bc9a-4581-a5a6-cca917147488 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:30.723463 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8e79f9b3-bc9a-4581-a5a6-cca917147488 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:30.999630 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ad59e750-009e-4f10-8015-9b09155ec8a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:31.000389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ad59e750-009e-4f10-8015-9b09155ec8a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:31.031191 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ad59e750-009e-4f10-8015-9b09155ec8a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:31.031664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ad59e750-009e-4f10-8015-9b09155ec8a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:31.032516 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ad59e750-009e-4f10-8015-9b09155ec8a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:31.038390 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ad59e750-009e-4f10-8015-9b09155ec8a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:31.235957 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8e79f9b3-bc9a-4581-a5a6-cca917147488 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:31.250585 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8e79f9b3-bc9a-4581-a5a6-cca917147488 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1672 microversion: 2.1 time: 0.565012 Jul 12 11:54:31.251422 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 732/1406] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:30 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1672 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:31.256379 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9c99f9bc-72e9-4727-973f-0b6dd6967998 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:31.259851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9c99f9bc-72e9-4727-973f-0b6dd6967998 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:31.270801 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c99f9bc-72e9-4727-973f-0b6dd6967998 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:31.271646 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c99f9bc-72e9-4727-973f-0b6dd6967998 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:31.272695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c99f9bc-72e9-4727-973f-0b6dd6967998 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:31.273942 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c99f9bc-72e9-4727-973f-0b6dd6967998 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:31.394317 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9c99f9bc-72e9-4727-973f-0b6dd6967998 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:31.412108 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9c99f9bc-72e9-4727-973f-0b6dd6967998 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1345 microversion: 2.1 time: 0.159320 Jul 12 11:54:31.412748 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 733/1407] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:31 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1345 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:31.418180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cc9ee0da-6a7d-4828-93c4-b0c752e4b2d6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:31.419042 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cc9ee0da-6a7d-4828-93c4-b0c752e4b2d6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:31.432024 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cc9ee0da-6a7d-4828-93c4-b0c752e4b2d6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:31.435061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cc9ee0da-6a7d-4828-93c4-b0c752e4b2d6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:31.435907 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cc9ee0da-6a7d-4828-93c4-b0c752e4b2d6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:31.438138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cc9ee0da-6a7d-4828-93c4-b0c752e4b2d6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:31.698222 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ad59e750-009e-4f10-8015-9b09155ec8a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:31.709602 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ad59e750-009e-4f10-8015-9b09155ec8a4 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1313 microversion: 2.1 time: 0.723331 Jul 12 11:54:31.710600 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 675/1408] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:30 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1313 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:31.739925 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cc9ee0da-6a7d-4828-93c4-b0c752e4b2d6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:31.753145 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cc9ee0da-6a7d-4828-93c4-b0c752e4b2d6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.339138 Jul 12 11:54:31.760343 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 734/1409] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:31 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:32.269407 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cbe628bf-52c1-435b-bb15-c3e9ba1f42d9 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:32.270262 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cbe628bf-52c1-435b-bb15-c3e9ba1f42d9 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:32.295180 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cbe628bf-52c1-435b-bb15-c3e9ba1f42d9 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:32.295741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cbe628bf-52c1-435b-bb15-c3e9ba1f42d9 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:32.303526 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cbe628bf-52c1-435b-bb15-c3e9ba1f42d9 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:32.307859 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cbe628bf-52c1-435b-bb15-c3e9ba1f42d9 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:32.434558 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7a2aaa48-43a7-4f13-a5c6-4b78158907cb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:32.435171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7a2aaa48-43a7-4f13-a5c6-4b78158907cb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:32.438116 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:32.458129 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7a2aaa48-43a7-4f13-a5c6-4b78158907cb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:32.458604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7a2aaa48-43a7-4f13-a5c6-4b78158907cb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:32.459416 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7a2aaa48-43a7-4f13-a5c6-4b78158907cb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:32.459857 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7a2aaa48-43a7-4f13-a5c6-4b78158907cb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:32.547660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=4 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:33.193643 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7a2aaa48-43a7-4f13-a5c6-4b78158907cb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:33.208291 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7a2aaa48-43a7-4f13-a5c6-4b78158907cb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 200 len: 1345 microversion: 2.1 time: 0.777667 Jul 12 11:54:33.220996 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 735/1410] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:32 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 1345 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:33.238035 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-239f9957-efe7-4c58-80bf-5033ecc1bad7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:33.238035 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-239f9957-efe7-4c58-80bf-5033ecc1bad7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:33.264489 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-239f9957-efe7-4c58-80bf-5033ecc1bad7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:33.266040 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-239f9957-efe7-4c58-80bf-5033ecc1bad7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:33.268425 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-239f9957-efe7-4c58-80bf-5033ecc1bad7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:33.269282 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-239f9957-efe7-4c58-80bf-5033ecc1bad7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:33.534983 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-cbe628bf-52c1-435b-bb15-c3e9ba1f42d9 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:33.571369 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cbe628bf-52c1-435b-bb15-c3e9ba1f42d9 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1651 microversion: 2.1 time: 1.302567 Jul 12 11:54:33.573043 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 676/1411] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:32 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1651 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:33.615082 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5ba695fe-3973-4efd-b481-3ff9fbbe5d9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:33.620823 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5ba695fe-3973-4efd-b481-3ff9fbbe5d9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:33.661342 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5ba695fe-3973-4efd-b481-3ff9fbbe5d9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:33.662923 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5ba695fe-3973-4efd-b481-3ff9fbbe5d9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:33.684679 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5ba695fe-3973-4efd-b481-3ff9fbbe5d9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:33.686242 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5ba695fe-3973-4efd-b481-3ff9fbbe5d9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:33.963982 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-239f9957-efe7-4c58-80bf-5033ecc1bad7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:33.980919 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-239f9957-efe7-4c58-80bf-5033ecc1bad7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1313 microversion: 2.1 time: 0.758619 Jul 12 11:54:33.982297 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 736/1412] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:33 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1313 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:34.305553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-af14dd4a-d5de-4250-8061-9af0f10604a0 req-80f3d031-5b83-4754-885e-b016ab87a062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8de68ee-82f3-4e97-ac78-5be719aa8c6b", "name": "network-vif-unplugged", "status": "completed", "tag": "e9841222-41fd-4fae-86a1-ee22db4e210f"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:34.319882 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-af14dd4a-d5de-4250-8061-9af0f10604a0 req-80f3d031-5b83-4754-885e-b016ab87a062 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:34.320569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-af14dd4a-d5de-4250-8061-9af0f10604a0 req-80f3d031-5b83-4754-885e-b016ab87a062 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:34.334734 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-af14dd4a-d5de-4250-8061-9af0f10604a0 req-80f3d031-5b83-4754-885e-b016ab87a062 service nova] Creating event network-vif-unplugged:e9841222-41fd-4fae-86a1-ee22db4e210f for instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b on n-h1-849104-4 Jul 12 11:54:34.342466 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-af14dd4a-d5de-4250-8061-9af0f10604a0 req-80f3d031-5b83-4754-885e-b016ab87a062 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.357977 Jul 12 11:54:34.343905 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 737/1413] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:34.350912 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-73de6577-a639-4993-b509-c3e79c085ede req-009162ac-e033-43fd-8c11-0e4e3304a8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8de68ee-82f3-4e97-ac78-5be719aa8c6b", "name": "network-vif-deleted", "tag": "99a0b5ce-e578-495f-b132-8d76185a41b7"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:34.363533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-73de6577-a639-4993-b509-c3e79c085ede req-009162ac-e033-43fd-8c11-0e4e3304a8c8 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:34.364483 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-73de6577-a639-4993-b509-c3e79c085ede req-009162ac-e033-43fd-8c11-0e4e3304a8c8 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:34.391398 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-73de6577-a639-4993-b509-c3e79c085ede req-009162ac-e033-43fd-8c11-0e4e3304a8c8 service nova] Creating event network-vif-deleted:99a0b5ce-e578-495f-b132-8d76185a41b7 for instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b on n-h1-849104-4 Jul 12 11:54:34.400563 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-73de6577-a639-4993-b509-c3e79c085ede req-009162ac-e033-43fd-8c11-0e4e3304a8c8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054230 Jul 12 11:54:34.402327 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 738/1414] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:34.409107 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-225412df-308c-4883-ac49-1db617b83db7 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:34.410183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-225412df-308c-4883-ac49-1db617b83db7 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:34.419501 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-225412df-308c-4883-ac49-1db617b83db7 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:34.420325 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-225412df-308c-4883-ac49-1db617b83db7 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:34.421382 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-225412df-308c-4883-ac49-1db617b83db7 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:34.422005 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-225412df-308c-4883-ac49-1db617b83db7 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:34.493680 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-225412df-308c-4883-ac49-1db617b83db7 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:54:34.672005 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5ba695fe-3973-4efd-b481-3ff9fbbe5d9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:34.688601 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5ba695fe-3973-4efd-b481-3ff9fbbe5d9b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 1.101602 Jul 12 11:54:34.690250 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 677/1415] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:33 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:34.695437 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-225412df-308c-4883-ac49-1db617b83db7 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 204 len: 0 microversion: 2.1 time: 0.290723 Jul 12 11:54:34.696388 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 739/1416] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:54:34 2022] DELETE /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:54:34.729101 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-216894fc-59a7-451d-93a2-3ed1f23e2f40 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:34.729101 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-216894fc-59a7-451d-93a2-3ed1f23e2f40 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:34.745438 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-216894fc-59a7-451d-93a2-3ed1f23e2f40 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:34.745903 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-216894fc-59a7-451d-93a2-3ed1f23e2f40 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:34.748396 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-216894fc-59a7-451d-93a2-3ed1f23e2f40 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:34.750332 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-216894fc-59a7-451d-93a2-3ed1f23e2f40 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:34.787008 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-216894fc-59a7-451d-93a2-3ed1f23e2f40 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-216894fc-59a7-451d-93a2-3ed1f23e2f40 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 HTTP/1.1 Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '6be284e8-364a-45aa-97d4-944bfb60fc64'} Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:34.793932 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:34.805978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:34.805978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:34.805978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:34.805978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:34.805978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:34.805978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:54:34.805978 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:34.805978 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-216894fc-59a7-451d-93a2-3ed1f23e2f40 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:34.805978 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-216894fc-59a7-451d-93a2-3ed1f23e2f40 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 404 len: 111 microversion: 2.1 time: 0.097057 Jul 12 11:54:34.805978 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 740/1417] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:34 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:34.813587 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e10417b2-9e07-4cc9-98e9-73f436f193ed tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:34.815487 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e10417b2-9e07-4cc9-98e9-73f436f193ed tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:34.827823 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e10417b2-9e07-4cc9-98e9-73f436f193ed tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:34.831061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e10417b2-9e07-4cc9-98e9-73f436f193ed tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:34.831945 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e10417b2-9e07-4cc9-98e9-73f436f193ed tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:34.832429 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e10417b2-9e07-4cc9-98e9-73f436f193ed tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:34.839993 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9347c577-ca49-4d1d-86c8-cfd11fcb5bb7 tempest-ListImageFiltersNegativeTestJSON-745836287 tempest-ListImageFiltersNegativeTestJSON-745836287-project] Calling method '.version_select at 0x7f5e0a6c33a0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:34.891589 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-9347c577-ca49-4d1d-86c8-cfd11fcb5bb7 tempest-ListImageFiltersNegativeTestJSON-745836287 tempest-ListImageFiltersNegativeTestJSON-745836287-project] HTTP exception thrown: Image not found. Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9347c577-ca49-4d1d-86c8-cfd11fcb5bb7 tempest-ListImageFiltersNegativeTestJSON-745836287 tempest-ListImageFiltersNegativeTestJSON-745836287-project] Request method failure captured: Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/images/703d7b1a-c384-4b27-902c-3d394501e713 HTTP/1.1 Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWD5fE28-Qpa6F9QPTxr3Ohus4L5dnttMC7NUsQOGUaqUsWFzAgjN9wB02ww3UvovimGwf_CKdKTJP4mAJ4y2Z-mb2iU-zKNEm2-l2yJT90qJDAUIVQJpOtsuSmBDfj_bgi4hhrQHnTllKJXNuED9glapEPxvREkQI-TB-TWThkrPPo Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 12b123998e514e56baa92d3a4765ab87 Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-745836287 Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12b123998e514e56baa92d3a4765ab87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12b123998e514e56baa92d3a4765ab87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/12b123998e514e56baa92d3a4765ab87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_12b123998e514e56baa92d3a4765ab87", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-745836287 Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 12b123998e514e56baa92d3a4765ab87 Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-745836287 Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ListImageFiltersNegativeTestJSON-745836287-project Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 2dec086824444a8588b9e6ebe17eb6c9 Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-745836287-project Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: exception: Image not found. Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '703d7b1a-c384-4b27-902c-3d394501e713'} Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 703d7b1a-c384-4b27-902c-3d394501e713 Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 12 11:54:34.912236 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 703d7b1a-c384-4b27-902c-3d394501e713 could not be found. Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9347c577-ca49-4d1d-86c8-cfd11fcb5bb7 tempest-ListImageFiltersNegativeTestJSON-745836287 tempest-ListImageFiltersNegativeTestJSON-745836287-project] Returning 404 to user: Image not found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9347c577-ca49-4d1d-86c8-cfd11fcb5bb7 tempest-ListImageFiltersNegativeTestJSON-745836287 tempest-ListImageFiltersNegativeTestJSON-745836287-project] 10.222.0.50 "GET /compute/v2.1/images/703d7b1a-c384-4b27-902c-3d394501e713" status: 404 len: 62 microversion: 2.1 time: 0.214829 Jul 12 11:54:34.918019 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 678/1418] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 11:54:34 2022] GET /compute/v2.1/images/703d7b1a-c384-4b27-902c-3d394501e713 => generated 62 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:54:34.930962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-286e6ea7-9aaa-4932-adc7-5e8bc022de33 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:34.930962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-286e6ea7-9aaa-4932-adc7-5e8bc022de33 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:34.968843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-286e6ea7-9aaa-4932-adc7-5e8bc022de33 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:34.969808 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-286e6ea7-9aaa-4932-adc7-5e8bc022de33 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:34.971211 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-286e6ea7-9aaa-4932-adc7-5e8bc022de33 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:34.972922 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-286e6ea7-9aaa-4932-adc7-5e8bc022de33 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:34.980387 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:35.321402 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e10417b2-9e07-4cc9-98e9-73f436f193ed tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:35.336924 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e10417b2-9e07-4cc9-98e9-73f436f193ed tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 200 len: 1494 microversion: 2.1 time: 0.539479 Jul 12 11:54:35.351160 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 741/1419] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:34 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 1494 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:35.394468 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-286e6ea7-9aaa-4932-adc7-5e8bc022de33 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:35.410975 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-286e6ea7-9aaa-4932-adc7-5e8bc022de33 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1683 microversion: 2.1 time: 0.495100 Jul 12 11:54:35.424606 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 679/1420] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:34 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1683 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:35.444857 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d814d547-bbbd-45d4-bd19-78443150a2ff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:35.455677 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d814d547-bbbd-45d4-bd19-78443150a2ff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:35.466871 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d814d547-bbbd-45d4-bd19-78443150a2ff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:35.467607 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d814d547-bbbd-45d4-bd19-78443150a2ff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:35.469202 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d814d547-bbbd-45d4-bd19-78443150a2ff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:35.469882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d814d547-bbbd-45d4-bd19-78443150a2ff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:35.507563 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-d814d547-bbbd-45d4-bd19-78443150a2ff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d814d547-bbbd-45d4-bd19-78443150a2ff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64/os-volume_attachments HTTP/1.1 Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'server_id': '6be284e8-364a-45aa-97d4-944bfb60fc64'} Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:35.512271 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:35.518085 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:54:35.518085 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:35.518085 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:35.518085 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:35.518085 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:35.518085 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:35.518085 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:35.518085 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:35.518085 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:35.518085 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:54:35.518085 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:35.525152 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d814d547-bbbd-45d4-bd19-78443150a2ff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:35.526436 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d814d547-bbbd-45d4-bd19-78443150a2ff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.095758 Jul 12 11:54:35.527924 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 680/1421] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:54:35 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64/os-volume_attachments => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:35.872937 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6f5ba846-b0b4-4a9c-b2aa-4a7a31bf59b9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:35.873670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6f5ba846-b0b4-4a9c-b2aa-4a7a31bf59b9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:35.883091 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6f5ba846-b0b4-4a9c-b2aa-4a7a31bf59b9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:35.883838 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6f5ba846-b0b4-4a9c-b2aa-4a7a31bf59b9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:35.885471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6f5ba846-b0b4-4a9c-b2aa-4a7a31bf59b9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:35.886104 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6f5ba846-b0b4-4a9c-b2aa-4a7a31bf59b9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:35.997822 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-960911e6-d4f6-46ee-bec5-198078d4191d tempest-FloatingIPDetailsNegativeTestJSON-1319929913 tempest-FloatingIPDetailsNegativeTestJSON-1319929913-project] Calling method '.version_select at 0x7f5e0a780f70>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:36.159182 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6f5ba846-b0b4-4a9c-b2aa-4a7a31bf59b9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:36.167510 n-d-849104-4 devstack@n-api.service[125983]: DEBUG neutronclient.v2_0.client [None req-960911e6-d4f6-46ee-bec5-198078d4191d tempest-FloatingIPDetailsNegativeTestJSON-1319929913 tempest-FloatingIPDetailsNegativeTestJSON-1319929913-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e0ddc9d2-9410-4921-8cf0-c5bad4298433 could not be found", "detail": ""}} {{(pid=125983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 12 11:54:36.168501 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-960911e6-d4f6-46ee-bec5-198078d4191d tempest-FloatingIPDetailsNegativeTestJSON-1319929913 tempest-FloatingIPDetailsNegativeTestJSON-1319929913-project] HTTP exception thrown: Floating IP not found for ID e0ddc9d2-9410-4921-8cf0-c5bad4298433 Jul 12 11:54:36.171936 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6f5ba846-b0b4-4a9c-b2aa-4a7a31bf59b9 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1313 microversion: 2.1 time: 0.816006 Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-960911e6-d4f6-46ee-bec5-198078d4191d tempest-FloatingIPDetailsNegativeTestJSON-1319929913 tempest-FloatingIPDetailsNegativeTestJSON-1319929913-project] Request method failure captured: Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-floating-ips/e0ddc9d2-9410-4921-8cf0-c5bad4298433 HTTP/1.1 Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWD7kTULWHEgrvjhOY5xP-_oouPaGwQ-DVbWJVpZhcrPl6Kll5t-pTGZ1rxZyAxwm-r6tq_vTtYuIRsXhUfYp7l_eLerVXBS0Baf29JQOdtjxhOOMZ_GHtRUWqgL0wdzPvYkr-SfjPBVxOSPXVlj9fCtaWEM76J1zlkJTMS-PVXzVBQ Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 0f0995e4427a40f2869b4ff58637c003 Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1319929913 Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0f0995e4427a40f2869b4ff58637c003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0f0995e4427a40f2869b4ff58637c003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0f0995e4427a40f2869b4ff58637c003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0f0995e4427a40f2869b4ff58637c003", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1319929913 Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 0f0995e4427a40f2869b4ff58637c003 Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1319929913 Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1319929913-project Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: a7390ca7ddaf4a10bc66099bff1ac378 Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1319929913-project Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: exception: Floating IP not found for ID e0ddc9d2-9410-4921-8cf0-c5bad4298433 Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'e0ddc9d2-9410-4921-8cf0-c5bad4298433'} Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e0ddc9d2-9410-4921-8cf0-c5bad4298433 could not be found Jul 12 11:54:36.172753 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dab56c13-8ddf-4171-b4c1-d9e039ce0eef'] Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e0ddc9d2-9410-4921-8cf0-c5bad4298433. Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e0ddc9d2-9410-4921-8cf0-c5bad4298433 Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e0ddc9d2-9410-4921-8cf0-c5bad4298433 Jul 12 11:54:36.176919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:36.182256 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 742/1422] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:35 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1313 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:36.182482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-960911e6-d4f6-46ee-bec5-198078d4191d tempest-FloatingIPDetailsNegativeTestJSON-1319929913 tempest-FloatingIPDetailsNegativeTestJSON-1319929913-project] Returning 404 to user: Floating IP not found for ID e0ddc9d2-9410-4921-8cf0-c5bad4298433 {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:36.183261 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-960911e6-d4f6-46ee-bec5-198078d4191d tempest-FloatingIPDetailsNegativeTestJSON-1319929913 tempest-FloatingIPDetailsNegativeTestJSON-1319929913-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/e0ddc9d2-9410-4921-8cf0-c5bad4298433" status: 404 len: 111 microversion: 2.1 time: 0.653990 Jul 12 11:54:36.191858 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 681/1423] 10.222.0.50 () {58 vars in 1259 bytes} [Tue Jul 12 11:54:35 2022] GET /compute/v2.1/os-floating-ips/e0ddc9d2-9410-4921-8cf0-c5bad4298433 => generated 111 bytes in 663 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:36.200491 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c72d52ad-9b5d-4dc7-a2b5-5ee2bab64dfd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:36.201242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c72d52ad-9b5d-4dc7-a2b5-5ee2bab64dfd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:36.210527 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c72d52ad-9b5d-4dc7-a2b5-5ee2bab64dfd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:36.210985 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c72d52ad-9b5d-4dc7-a2b5-5ee2bab64dfd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:36.211903 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c72d52ad-9b5d-4dc7-a2b5-5ee2bab64dfd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:36.212395 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c72d52ad-9b5d-4dc7-a2b5-5ee2bab64dfd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:36.214037 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1507390369", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "24a2b846-48a0-496a-b982-522753a2dd1f"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:36.327488 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] validate_networks() for [('24a2b846-48a0-496a-b982-522753a2dd1f', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:54:36.596306 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c72d52ad-9b5d-4dc7-a2b5-5ee2bab64dfd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:36.619589 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c72d52ad-9b5d-4dc7-a2b5-5ee2bab64dfd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.436418 Jul 12 11:54:36.620766 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 743/1424] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:36 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:36.635049 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-42f7aaaa-d51e-4ead-9a9d-827c9e1054ee tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:36.640390 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-42f7aaaa-d51e-4ead-9a9d-827c9e1054ee tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:36.659200 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-42f7aaaa-d51e-4ead-9a9d-827c9e1054ee tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:36.660306 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-42f7aaaa-d51e-4ead-9a9d-827c9e1054ee tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:36.661726 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-42f7aaaa-d51e-4ead-9a9d-827c9e1054ee tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:36.662414 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-42f7aaaa-d51e-4ead-9a9d-827c9e1054ee tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:36.681664 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-42f7aaaa-d51e-4ead-9a9d-827c9e1054ee tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] HTTP exception thrown: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-42f7aaaa-d51e-4ead-9a9d-827c9e1054ee tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Request method failure captured: Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b HTTP/1.1 Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWDAYARO2nK9svWM9gyIbH2BdaBbPEWUCqtweHg34jDocVm8zkTbuQPdp83eUR_Am_M-Bs5YIkKgfSDuin_mMd_3r6sBjUWLNamG90Pl0nhqekMlO6HpEV7NFoJGUniBwny585LDZ3D0Bbw2d-kQGDhTOUyzuRyqpwSNc1Ze1_uMmww Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 8526c888ef874e22b5d9496db4568cfa Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersTestMultiNic-1782502585 Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8526c888ef874e22b5d9496db4568cfa", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersTestMultiNic-1782502585 Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 8526c888ef874e22b5d9496db4568cfa Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersTestMultiNic-1782502585 Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersTestMultiNic-1782502585-project Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: f91215d432f74692b5b8129dab66bc51 Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersTestMultiNic-1782502585-project Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'c8de68ee-82f3-4e97-ac78-5be719aa8c6b'} Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:36.683748 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:36.688173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:36.688173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:36.688173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:36.688173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:36.688173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:36.688173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:54:36.688173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:36.694746 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-42f7aaaa-d51e-4ead-9a9d-827c9e1054ee tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Returning 404 to user: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:36.696268 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-42f7aaaa-d51e-4ead-9a9d-827c9e1054ee tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 404 len: 111 microversion: 2.1 time: 0.071800 Jul 12 11:54:36.698227 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 744/1425] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:36 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:36.704512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-99ee0e5c-eaa3-4cb6-9e2a-70645db94492 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:36.705555 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-99ee0e5c-eaa3-4cb6-9e2a-70645db94492 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:36.721204 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-99ee0e5c-eaa3-4cb6-9e2a-70645db94492 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:36.721975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-99ee0e5c-eaa3-4cb6-9e2a-70645db94492 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:36.723782 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-99ee0e5c-eaa3-4cb6-9e2a-70645db94492 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:36.725477 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-99ee0e5c-eaa3-4cb6-9e2a-70645db94492 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:36.749716 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:37.093002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-99ee0e5c-eaa3-4cb6-9e2a-70645db94492 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:37.105032 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-99ee0e5c-eaa3-4cb6-9e2a-70645db94492 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1683 microversion: 2.1 time: 0.404849 Jul 12 11:54:37.105809 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 745/1426] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:36 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1683 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:37.124668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-33055ae6-46f3-48d0-9316-b12510a2da8d req-65070ed3-13dd-4c89-a285-a2d4e45b06a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bfc910-f0c8-4290-a296-881b4381b84e", "name": "network-vif-plugged", "status": "completed", "tag": "9888919a-4e04-47ae-b8f2-1a4693dcc22a"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:37.147390 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-33055ae6-46f3-48d0-9316-b12510a2da8d req-65070ed3-13dd-4c89-a285-a2d4e45b06a6 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:37.154562 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-33055ae6-46f3-48d0-9316-b12510a2da8d req-65070ed3-13dd-4c89-a285-a2d4e45b06a6 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:37.191215 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-33055ae6-46f3-48d0-9316-b12510a2da8d req-65070ed3-13dd-4c89-a285-a2d4e45b06a6 service nova] Creating event network-vif-plugged:9888919a-4e04-47ae-b8f2-1a4693dcc22a for instance 69bfc910-f0c8-4290-a296-881b4381b84e on n-h2-849104-4 Jul 12 11:54:37.204461 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-33055ae6-46f3-48d0-9316-b12510a2da8d req-65070ed3-13dd-4c89-a285-a2d4e45b06a6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096504 Jul 12 11:54:37.208001 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 746/1427] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:37.232743 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-835f250e-423d-4234-8bb3-789d22a8c68f req-86699999-985c-4fe1-aeae-29b48ab522f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8de68ee-82f3-4e97-ac78-5be719aa8c6b", "name": "network-vif-deleted", "tag": "e9841222-41fd-4fae-86a1-ee22db4e210f"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:37.273352 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-835f250e-423d-4234-8bb3-789d22a8c68f req-86699999-985c-4fe1-aeae-29b48ab522f0 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:37.273815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-835f250e-423d-4234-8bb3-789d22a8c68f req-86699999-985c-4fe1-aeae-29b48ab522f0 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:37.294675 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-835f250e-423d-4234-8bb3-789d22a8c68f req-86699999-985c-4fe1-aeae-29b48ab522f0 service nova] Creating event network-vif-deleted:e9841222-41fd-4fae-86a1-ee22db4e210f for instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b on n-h1-849104-4 Jul 12 11:54:37.302115 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-835f250e-423d-4234-8bb3-789d22a8c68f req-86699999-985c-4fe1-aeae-29b48ab522f0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092134 Jul 12 11:54:37.304803 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 747/1428] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:37.315848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0f17a00d-1124-4fd8-8ba7-e6cf8a849154 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:37.320247 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0f17a00d-1124-4fd8-8ba7-e6cf8a849154 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:37.334480 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f17a00d-1124-4fd8-8ba7-e6cf8a849154 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:37.334954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f17a00d-1124-4fd8-8ba7-e6cf8a849154 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:37.335783 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f17a00d-1124-4fd8-8ba7-e6cf8a849154 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:37.336277 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f17a00d-1124-4fd8-8ba7-e6cf8a849154 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:37.959729 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:54:37.960670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:54:37.960670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:54:37.961109 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:54:37.961640 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:54:37.984138 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:37.984604 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:37.985438 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:37.985885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:38.010221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0f17a00d-1124-4fd8-8ba7-e6cf8a849154 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:38.017862 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0f17a00d-1124-4fd8-8ba7-e6cf8a849154 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1313 microversion: 2.1 time: 0.711581 Jul 12 11:54:38.033062 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 748/1429] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:37 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1313 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:38.037529 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-99188262-306f-46e3-a623-c5b130ac37a1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:38.038986 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-99188262-306f-46e3-a623-c5b130ac37a1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:38.048977 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-99188262-306f-46e3-a623-c5b130ac37a1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:38.049695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-99188262-306f-46e3-a623-c5b130ac37a1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:38.050728 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-99188262-306f-46e3-a623-c5b130ac37a1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:38.051345 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-99188262-306f-46e3-a623-c5b130ac37a1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:38.065428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Getting quotas for project 6acea80b1e154ffcb3e657056d6e8dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:54:38.082688 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Getting quotas for user 4c93078ac6044bf6b62ca073b3850016 and project 6acea80b1e154ffcb3e657056d6e8dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:54:38.114459 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:54:38.128072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9f2d49ee-0d10-42e9-80db-c8530c914843] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:54:38.248240 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e3e26d54-8c3f-4d59-b7cf-36aefa7c3810 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.054989 Jul 12 11:54:38.249295 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 682/1430] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:54:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:54:38.258273 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d212029e-2896-4118-a826-5a9b5598dcde tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:38.261896 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d212029e-2896-4118-a826-5a9b5598dcde tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:38.284884 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d212029e-2896-4118-a826-5a9b5598dcde tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:38.285581 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d212029e-2896-4118-a826-5a9b5598dcde tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:38.286549 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d212029e-2896-4118-a826-5a9b5598dcde tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:38.287169 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d212029e-2896-4118-a826-5a9b5598dcde tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:38.706169 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d212029e-2896-4118-a826-5a9b5598dcde tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:38.726826 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d212029e-2896-4118-a826-5a9b5598dcde tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1683 microversion: 2.1 time: 0.473083 Jul 12 11:54:38.732184 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 683/1431] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:38 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1683 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:38.745757 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2fb6ed64-c96c-4ea2-987f-f352cc6dd607 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:38.746378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2fb6ed64-c96c-4ea2-987f-f352cc6dd607 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9f2d49ee-0d10-42e9-80db-c8530c914843] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:39.024746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2fb6ed64-c96c-4ea2-987f-f352cc6dd607 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:39.079254 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2fb6ed64-c96c-4ea2-987f-f352cc6dd607 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2d49ee-0d10-42e9-80db-c8530c914843" status: 200 len: 1215 microversion: 2.1 time: 0.339326 Jul 12 11:54:39.079938 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 684/1432] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:38 2022] GET /compute/v2.1/servers/9f2d49ee-0d10-42e9-80db-c8530c914843 => generated 1215 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:39.121756 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a39bd62b-832d-4764-ac32-e16b20f4561b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:39.127792 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a39bd62b-832d-4764-ac32-e16b20f4561b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:39.149486 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a39bd62b-832d-4764-ac32-e16b20f4561b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:39.149997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a39bd62b-832d-4764-ac32-e16b20f4561b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:39.154675 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a39bd62b-832d-4764-ac32-e16b20f4561b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:39.156700 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a39bd62b-832d-4764-ac32-e16b20f4561b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:39.338189 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-99188262-306f-46e3-a623-c5b130ac37a1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:39.364918 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-99188262-306f-46e3-a623-c5b130ac37a1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 1.331151 Jul 12 11:54:39.369068 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 749/1433] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:38 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:39.376183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2cb38920-ed1c-436a-b5e2-ec0a80068dd7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:39.376688 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2cb38920-ed1c-436a-b5e2-ec0a80068dd7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9f2d49ee-0d10-42e9-80db-c8530c914843] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:39.435127 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2cb38920-ed1c-436a-b5e2-ec0a80068dd7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9f2d49ee-0d10-42e9-80db-c8530c914843] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:54:40.118021 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.scheduler.client.report [None req-2cb38920-ed1c-436a-b5e2-ec0a80068dd7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Deleted allocations for instance 9f2d49ee-0d10-42e9-80db-c8530c914843 Jul 12 11:54:40.170488 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2cb38920-ed1c-436a-b5e2-ec0a80068dd7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9f2d49ee-0d10-42e9-80db-c8530c914843" status: 204 len: 0 microversion: 2.1 time: 0.800240 Jul 12 11:54:40.182333 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 750/1434] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:54:39 2022] DELETE /compute/v2.1/servers/9f2d49ee-0d10-42e9-80db-c8530c914843 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:54:40.192968 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2975fb9d-0d31-44f9-90f3-bba0eedd2694 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:40.192968 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2975fb9d-0d31-44f9-90f3-bba0eedd2694 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:40.217625 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2975fb9d-0d31-44f9-90f3-bba0eedd2694 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:40.218145 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2975fb9d-0d31-44f9-90f3-bba0eedd2694 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:40.218999 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2975fb9d-0d31-44f9-90f3-bba0eedd2694 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:40.219505 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2975fb9d-0d31-44f9-90f3-bba0eedd2694 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:40.311744 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a39bd62b-832d-4764-ac32-e16b20f4561b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:40.323928 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a39bd62b-832d-4764-ac32-e16b20f4561b tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1313 microversion: 2.1 time: 1.241089 Jul 12 11:54:40.324550 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 685/1435] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:39 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1313 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:40.335215 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-797542d6-291c-4a62-8884-e3b3f83ffad8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:40.336589 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-797542d6-291c-4a62-8884-e3b3f83ffad8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9f2d49ee-0d10-42e9-80db-c8530c914843] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:40.353497 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-797542d6-291c-4a62-8884-e3b3f83ffad8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:40.363979 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-797542d6-291c-4a62-8884-e3b3f83ffad8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:40.365099 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-797542d6-291c-4a62-8884-e3b3f83ffad8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:40.365713 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-797542d6-291c-4a62-8884-e3b3f83ffad8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:40.388603 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-797542d6-291c-4a62-8884-e3b3f83ffad8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-797542d6-291c-4a62-8884-e3b3f83ffad8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/9f2d49ee-0d10-42e9-80db-c8530c914843 HTTP/1.1 Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '9f2d49ee-0d10-42e9-80db-c8530c914843'} Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:40.403427 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:40.408355 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:40.408355 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:40.408355 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:40.408355 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:40.408355 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:40.408355 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:54:40.408355 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:40.417591 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-797542d6-291c-4a62-8884-e3b3f83ffad8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:40.418998 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-797542d6-291c-4a62-8884-e3b3f83ffad8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2d49ee-0d10-42e9-80db-c8530c914843" status: 404 len: 111 microversion: 2.1 time: 0.092180 Jul 12 11:54:40.440499 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 686/1436] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:40 2022] GET /compute/v2.1/servers/9f2d49ee-0d10-42e9-80db-c8530c914843 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:40.455496 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-17fd5a54-6a8f-43b8-993a-15e88c788fff tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:40.457599 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-17fd5a54-6a8f-43b8-993a-15e88c788fff tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:40.472884 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2975fb9d-0d31-44f9-90f3-bba0eedd2694 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca463d55047caa749c514a3e1499d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd080a7dad6c4a6ebf684e44bf7a6e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:40.477743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-17fd5a54-6a8f-43b8-993a-15e88c788fff tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:40.488619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-17fd5a54-6a8f-43b8-993a-15e88c788fff tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:40.489859 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-17fd5a54-6a8f-43b8-993a-15e88c788fff tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:40.493217 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-17fd5a54-6a8f-43b8-993a-15e88c788fff tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:40.522112 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2975fb9d-0d31-44f9-90f3-bba0eedd2694 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 200 len: 1615 microversion: 2.1 time: 0.336118 Jul 12 11:54:40.540345 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 751/1437] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:40 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 1615 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:40.581459 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-914733fb-ffa1-4b40-96e6-6d4b5999dc64 req-2f578230-303e-4ae5-91df-04159047ace3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb218c5-ad4e-4287-b44f-1c77481559cb", "name": "network-vif-deleted", "tag": "2af0933a-21e0-442c-8972-dc8f2b026a8f"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:40.638158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-914733fb-ffa1-4b40-96e6-6d4b5999dc64 req-2f578230-303e-4ae5-91df-04159047ace3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:40.638603 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-914733fb-ffa1-4b40-96e6-6d4b5999dc64 req-2f578230-303e-4ae5-91df-04159047ace3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:40.655663 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-914733fb-ffa1-4b40-96e6-6d4b5999dc64 req-2f578230-303e-4ae5-91df-04159047ace3 service nova] Creating event network-vif-deleted:2af0933a-21e0-442c-8972-dc8f2b026a8f for instance bdb218c5-ad4e-4287-b44f-1c77481559cb on n-h2-849104-4 Jul 12 11:54:40.661771 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-914733fb-ffa1-4b40-96e6-6d4b5999dc64 req-2f578230-303e-4ae5-91df-04159047ace3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111796 Jul 12 11:54:40.662815 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 752/1438] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:40.816905 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-384500920", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "24a2b846-48a0-496a-b982-522753a2dd1f"}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:40.944592 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] validate_networks() for [('24a2b846-48a0-496a-b982-522753a2dd1f', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:54:41.563387 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-17fd5a54-6a8f-43b8-993a-15e88c788fff tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:41.587381 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-17fd5a54-6a8f-43b8-993a-15e88c788fff tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 1.145682 Jul 12 11:54:41.588263 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 687/1439] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:40 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:41.593442 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f74e5dcd-7d69-48db-9532-df5b4cfd4ae7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:41.594419 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f74e5dcd-7d69-48db-9532-df5b4cfd4ae7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:41.605358 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f74e5dcd-7d69-48db-9532-df5b4cfd4ae7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:41.609052 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f74e5dcd-7d69-48db-9532-df5b4cfd4ae7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:41.610234 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f74e5dcd-7d69-48db-9532-df5b4cfd4ae7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:41.613492 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f74e5dcd-7d69-48db-9532-df5b4cfd4ae7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:42.305161 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f74e5dcd-7d69-48db-9532-df5b4cfd4ae7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:42.322932 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f74e5dcd-7d69-48db-9532-df5b4cfd4ae7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1463 microversion: 2.1 time: 0.733131 Jul 12 11:54:42.323879 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 688/1440] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:41 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1463 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:42.330876 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3b21412c-bf7d-44c3-a50f-38fe56e4caed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:42.331891 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3b21412c-bf7d-44c3-a50f-38fe56e4caed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] [instance: bdb218c5-ad4e-4287-b44f-1c77481559cb] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:42.347393 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b21412c-bf7d-44c3-a50f-38fe56e4caed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:42.348924 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b21412c-bf7d-44c3-a50f-38fe56e4caed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:42.349942 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b21412c-bf7d-44c3-a50f-38fe56e4caed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:42.351332 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b21412c-bf7d-44c3-a50f-38fe56e4caed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:42.398435 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-3b21412c-bf7d-44c3-a50f-38fe56e4caed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] HTTP exception thrown: Instance bdb218c5-ad4e-4287-b44f-1c77481559cb could not be found. Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3b21412c-bf7d-44c3-a50f-38fe56e4caed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Request method failure captured: Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb HTTP/1.1 Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWAr1EOgxbxpUalD2MtNKCdH5u0OkY2B7iGecusfTQ8KX4v1ufn8aY6EYeZ0GMRoBkXJDlfgKBSST4mYbDJYMORdxD26FROiIfSk4VrCi9xxp2yHsDjJsF-bq_lytxQqjPQ3dKAmGs57bjJ4y52cd3CX8pU2QnklKcf3gyXQOZbEMZI Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: bd080a7dad6c4a6ebf684e44bf7a6e76 Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-VolumesAdminNegativeTest-1169315287 Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd080a7dad6c4a6ebf684e44bf7a6e76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd080a7dad6c4a6ebf684e44bf7a6e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bd080a7dad6c4a6ebf684e44bf7a6e76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bd080a7dad6c4a6ebf684e44bf7a6e76", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-VolumesAdminNegativeTest-1169315287 Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: bd080a7dad6c4a6ebf684e44bf7a6e76 Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1169315287 Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-VolumesAdminNegativeTest-1169315287-project Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 5a7ca463d55047caa749c514a3e1499d Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-VolumesAdminNegativeTest-1169315287-project Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance bdb218c5-ad4e-4287-b44f-1c77481559cb could not be found. Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'bdb218c5-ad4e-4287-b44f-1c77481559cb'} Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb218c5-ad4e-4287-b44f-1c77481559cb could not be found. Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb218c5-ad4e-4287-b44f-1c77481559cb could not be found. Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:42.400928 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:42.405661 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:42.405661 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:42.405661 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:42.405661 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:42.405661 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:42.405661 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb218c5-ad4e-4287-b44f-1c77481559cb could not be found. Jul 12 11:54:42.405661 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:42.409880 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3b21412c-bf7d-44c3-a50f-38fe56e4caed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Returning 404 to user: Instance bdb218c5-ad4e-4287-b44f-1c77481559cb could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:42.414617 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3b21412c-bf7d-44c3-a50f-38fe56e4caed tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb" status: 404 len: 111 microversion: 2.1 time: 0.089332 Jul 12 11:54:42.416540 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 689/1441] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:42 2022] GET /compute/v2.1/servers/bdb218c5-ad4e-4287-b44f-1c77481559cb => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:42.428735 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a7e13b82-11bd-4649-911e-572c9de54ee2 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:42.429478 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a7e13b82-11bd-4649-911e-572c9de54ee2 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:42.451932 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a7e13b82-11bd-4649-911e-572c9de54ee2 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:42.452422 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a7e13b82-11bd-4649-911e-572c9de54ee2 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:42.453219 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a7e13b82-11bd-4649-911e-572c9de54ee2 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:42.453912 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a7e13b82-11bd-4649-911e-572c9de54ee2 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:42.752311 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:54:42.753332 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:54:42.753979 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:54:42.754549 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:54:42.755277 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:54:42.781726 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:42.782209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:42.783199 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:42.783787 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:42.811668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Getting quotas for project 6acea80b1e154ffcb3e657056d6e8dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:54:42.823214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Getting quotas for user 4c93078ac6044bf6b62ca073b3850016 and project 6acea80b1e154ffcb3e657056d6e8dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:54:42.839773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:42.841627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:54:42.844619 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:54:42.921776 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c1b7d31a-5634-4402-9731-92ca5215e9f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.124255 Jul 12 11:54:42.923239 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 753/1442] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:54:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:54:42.929617 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cbece520-d794-4bae-bb09-2813e1414ee2 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] Calling method '.version_select at 0x7f5e09b87280>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:42.971625 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cbece520-d794-4bae-bb09-2813e1414ee2 tempest-VolumesAdminNegativeTest-1169315287 tempest-VolumesAdminNegativeTest-1169315287-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1342155430" status: 202 len: 0 microversion: 2.1 time: 0.046926 Jul 12 11:54:42.972274 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 754/1443] 10.222.0.50 () {58 vars in 1220 bytes} [Tue Jul 12 11:54:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1342155430 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:54:43.002107 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3f5fa98a-9812-48bc-bbb3-b00561b9cd47 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:43.002652 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3f5fa98a-9812-48bc-bbb3-b00561b9cd47 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:43.020788 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f5fa98a-9812-48bc-bbb3-b00561b9cd47 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:43.021266 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f5fa98a-9812-48bc-bbb3-b00561b9cd47 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:43.022215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f5fa98a-9812-48bc-bbb3-b00561b9cd47 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:43.024732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f5fa98a-9812-48bc-bbb3-b00561b9cd47 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:43.713700 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3f5fa98a-9812-48bc-bbb3-b00561b9cd47 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:43.723080 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3f5fa98a-9812-48bc-bbb3-b00561b9cd47 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.735300 Jul 12 11:54:43.727176 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 755/1444] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:42 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:43.737862 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-81902dce-32a6-4c6d-9442-36824ccc983d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:43.738477 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-81902dce-32a6-4c6d-9442-36824ccc983d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:43.837493 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a7e13b82-11bd-4649-911e-572c9de54ee2 tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1614 microversion: 2.1 time: 1.419555 Jul 12 11:54:43.840071 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 690/1445] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:42 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1614 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:43.860171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-81902dce-32a6-4c6d-9442-36824ccc983d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:43.864401 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b95122f1-36a9-4aaa-ae2a-09571c1c3b0e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:43.865948 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b95122f1-36a9-4aaa-ae2a-09571c1c3b0e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:43.868370 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-81902dce-32a6-4c6d-9442-36824ccc983d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1214 microversion: 2.1 time: 0.139845 Jul 12 11:54:43.875414 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b95122f1-36a9-4aaa-ae2a-09571c1c3b0e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:43.876356 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b95122f1-36a9-4aaa-ae2a-09571c1c3b0e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:43.878488 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b95122f1-36a9-4aaa-ae2a-09571c1c3b0e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:43.879499 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b95122f1-36a9-4aaa-ae2a-09571c1c3b0e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:43.880295 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 756/1446] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:43 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:44.107378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b95122f1-36a9-4aaa-ae2a-09571c1c3b0e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7e394152cbc64b698118836521f3e4fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edf9834df214506be223369a506d00e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:44.118374 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b95122f1-36a9-4aaa-ae2a-09571c1c3b0e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] flavor_id is None. Assuming migration. {{(pid=125983) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 12 11:54:44.118964 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b95122f1-36a9-4aaa-ae2a-09571c1c3b0e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125983) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 12 11:54:44.753004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dde29ffc-e445-45b4-9508-a9d76e2691c5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:44.758602 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dde29ffc-e445-45b4-9508-a9d76e2691c5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:44.839278 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dde29ffc-e445-45b4-9508-a9d76e2691c5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:44.839740 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dde29ffc-e445-45b4-9508-a9d76e2691c5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:44.840730 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dde29ffc-e445-45b4-9508-a9d76e2691c5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:44.861396 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dde29ffc-e445-45b4-9508-a9d76e2691c5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:45.183992 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b95122f1-36a9-4aaa-ae2a-09571c1c3b0e tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e/action" status: 202 len: 0 microversion: 2.1 time: 1.325737 Jul 12 11:54:45.189229 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 691/1447] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:54:43 2022] POST /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e/action => generated 0 bytes in 1334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:54:45.195544 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6b394696-53f7-46f3-967c-8e58d19377b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:45.213243 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6b394696-53f7-46f3-967c-8e58d19377b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:45.228790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6b394696-53f7-46f3-967c-8e58d19377b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:45.232098 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6b394696-53f7-46f3-967c-8e58d19377b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:45.240469 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6b394696-53f7-46f3-967c-8e58d19377b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:45.243069 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6b394696-53f7-46f3-967c-8e58d19377b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:45.496804 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dde29ffc-e445-45b4-9508-a9d76e2691c5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:45.543159 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dde29ffc-e445-45b4-9508-a9d76e2691c5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.780545 Jul 12 11:54:45.544264 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 757/1448] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:44 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:45.557736 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9929c694-930b-4e80-aa8e-859a32e7032d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:45.568507 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9929c694-930b-4e80-aa8e-859a32e7032d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:45.608952 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9929c694-930b-4e80-aa8e-859a32e7032d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:45.618383 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9929c694-930b-4e80-aa8e-859a32e7032d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:45.622724 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9929c694-930b-4e80-aa8e-859a32e7032d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:45.624515 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9929c694-930b-4e80-aa8e-859a32e7032d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:45.732419 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6b394696-53f7-46f3-967c-8e58d19377b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:45.740688 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6b394696-53f7-46f3-967c-8e58d19377b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1272 microversion: 2.1 time: 0.549897 Jul 12 11:54:45.746514 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 692/1449] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:45 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1272 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:46.331814 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9929c694-930b-4e80-aa8e-859a32e7032d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:46.346185 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9929c694-930b-4e80-aa8e-859a32e7032d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1472 microversion: 2.1 time: 0.799159 Jul 12 11:54:46.348299 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 758/1450] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:45 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1472 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:46.561922 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fa9b8724-ae4b-420a-800f-b7229aed4eec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:46.562545 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fa9b8724-ae4b-420a-800f-b7229aed4eec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:46.575489 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa9b8724-ae4b-420a-800f-b7229aed4eec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:46.576459 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa9b8724-ae4b-420a-800f-b7229aed4eec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:46.581644 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa9b8724-ae4b-420a-800f-b7229aed4eec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:46.583730 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa9b8724-ae4b-420a-800f-b7229aed4eec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:46.759250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-95aaea2c-312e-454c-9efc-084dc290fb76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:46.759956 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-95aaea2c-312e-454c-9efc-084dc290fb76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:46.766318 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-95aaea2c-312e-454c-9efc-084dc290fb76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:46.768339 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-95aaea2c-312e-454c-9efc-084dc290fb76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:46.770722 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-95aaea2c-312e-454c-9efc-084dc290fb76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:46.771429 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-95aaea2c-312e-454c-9efc-084dc290fb76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:46.973313 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-95aaea2c-312e-454c-9efc-084dc290fb76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:46.981913 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-95aaea2c-312e-454c-9efc-084dc290fb76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1272 microversion: 2.1 time: 0.227290 Jul 12 11:54:46.994217 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 759/1451] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:46 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:47.429936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-14bc39c2-adf2-457a-95ab-6db7490ce25c tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-209831760", "id": 14980514, "os-flavor-access:is_public": "False"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:47.431639 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:47.431639 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:54:47.473101 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-14bc39c2-adf2-457a-95ab-6db7490ce25c tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.476103 Jul 12 11:54:47.477171 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 760/1452] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:54:46 2022] POST /compute/v2.1/flavors => generated 432 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:47.486181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-12504582-5f7f-422a-be2b-1d339f42832f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:47.489847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-12504582-5f7f-422a-be2b-1d339f42832f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:47.507198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-12504582-5f7f-422a-be2b-1d339f42832f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:47.507668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-12504582-5f7f-422a-be2b-1d339f42832f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:47.510923 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-12504582-5f7f-422a-be2b-1d339f42832f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:47.511423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-12504582-5f7f-422a-be2b-1d339f42832f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:47.549536 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fa9b8724-ae4b-420a-800f-b7229aed4eec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:47.565894 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fa9b8724-ae4b-420a-800f-b7229aed4eec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 1.005749 Jul 12 11:54:47.566568 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 693/1453] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:46 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:47.602243 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2a42bc7b-0e78-4378-b50c-a7cf42da2356 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "92f2ac8d66a64112b6f3f3004d187a37"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:47.603658 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:47.603658 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:54:47.823299 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2a42bc7b-0e78-4378-b50c-a7cf42da2356 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/14980514/action" status: 200 len: 95 microversion: 2.1 time: 0.237931 Jul 12 11:54:47.828964 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 694/1454] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:54:47 2022] POST /compute/v2.1/flavors/14980514/action => generated 95 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:54:47.852668 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-09a33410-2235-4f0b-a743-d458c44c5322 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "92f2ac8d66a64112b6f3f3004d187a37"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:48.001013 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-09a33410-2235-4f0b-a743-d458c44c5322 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project 92f2ac8d66a64112b6f3f3004d187a37 combination. Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-09a33410-2235-4f0b-a743-d458c44c5322 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Request method failure captured: Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/flavors/14980514/action HTTP/1.1 Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 67 Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWEFGrdhuvpMA5NpYj1SwCCfyO2QKVgKFdqDyrgfjdZlbCbIkLzU99JrlAZqn_9klsglL_8bjTgUMWeRavC6uQ9WllqZc9v0SS-DFgLcs8phzXYnTRj0VSW2UWgz7KoZQFOV1BNSX_tR6wo2B4EU9dyu9ZmiiTS_LDKZks8mmmsStiE Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 8213f5463a254de99c5d934c4e347cdc Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1487127301 Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8213f5463a254de99c5d934c4e347cdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8213f5463a254de99c5d934c4e347cdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8213f5463a254de99c5d934c4e347cdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8213f5463a254de99c5d934c4e347cdc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1487127301 Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 8213f5463a254de99c5d934c4e347cdc Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1487127301 Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 508e6bd7b6ae485e959fc5430e668d7f Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: {"addTenantAccess": {"tenant": "92f2ac8d66a64112b6f3f3004d187a37"}} Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: exception: Flavor access already exists for flavor 35 and project 92f2ac8d66a64112b6f3f3004d187a37 combination. Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '14980514', 'body': {'addTenantAccess': {'tenant': '92f2ac8d66a64112b6f3f3004d187a37'}}} Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result.read() Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-92f2ac8d66a64112b6f3f3004d187a37' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:48.036741 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi session.flush() Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result.read() Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 11:54:48.041522 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-92f2ac8d66a64112b6f3f3004d187a37' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 12, 11, 54, 47, 995144), 'updated_at': None, 'flavor_id': 35, 'project_id': '92f2ac8d66a64112b6f3f3004d187a37'}] Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project 92f2ac8d66a64112b6f3f3004d187a37 combination. Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project 92f2ac8d66a64112b6f3f3004d187a37 combination. Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project 92f2ac8d66a64112b6f3f3004d187a37 combination. Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-09a33410-2235-4f0b-a743-d458c44c5322 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project 92f2ac8d66a64112b6f3f3004d187a37 combination. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:48.058141 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-09a33410-2235-4f0b-a743-d458c44c5322 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/14980514/action" status: 409 len: 152 microversion: 2.1 time: 0.216790 Jul 12 11:54:48.066675 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 695/1455] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:54:47 2022] POST /compute/v2.1/flavors/14980514/action => generated 152 bytes in 219 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:54:48.066675 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-42ff5f05-c3e7-4901-9d90-13213f3f8853 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:48.066675 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-42ff5f05-c3e7-4901-9d90-13213f3f8853 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:48.072238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:48.080589 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-42ff5f05-c3e7-4901-9d90-13213f3f8853 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:48.081050 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-42ff5f05-c3e7-4901-9d90-13213f3f8853 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:48.081857 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-42ff5f05-c3e7-4901-9d90-13213f3f8853 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:48.082296 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-42ff5f05-c3e7-4901-9d90-13213f3f8853 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:48.347184 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-12504582-5f7f-422a-be2b-1d339f42832f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:48.356737 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-12504582-5f7f-422a-be2b-1d339f42832f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1472 microversion: 2.1 time: 0.878201 Jul 12 11:54:48.357571 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 761/1456] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:47 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1472 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:48.387039 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d388b5a7-6a8c-4c6b-8341-a7ccfc1c6dab tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "92f2ac8d66a64112b6f3f3004d187a37"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:48.389643 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:48.389643 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:54:48.532007 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d388b5a7-6a8c-4c6b-8341-a7ccfc1c6dab tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/14980514/action" status: 200 len: 21 microversion: 2.1 time: 0.166427 Jul 12 11:54:48.539648 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 762/1457] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Jul 12 11:54:48 2022] POST /compute/v2.1/flavors/14980514/action => generated 21 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:54:48.546817 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cf4d3606-47da-4bab-8b71-353434d9ebee tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:48.547822 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:48.547822 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:54:48.575699 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cf4d3606-47da-4bab-8b71-353434d9ebee tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/14980514" status: 202 len: 0 microversion: 2.1 time: 0.034118 Jul 12 11:54:48.583312 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 763/1458] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Jul 12 11:54:48 2022] DELETE /compute/v2.1/flavors/14980514 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 11:54:48.591451 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0d0d2104-2de8-4fce-aea7-a398fbfa12d2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:48.592721 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0d0d2104-2de8-4fce-aea7-a398fbfa12d2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:48.602483 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0d0d2104-2de8-4fce-aea7-a398fbfa12d2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:48.603655 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0d0d2104-2de8-4fce-aea7-a398fbfa12d2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:48.604740 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0d0d2104-2de8-4fce-aea7-a398fbfa12d2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:48.605428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0d0d2104-2de8-4fce-aea7-a398fbfa12d2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:48.706292 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-42ff5f05-c3e7-4901-9d90-13213f3f8853 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:48.729924 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-42ff5f05-c3e7-4901-9d90-13213f3f8853 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1272 microversion: 2.1 time: 0.673103 Jul 12 11:54:48.735722 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 696/1459] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:48 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1272 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:48.756278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cc3de983-fb79-46ea-af6c-d50605a326d9 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:48.797493 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cc3de983-fb79-46ea-af6c-d50605a326d9 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060019 Jul 12 11:54:48.811196 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 697/1460] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:54:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:48.835719 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-aab0d6a4-06cc-4dd2-917a-39083a2c4a83 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-249876879", "id": 394536999, "os-flavor-access:is_public": "True"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:48.837479 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:48.837479 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:54:48.880840 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-aab0d6a4-06cc-4dd2-917a-39083a2c4a83 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.049574 Jul 12 11:54:48.881817 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 698/1461] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:54:48 2022] POST /compute/v2.1/flavors => generated 434 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:54:48.895531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cc1bfffe-0c5e-4d52-9aa6-70f244524a26 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:48.896203 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:48.896203 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:54:48.904398 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-cc1bfffe-0c5e-4d52-9aa6-70f244524a26 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cc1bfffe-0c5e-4d52-9aa6-70f244524a26 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Request method failure captured: Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/flavors/394536999/os-flavor-access HTTP/1.1 Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWEFGrdhuvpMA5NpYj1SwCCfyO2QKVgKFdqDyrgfjdZlbCbIkLzU99JrlAZqn_9klsglL_8bjTgUMWeRavC6uQ9WllqZc9v0SS-DFgLcs8phzXYnTRj0VSW2UWgz7KoZQFOV1BNSX_tR6wo2B4EU9dyu9ZmiiTS_LDKZks8mmmsStiE Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 8213f5463a254de99c5d934c4e347cdc Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1487127301 Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8213f5463a254de99c5d934c4e347cdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8213f5463a254de99c5d934c4e347cdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8213f5463a254de99c5d934c4e347cdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8213f5463a254de99c5d934c4e347cdc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1487127301 Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 8213f5463a254de99c5d934c4e347cdc Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1487127301 Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 508e6bd7b6ae485e959fc5430e668d7f Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: exception: Access list not available for public flavors. Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'flavor_id': '394536999'} Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 12 11:54:48.905746 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:48.910104 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cc1bfffe-0c5e-4d52-9aa6-70f244524a26 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:48.910104 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cc1bfffe-0c5e-4d52-9aa6-70f244524a26 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/394536999/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.018110 Jul 12 11:54:48.910104 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 699/1462] 10.222.0.50 () {58 vars in 1205 bytes} [Tue Jul 12 11:54:48 2022] GET /compute/v2.1/flavors/394536999/os-flavor-access => generated 91 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:54:48.917856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-21580814-5eb8-422e-8a3c-f060d5723022 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:48.918651 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:48.918651 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:54:48.949400 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-21580814-5eb8-422e-8a3c-f060d5723022 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/394536999" status: 202 len: 0 microversion: 2.1 time: 0.036747 Jul 12 11:54:48.951945 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 700/1463] 10.222.0.50 () {58 vars in 1157 bytes} [Tue Jul 12 11:54:48 2022] DELETE /compute/v2.1/flavors/394536999 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 11:54:48.968014 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f0c83b26-8e23-4579-830f-2c453a3db5ab tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:49.001870 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f0c83b26-8e23-4579-830f-2c453a3db5ab tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035292 Jul 12 11:54:49.001870 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 701/1464] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:54:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:49.016556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4324f3dd-7e8a-4ce1-b198-d23266b789ad tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-872456036", "id": 538908808, "os-flavor-access:is_public": "False"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:49.034523 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0d0d2104-2de8-4fce-aea7-a398fbfa12d2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:49.041617 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=8 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:49.048200 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0d0d2104-2de8-4fce-aea7-a398fbfa12d2 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.460357 Jul 12 11:54:49.048735 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:49.050645 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 764/1465] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:48 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:49.095435 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4324f3dd-7e8a-4ce1-b198-d23266b789ad tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.083908 Jul 12 11:54:49.096782 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 702/1466] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:54:49 2022] POST /compute/v2.1/flavors => generated 435 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:49.375844 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-34622fce-841f-411f-b236-4d5c66b4b0e8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:49.376655 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-34622fce-841f-411f-b236-4d5c66b4b0e8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:49.393291 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-34622fce-841f-411f-b236-4d5c66b4b0e8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:49.393911 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-34622fce-841f-411f-b236-4d5c66b4b0e8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:49.395139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-34622fce-841f-411f-b236-4d5c66b4b0e8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:49.395778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-34622fce-841f-411f-b236-4d5c66b4b0e8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:49.415660 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-57ed3099-3b42-4a38-8125-62a2a5d2750c tempest-FlavorsAccessNegativeTestJSON-1582912404 tempest-FlavorsAccessNegativeTestJSON-1582912404-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "92f2ac8d66a64112b6f3f3004d187a37"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:49.422721 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:49.422721 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:54:49.425499 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-57ed3099-3b42-4a38-8125-62a2a5d2750c tempest-FlavorsAccessNegativeTestJSON-1582912404 tempest-FlavorsAccessNegativeTestJSON-1582912404-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bc2a723129644e3288475ea3b54b4dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f2ac8d66a64112b6f3f3004d187a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-57ed3099-3b42-4a38-8125-62a2a5d2750c tempest-FlavorsAccessNegativeTestJSON-1582912404 tempest-FlavorsAccessNegativeTestJSON-1582912404-project] Request method failure captured: Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/flavors/538908808/action HTTP/1.1 Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 67 Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWEEplbQiI4DxsvVOlfM_Gx2Bqusff3SVP930_qf0X4M18LPhMkXfQUMO0KojNbpWSy1p_7cVl94ZnPHqUSBAZ4czzwDA43EiuNoO4PlFXWZSrvutUMPhax19dmZh0kvtcklVo87pIsfGrVncYE7G5ANijMyRyRWHCcZRKoSlOi7RMs Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 92f2ac8d66a64112b6f3f3004d187a37 Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1582912404 Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/92f2ac8d66a64112b6f3f3004d187a37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/92f2ac8d66a64112b6f3f3004d187a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/92f2ac8d66a64112b6f3f3004d187a37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_92f2ac8d66a64112b6f3f3004d187a37", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1582912404 Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 92f2ac8d66a64112b6f3f3004d187a37 Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1582912404 Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-FlavorsAccessNegativeTestJSON-1582912404-project Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: bc2a723129644e3288475ea3b54b4dd2 Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1582912404-project Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: {"addTenantAccess": {"tenant": "92f2ac8d66a64112b6f3f3004d187a37"}} Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '538908808', 'body': {'addTenantAccess': {'tenant': '92f2ac8d66a64112b6f3f3004d187a37'}}} Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 12 11:54:49.430144 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:49.436608 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:49.436608 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:49.436608 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:49.436608 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:49.436608 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:49.436608 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:54:49.436608 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:54:49.436608 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 12 11:54:49.436608 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:54:49.438880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-57ed3099-3b42-4a38-8125-62a2a5d2750c tempest-FlavorsAccessNegativeTestJSON-1582912404 tempest-FlavorsAccessNegativeTestJSON-1582912404-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:49.440709 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-57ed3099-3b42-4a38-8125-62a2a5d2750c tempest-FlavorsAccessNegativeTestJSON-1582912404 tempest-FlavorsAccessNegativeTestJSON-1582912404-project] 10.222.0.50 "POST /compute/v2.1/flavors/538908808/action" status: 403 len: 130 microversion: 2.1 time: 0.333238 Jul 12 11:54:49.442269 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 765/1467] 10.222.0.50 () {60 vars in 1196 bytes} [Tue Jul 12 11:54:49 2022] POST /compute/v2.1/flavors/538908808/action => generated 130 bytes in 335 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:49.453645 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-923a1ae6-43a7-4534-ab7f-c2e1e0e425a5 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:49.454965 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:49.454965 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:54:49.485068 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-923a1ae6-43a7-4534-ab7f-c2e1e0e425a5 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/538908808" status: 202 len: 0 microversion: 2.1 time: 0.035774 Jul 12 11:54:49.486878 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 766/1468] 10.222.0.50 () {58 vars in 1157 bytes} [Tue Jul 12 11:54:49 2022] DELETE /compute/v2.1/flavors/538908808 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:54:49.498021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-24eccee7-ee8a-43de-ba64-26aeb1ea0fe1 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:49.517709 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-24eccee7-ee8a-43de-ba64-26aeb1ea0fe1 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024016 Jul 12 11:54:49.518556 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 767/1469] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:54:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:49.541776 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a41495b9-4140-49d8-95a0-09581668f5f8 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-416790087", "id": 1652105421, "os-flavor-access:is_public": "False"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:49.550056 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:49.550056 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:54:49.578286 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a41495b9-4140-49d8-95a0-09581668f5f8 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.041229 Jul 12 11:54:49.579569 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 768/1470] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:54:49 2022] POST /compute/v2.1/flavors => generated 438 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:54:49.598716 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ba53b1a2-8178-45ff-9efc-554c341afdae tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "92f2ac8d66a64112b6f3f3004d187a37"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:49.946220 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ba53b1a2-8178-45ff-9efc-554c341afdae tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1652105421/action" status: 200 len: 97 microversion: 2.1 time: 0.348329 Jul 12 11:54:49.948096 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 769/1471] 10.222.0.50 () {60 vars in 1199 bytes} [Tue Jul 12 11:54:49 2022] POST /compute/v2.1/flavors/1652105421/action => generated 97 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:54:49.957379 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b4b49e7c-d89b-4df6-9f3a-84da495e2ceb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:49.958098 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b4b49e7c-d89b-4df6-9f3a-84da495e2ceb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:49.966870 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b4b49e7c-d89b-4df6-9f3a-84da495e2ceb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:49.967584 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b4b49e7c-d89b-4df6-9f3a-84da495e2ceb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:49.968546 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b4b49e7c-d89b-4df6-9f3a-84da495e2ceb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:49.969238 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b4b49e7c-d89b-4df6-9f3a-84da495e2ceb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:50.285404 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-34622fce-841f-411f-b236-4d5c66b4b0e8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:50.303441 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-34622fce-841f-411f-b236-4d5c66b4b0e8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1472 microversion: 2.1 time: 0.927550 Jul 12 11:54:50.306246 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 703/1472] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:49 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1472 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:50.333667 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-aa583efd-c980-4d47-88d8-fd0e85634aa2 tempest-FlavorsAccessNegativeTestJSON-1582912404 tempest-FlavorsAccessNegativeTestJSON-1582912404-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "92f2ac8d66a64112b6f3f3004d187a37"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:50.337914 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:50.337914 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:54:50.341278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-aa583efd-c980-4d47-88d8-fd0e85634aa2 tempest-FlavorsAccessNegativeTestJSON-1582912404 tempest-FlavorsAccessNegativeTestJSON-1582912404-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bc2a723129644e3288475ea3b54b4dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f2ac8d66a64112b6f3f3004d187a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-aa583efd-c980-4d47-88d8-fd0e85634aa2 tempest-FlavorsAccessNegativeTestJSON-1582912404 tempest-FlavorsAccessNegativeTestJSON-1582912404-project] Request method failure captured: Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/flavors/1652105421/action HTTP/1.1 Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 70 Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWEEplbQiI4DxsvVOlfM_Gx2Bqusff3SVP930_qf0X4M18LPhMkXfQUMO0KojNbpWSy1p_7cVl94ZnPHqUSBAZ4czzwDA43EiuNoO4PlFXWZSrvutUMPhax19dmZh0kvtcklVo87pIsfGrVncYE7G5ANijMyRyRWHCcZRKoSlOi7RMs Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 92f2ac8d66a64112b6f3f3004d187a37 Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1582912404 Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/92f2ac8d66a64112b6f3f3004d187a37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/92f2ac8d66a64112b6f3f3004d187a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/92f2ac8d66a64112b6f3f3004d187a37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_92f2ac8d66a64112b6f3f3004d187a37", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1582912404 Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 92f2ac8d66a64112b6f3f3004d187a37 Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1582912404 Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-FlavorsAccessNegativeTestJSON-1582912404-project Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: bc2a723129644e3288475ea3b54b4dd2 Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1582912404-project Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: {"removeTenantAccess": {"tenant": "92f2ac8d66a64112b6f3f3004d187a37"}} Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '1652105421', 'body': {'removeTenantAccess': {'tenant': '92f2ac8d66a64112b6f3f3004d187a37'}}} Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi context.can( Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise self.value Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 12 11:54:50.348729 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:50.353004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:50.353004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:50.353004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:50.353004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:50.353004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:50.353004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 12 11:54:50.353004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 12 11:54:50.353004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 12 11:54:50.353004 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:50.353004 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-aa583efd-c980-4d47-88d8-fd0e85634aa2 tempest-FlavorsAccessNegativeTestJSON-1582912404 tempest-FlavorsAccessNegativeTestJSON-1582912404-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:50.353004 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-aa583efd-c980-4d47-88d8-fd0e85634aa2 tempest-FlavorsAccessNegativeTestJSON-1582912404 tempest-FlavorsAccessNegativeTestJSON-1582912404-project] 10.222.0.50 "POST /compute/v2.1/flavors/1652105421/action" status: 403 len: 133 microversion: 2.1 time: 0.031398 Jul 12 11:54:50.360195 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 704/1473] 10.222.0.50 () {60 vars in 1199 bytes} [Tue Jul 12 11:54:50 2022] POST /compute/v2.1/flavors/1652105421/action => generated 133 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:50.373774 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-f5812fdb-e9ea-4f4f-a180-855cd47ef648 req-c25622c0-2bba-4061-9cc5-a4c3978503bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec6989c-9a01-4cd9-a91b-421af9130b46", "name": "network-vif-unplugged", "status": "completed", "tag": "694302fc-4796-4f12-bc02-b17c9376ebbb"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:50.415161 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-f5812fdb-e9ea-4f4f-a180-855cd47ef648 req-c25622c0-2bba-4061-9cc5-a4c3978503bd service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:50.429152 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-f5812fdb-e9ea-4f4f-a180-855cd47ef648 req-c25622c0-2bba-4061-9cc5-a4c3978503bd service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:50.435092 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b4b49e7c-d89b-4df6-9f3a-84da495e2ceb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:50.457038 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b4b49e7c-d89b-4df6-9f3a-84da495e2ceb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1314 microversion: 2.1 time: 0.501721 Jul 12 11:54:50.466679 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 770/1474] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:49 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:50.466778 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-f5812fdb-e9ea-4f4f-a180-855cd47ef648 req-c25622c0-2bba-4061-9cc5-a4c3978503bd service nova] Creating event network-vif-unplugged:694302fc-4796-4f12-bc02-b17c9376ebbb for instance dec6989c-9a01-4cd9-a91b-421af9130b46 on n-h2-849104-4 Jul 12 11:54:50.477882 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-f5812fdb-e9ea-4f4f-a180-855cd47ef648 req-c25622c0-2bba-4061-9cc5-a4c3978503bd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116055 Jul 12 11:54:50.478498 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 705/1475] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:50.480345 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fab49c90-bbb5-49d6-9817-6d2fd29633f8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:50.481688 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fab49c90-bbb5-49d6-9817-6d2fd29633f8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:50.493644 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5257ca23-8ec8-4430-9097-a801a3cfde02 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "92f2ac8d66a64112b6f3f3004d187a37"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:50.495731 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:50.495731 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:54:50.508683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fab49c90-bbb5-49d6-9817-6d2fd29633f8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:50.509412 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fab49c90-bbb5-49d6-9817-6d2fd29633f8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:50.510381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fab49c90-bbb5-49d6-9817-6d2fd29633f8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:50.510829 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fab49c90-bbb5-49d6-9817-6d2fd29633f8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:51.153474 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5257ca23-8ec8-4430-9097-a801a3cfde02 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1652105421/action" status: 200 len: 21 microversion: 2.1 time: 0.671850 Jul 12 11:54:51.155817 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 706/1476] 10.222.0.50 () {60 vars in 1199 bytes} [Tue Jul 12 11:54:50 2022] POST /compute/v2.1/flavors/1652105421/action => generated 21 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:54:51.233383 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b97e3014-99a3-4e30-855a-e7bfa1a8ba32 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:51.238519 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:51.238519 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:54:51.281167 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b97e3014-99a3-4e30-855a-e7bfa1a8ba32 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1652105421" status: 202 len: 0 microversion: 2.1 time: 0.082960 Jul 12 11:54:51.283413 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 707/1477] 10.222.0.50 () {58 vars in 1160 bytes} [Tue Jul 12 11:54:51 2022] DELETE /compute/v2.1/flavors/1652105421 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:54:51.313923 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-410f79ee-a872-46db-9c46-95257713e1f8 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:51.378702 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-410f79ee-a872-46db-9c46-95257713e1f8 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091002 Jul 12 11:54:51.385940 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 708/1478] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:54:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:51.400892 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5a941327-ed98-4778-86e3-e7eb929fd92c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:51.402825 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5a941327-ed98-4778-86e3-e7eb929fd92c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:51.431541 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5a941327-ed98-4778-86e3-e7eb929fd92c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:51.436319 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5a941327-ed98-4778-86e3-e7eb929fd92c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:51.437527 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5a941327-ed98-4778-86e3-e7eb929fd92c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:51.438171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5a941327-ed98-4778-86e3-e7eb929fd92c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:51.471915 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fab49c90-bbb5-49d6-9817-6d2fd29633f8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:51.521057 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fab49c90-bbb5-49d6-9817-6d2fd29633f8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 1.058781 Jul 12 11:54:51.522142 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 771/1479] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:50 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:51.543755 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-aa83a4d9-8550-4751-a672-74ed7f9764b9 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1777012356", "id": 466179872, "os-flavor-access:is_public": "False"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:51.548919 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:51.548919 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:54:51.578561 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-aa83a4d9-8550-4751-a672-74ed7f9764b9 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.049628 Jul 12 11:54:51.581265 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 772/1480] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:54:51 2022] POST /compute/v2.1/flavors => generated 436 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:51.592341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-05b8c1fa-2319-4b64-a4b0-0f5c9ef7e6c1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:51.593473 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-05b8c1fa-2319-4b64-a4b0-0f5c9ef7e6c1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:51.604751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05b8c1fa-2319-4b64-a4b0-0f5c9ef7e6c1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:51.605816 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05b8c1fa-2319-4b64-a4b0-0f5c9ef7e6c1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:51.607428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05b8c1fa-2319-4b64-a4b0-0f5c9ef7e6c1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:51.608738 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05b8c1fa-2319-4b64-a4b0-0f5c9ef7e6c1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:52.055068 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5a941327-ed98-4778-86e3-e7eb929fd92c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:52.072694 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5a941327-ed98-4778-86e3-e7eb929fd92c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1477 microversion: 2.1 time: 0.684963 Jul 12 11:54:52.076449 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 709/1481] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:51 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1477 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:52.083523 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0ba5f74f-642b-48de-9d8c-9e388119c318 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "05285109310f45129c1327b320ae3dc1"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:52.097911 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:52.097911 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:54:52.196229 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-05b8c1fa-2319-4b64-a4b0-0f5c9ef7e6c1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:52.204931 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-05b8c1fa-2319-4b64-a4b0-0f5c9ef7e6c1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1314 microversion: 2.1 time: 0.621935 Jul 12 11:54:52.211454 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 773/1482] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:51 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:52.539313 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-31d9df44-eaa5-42fd-bd39-fe7622d13788 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:52.540723 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-31d9df44-eaa5-42fd-bd39-fe7622d13788 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:52.568324 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31d9df44-eaa5-42fd-bd39-fe7622d13788 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:52.568628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31d9df44-eaa5-42fd-bd39-fe7622d13788 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:52.571509 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31d9df44-eaa5-42fd-bd39-fe7622d13788 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:52.573136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31d9df44-eaa5-42fd-bd39-fe7622d13788 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:52.708346 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-0ba5f74f-642b-48de-9d8c-9e388119c318 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] HTTP exception thrown: Flavor access not found for 39 / 05285109310f45129c1327b320ae3dc1 combination. Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0ba5f74f-642b-48de-9d8c-9e388119c318 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Request method failure captured: Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/flavors/466179872/action HTTP/1.1 Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 70 Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWEFGrdhuvpMA5NpYj1SwCCfyO2QKVgKFdqDyrgfjdZlbCbIkLzU99JrlAZqn_9klsglL_8bjTgUMWeRavC6uQ9WllqZc9v0SS-DFgLcs8phzXYnTRj0VSW2UWgz7KoZQFOV1BNSX_tR6wo2B4EU9dyu9ZmiiTS_LDKZks8mmmsStiE Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 8213f5463a254de99c5d934c4e347cdc Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1487127301 Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Role: admin,reader,member Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: admin,reader,member Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8213f5463a254de99c5d934c4e347cdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8213f5463a254de99c5d934c4e347cdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8213f5463a254de99c5d934c4e347cdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8213f5463a254de99c5d934c4e347cdc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1487127301 Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 8213f5463a254de99c5d934c4e347cdc Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1487127301 Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 508e6bd7b6ae485e959fc5430e668d7f Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: {"removeTenantAccess": {"tenant": "05285109310f45129c1327b320ae3dc1"}} Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: exception: Flavor access not found for 39 / 05285109310f45129c1327b320ae3dc1 combination. Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '466179872', 'body': {'removeTenantAccess': {'tenant': '05285109310f45129c1327b320ae3dc1'}}} Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / 05285109310f45129c1327b320ae3dc1 combination. Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:54:52.720282 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / 05285109310f45129c1327b320ae3dc1 combination. Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / 05285109310f45129c1327b320ae3dc1 combination. Jul 12 11:54:52.729430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:54:52.736567 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0ba5f74f-642b-48de-9d8c-9e388119c318 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Returning 404 to user: Flavor access not found for 39 / 05285109310f45129c1327b320ae3dc1 combination. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:54:52.736567 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0ba5f74f-642b-48de-9d8c-9e388119c318 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/466179872/action" status: 404 len: 124 microversion: 2.1 time: 0.657236 Jul 12 11:54:52.740357 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 710/1483] 10.222.0.50 () {60 vars in 1196 bytes} [Tue Jul 12 11:54:52 2022] POST /compute/v2.1/flavors/466179872/action => generated 124 bytes in 663 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:54:52.759723 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-d38d1af9-f030-4bd9-8a88-98744be250ce req-35d99492-210e-4eac-b00f-38ad6aa08eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec6989c-9a01-4cd9-a91b-421af9130b46", "tag": "694302fc-4796-4f12-bc02-b17c9376ebbb"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:52.785335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-d38d1af9-f030-4bd9-8a88-98744be250ce req-35d99492-210e-4eac-b00f-38ad6aa08eab service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:52.789190 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-d38d1af9-f030-4bd9-8a88-98744be250ce req-35d99492-210e-4eac-b00f-38ad6aa08eab service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:52.800595 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:52.817989 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-d38d1af9-f030-4bd9-8a88-98744be250ce req-35d99492-210e-4eac-b00f-38ad6aa08eab service nova] Creating event network-changed:694302fc-4796-4f12-bc02-b17c9376ebbb for instance dec6989c-9a01-4cd9-a91b-421af9130b46 on n-h2-849104-4 Jul 12 11:54:52.829771 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-d38d1af9-f030-4bd9-8a88-98744be250ce req-35d99492-210e-4eac-b00f-38ad6aa08eab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084894 Jul 12 11:54:52.833547 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 711/1484] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:52.855210 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ba9d1d91-0eb8-4ffa-b658-96d60ceb7910 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:52.865091 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:54:52.865091 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:54:52.907918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-31d9df44-eaa5-42fd-bd39-fe7622d13788 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:52.921063 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ba9d1d91-0eb8-4ffa-b658-96d60ceb7910 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/466179872" status: 202 len: 0 microversion: 2.1 time: 0.082551 Jul 12 11:54:52.923640 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 712/1485] 10.222.0.50 () {58 vars in 1157 bytes} [Tue Jul 12 11:54:52 2022] DELETE /compute/v2.1/flavors/466179872 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:54:52.927010 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-31d9df44-eaa5-42fd-bd39-fe7622d13788 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.390430 Jul 12 11:54:52.952412 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 774/1486] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:52 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:52.964050 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ba97b270-fd88-4739-a709-b024c6da6410 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:53.030298 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ba97b270-fd88-4739-a709-b024c6da6410 tempest-FlavorsAccessNegativeTestJSON-1487127301 tempest-FlavorsAccessNegativeTestJSON-1487127301-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082907 Jul 12 11:54:53.046442 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 713/1487] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:54:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:53.095184 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-26dfd5f6-d90d-4d7a-ae05-9ed329fa3daf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:53.097234 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-26dfd5f6-d90d-4d7a-ae05-9ed329fa3daf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:53.129828 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26dfd5f6-d90d-4d7a-ae05-9ed329fa3daf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:53.131439 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26dfd5f6-d90d-4d7a-ae05-9ed329fa3daf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:53.134768 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26dfd5f6-d90d-4d7a-ae05-9ed329fa3daf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:53.138273 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26dfd5f6-d90d-4d7a-ae05-9ed329fa3daf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:53.234948 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cb3e7d1d-539e-427b-bb07-a8d2e87f6409 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:53.235789 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cb3e7d1d-539e-427b-bb07-a8d2e87f6409 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:53.260558 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb3e7d1d-539e-427b-bb07-a8d2e87f6409 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:53.263367 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb3e7d1d-539e-427b-bb07-a8d2e87f6409 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:53.270818 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb3e7d1d-539e-427b-bb07-a8d2e87f6409 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:53.271630 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb3e7d1d-539e-427b-bb07-a8d2e87f6409 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:53.628949 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-26dfd5f6-d90d-4d7a-ae05-9ed329fa3daf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:53.642517 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-26dfd5f6-d90d-4d7a-ae05-9ed329fa3daf tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1477 microversion: 2.1 time: 0.549633 Jul 12 11:54:53.643527 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 775/1488] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:53 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1477 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:53.654586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1717237953", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "bdff15ed-aeb8-4ae5-8440-8916a1c10d85"}, {"uuid": "0280fe4f-5b2a-4e88-af90-9bfa83072f12"}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:53.740200 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] validate_networks() for [('bdff15ed-aeb8-4ae5-8440-8916a1c10d85', None, None, None, None, None), ('0280fe4f-5b2a-4e88-af90-9bfa83072f12', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:54:53.866477 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=10 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:54.665053 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-cb3e7d1d-539e-427b-bb07-a8d2e87f6409 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:54.676489 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cb3e7d1d-539e-427b-bb07-a8d2e87f6409 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1314 microversion: 2.1 time: 1.452988 Jul 12 11:54:54.677886 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 714/1489] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:53 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1314 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:54.687439 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-eaebbdfe-f6ba-408c-86f1-076c4fe2d3ec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:54.688878 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-eaebbdfe-f6ba-408c-86f1-076c4fe2d3ec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:54.695503 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eaebbdfe-f6ba-408c-86f1-076c4fe2d3ec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:54.696318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eaebbdfe-f6ba-408c-86f1-076c4fe2d3ec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:54.698101 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eaebbdfe-f6ba-408c-86f1-076c4fe2d3ec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:54.699023 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eaebbdfe-f6ba-408c-86f1-076c4fe2d3ec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:54.704942 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:55.933783 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eaebbdfe-f6ba-408c-86f1-076c4fe2d3ec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:55.982861 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-eaebbdfe-f6ba-408c-86f1-076c4fe2d3ec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 1.282037 Jul 12 11:54:55.984066 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 715/1490] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:54 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:55.990026 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0ad42ebb-1b66-4970-9ce0-9ae4c74474a0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:55.992081 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0ad42ebb-1b66-4970-9ce0-9ae4c74474a0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:56.017281 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ad42ebb-1b66-4970-9ce0-9ae4c74474a0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:56.018891 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ad42ebb-1b66-4970-9ce0-9ae4c74474a0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:56.021804 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ad42ebb-1b66-4970-9ce0-9ae4c74474a0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:56.024815 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ad42ebb-1b66-4970-9ce0-9ae4c74474a0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:57.016629 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:54:57.017214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:54:57.017512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:54:57.017927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:54:57.018338 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:54:57.040604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:57.041062 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:57.041897 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:57.046128 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:57.097238 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Getting quotas for project 8526c888ef874e22b5d9496db4568cfa. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:54:57.105929 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Getting quotas for user f91215d432f74692b5b8129dab66bc51 and project 8526c888ef874e22b5d9496db4568cfa. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:54:57.144055 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:54:57.146607 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:54:57.272297 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bb16105a-70a2-422b-b27f-533e05ec6640 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.626391 Jul 12 11:54:57.273588 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 776/1491] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:54:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:54:57.280354 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-d7edcad0-5eb5-495f-8a45-a991cef849f5 req-e3c47fc8-d222-43da-b6d3-5078022bb135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "407593f6-2750-41da-94d7-2f786fa41200", "tag": "9695ca6b-f189-420a-8717-b24b42bc1233"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:54:57.292422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d7edcad0-5eb5-495f-8a45-a991cef849f5 req-e3c47fc8-d222-43da-b6d3-5078022bb135 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:57.293176 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d7edcad0-5eb5-495f-8a45-a991cef849f5 req-e3c47fc8-d222-43da-b6d3-5078022bb135 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:57.312602 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-d7edcad0-5eb5-495f-8a45-a991cef849f5 req-e3c47fc8-d222-43da-b6d3-5078022bb135 service nova] Creating event network-changed:9695ca6b-f189-420a-8717-b24b42bc1233 for instance 407593f6-2750-41da-94d7-2f786fa41200 on n-h1-849104-4 Jul 12 11:54:57.322195 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-d7edcad0-5eb5-495f-8a45-a991cef849f5 req-e3c47fc8-d222-43da-b6d3-5078022bb135 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046751 Jul 12 11:54:57.325483 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 777/1492] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:54:57.334218 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9be9237d-758d-4ed5-a101-34b6047272b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:57.336013 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9be9237d-758d-4ed5-a101-34b6047272b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:57.345932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9be9237d-758d-4ed5-a101-34b6047272b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:57.346371 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9be9237d-758d-4ed5-a101-34b6047272b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:57.347894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9be9237d-758d-4ed5-a101-34b6047272b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:57.349424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9be9237d-758d-4ed5-a101-34b6047272b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:57.356118 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:54:57.365603 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0ad42ebb-1b66-4970-9ce0-9ae4c74474a0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:57.378615 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0ad42ebb-1b66-4970-9ce0-9ae4c74474a0 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1477 microversion: 2.1 time: 1.393051 Jul 12 11:54:57.379204 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 716/1493] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:55 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1477 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:57.389890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-621b95c5-f401-43f7-818b-840b37a493a3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:57.392588 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-621b95c5-f401-43f7-818b-840b37a493a3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:57.406937 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-621b95c5-f401-43f7-818b-840b37a493a3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:57.409408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-621b95c5-f401-43f7-818b-840b37a493a3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:57.413568 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-621b95c5-f401-43f7-818b-840b37a493a3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:57.414237 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-621b95c5-f401-43f7-818b-840b37a493a3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:57.953587 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-621b95c5-f401-43f7-818b-840b37a493a3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:57.979082 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-621b95c5-f401-43f7-818b-840b37a493a3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.592192 Jul 12 11:54:57.987266 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 717/1494] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:57 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:58.004162 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-655d9c43-bff4-4878-8f02-8815e739f218 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:58.005843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-655d9c43-bff4-4878-8f02-8815e739f218 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:58.283997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-655d9c43-bff4-4878-8f02-8815e739f218 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:58.304579 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-655d9c43-bff4-4878-8f02-8815e739f218 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1213 microversion: 2.1 time: 0.315741 Jul 12 11:54:58.305169 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 718/1495] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:57 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1213 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:58.396714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6c5f73d1-6675-49c8-9594-6ee65569702e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:58.397670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6c5f73d1-6675-49c8-9594-6ee65569702e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:58.413124 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6c5f73d1-6675-49c8-9594-6ee65569702e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:58.413610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6c5f73d1-6675-49c8-9594-6ee65569702e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:58.426713 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6c5f73d1-6675-49c8-9594-6ee65569702e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:58.427241 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6c5f73d1-6675-49c8-9594-6ee65569702e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:58.600887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9be9237d-758d-4ed5-a101-34b6047272b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:58.640727 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9be9237d-758d-4ed5-a101-34b6047272b3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1314 microversion: 2.1 time: 1.312520 Jul 12 11:54:58.647937 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 778/1496] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:57 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1314 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:54:59.014475 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-db72239d-5fbe-42bf-8ea0-8f6440bcaba1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:59.015559 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-db72239d-5fbe-42bf-8ea0-8f6440bcaba1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:59.045920 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db72239d-5fbe-42bf-8ea0-8f6440bcaba1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:59.046485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db72239d-5fbe-42bf-8ea0-8f6440bcaba1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:59.048849 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db72239d-5fbe-42bf-8ea0-8f6440bcaba1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:59.049592 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db72239d-5fbe-42bf-8ea0-8f6440bcaba1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:59.108896 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6c5f73d1-6675-49c8-9594-6ee65569702e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:59.120143 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6c5f73d1-6675-49c8-9594-6ee65569702e tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1477 microversion: 2.1 time: 0.727452 Jul 12 11:54:59.126597 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 719/1497] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:58 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1477 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:59.322434 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6e89e049-8cc3-4291-bea2-ed14a7696e80 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:59.323185 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6e89e049-8cc3-4291-bea2-ed14a7696e80 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:59.331308 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e89e049-8cc3-4291-bea2-ed14a7696e80 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:59.352504 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e89e049-8cc3-4291-bea2-ed14a7696e80 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:59.354780 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e89e049-8cc3-4291-bea2-ed14a7696e80 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:59.355751 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e89e049-8cc3-4291-bea2-ed14a7696e80 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:59.721453 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-db72239d-5fbe-42bf-8ea0-8f6440bcaba1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:54:59.732002 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-db72239d-5fbe-42bf-8ea0-8f6440bcaba1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.733159 Jul 12 11:54:59.733069 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 779/1498] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:58 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:54:59.740756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e95b6239-fbf4-408c-89e2-93be11460f77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:54:59.745249 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e95b6239-fbf4-408c-89e2-93be11460f77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:54:59.761271 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e95b6239-fbf4-408c-89e2-93be11460f77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:59.762274 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e95b6239-fbf4-408c-89e2-93be11460f77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:54:59.763560 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e95b6239-fbf4-408c-89e2-93be11460f77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:54:59.764283 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e95b6239-fbf4-408c-89e2-93be11460f77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:00.097733 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6e89e049-8cc3-4291-bea2-ed14a7696e80 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:00.116901 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6e89e049-8cc3-4291-bea2-ed14a7696e80 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1283 microversion: 2.1 time: 0.798684 Jul 12 11:55:00.117755 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 720/1499] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:59 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1283 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:55:00.138440 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c572b9d8-e68c-4476-bef9-39f7d0a08596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:00.139150 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c572b9d8-e68c-4476-bef9-39f7d0a08596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:00.154746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c572b9d8-e68c-4476-bef9-39f7d0a08596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:00.155215 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c572b9d8-e68c-4476-bef9-39f7d0a08596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:00.156058 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c572b9d8-e68c-4476-bef9-39f7d0a08596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:00.156580 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c572b9d8-e68c-4476-bef9-39f7d0a08596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:00.491716 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e95b6239-fbf4-408c-89e2-93be11460f77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:00.543813 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e95b6239-fbf4-408c-89e2-93be11460f77 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1314 microversion: 2.1 time: 0.809447 Jul 12 11:55:00.554498 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 780/1500] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:54:59 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1314 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:00.750372 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6eccdb2f-3d31-4215-8532-027916da6603 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:00.754279 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6eccdb2f-3d31-4215-8532-027916da6603 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:00.763017 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=10,nova_api:DELETE=8 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:00.787585 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6eccdb2f-3d31-4215-8532-027916da6603 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:00.787954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6eccdb2f-3d31-4215-8532-027916da6603 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:00.788779 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6eccdb2f-3d31-4215-8532-027916da6603 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:00.804064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6eccdb2f-3d31-4215-8532-027916da6603 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:01.502957 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6eccdb2f-3d31-4215-8532-027916da6603 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:01.516201 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6eccdb2f-3d31-4215-8532-027916da6603 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.766198 Jul 12 11:55:01.519320 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 781/1501] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:00 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:01.534995 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4c71e889-70e2-4108-9484-f1b830442fcf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:01.535737 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4c71e889-70e2-4108-9484-f1b830442fcf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:01.537772 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c572b9d8-e68c-4476-bef9-39f7d0a08596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:01.556427 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c572b9d8-e68c-4476-bef9-39f7d0a08596 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1477 microversion: 2.1 time: 1.421802 Jul 12 11:55:01.557001 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c71e889-70e2-4108-9484-f1b830442fcf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:01.557670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c71e889-70e2-4108-9484-f1b830442fcf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:01.558876 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 721/1502] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:00 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1477 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:55:01.563564 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c71e889-70e2-4108-9484-f1b830442fcf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:01.565244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c71e889-70e2-4108-9484-f1b830442fcf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:01.763262 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4c71e889-70e2-4108-9484-f1b830442fcf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:01.774255 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4c71e889-70e2-4108-9484-f1b830442fcf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1271 microversion: 2.1 time: 0.253466 Jul 12 11:55:01.778564 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 782/1503] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:01 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1271 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:01.792506 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-effe7555-ecc6-443a-a105-4fd1b0943a0e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:01.795286 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-effe7555-ecc6-443a-a105-4fd1b0943a0e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:01.813967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-effe7555-ecc6-443a-a105-4fd1b0943a0e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:01.814684 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-effe7555-ecc6-443a-a105-4fd1b0943a0e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:01.821949 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-effe7555-ecc6-443a-a105-4fd1b0943a0e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:01.824183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-effe7555-ecc6-443a-a105-4fd1b0943a0e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:01.977238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-96cef4ed-633c-46f4-95a6-18aca737099d tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Action: 'create', calling method: .version_select at 0x7f5e0a89a160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-587010292", "description": "tempest-description-1327122537"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:02.658551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-effe7555-ecc6-443a-a105-4fd1b0943a0e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:02.686467 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-effe7555-ecc6-443a-a105-4fd1b0943a0e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1314 microversion: 2.1 time: 0.905663 Jul 12 11:55:02.688644 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 783/1504] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:01 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:02.715915 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-38f5f1d9-8edb-46d4-9558-756ac34a3ade tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:02.716831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-38f5f1d9-8edb-46d4-9558-756ac34a3ade tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:02.740749 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-38f5f1d9-8edb-46d4-9558-756ac34a3ade tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:02.741695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-38f5f1d9-8edb-46d4-9558-756ac34a3ade tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:02.742729 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-38f5f1d9-8edb-46d4-9558-756ac34a3ade tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:02.743117 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-38f5f1d9-8edb-46d4-9558-756ac34a3ade tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:02.878124 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-96cef4ed-633c-46f4-95a6-18aca737099d tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.314854 Jul 12 11:55:02.879704 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 722/1505] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:55:01 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:02.884693 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3b92d31f-0e47-499b-8b79-6bf005400a76 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:02.885775 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3b92d31f-0e47-499b-8b79-6bf005400a76 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:02.898077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b92d31f-0e47-499b-8b79-6bf005400a76 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:02.899398 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b92d31f-0e47-499b-8b79-6bf005400a76 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:02.900489 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b92d31f-0e47-499b-8b79-6bf005400a76 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:02.907017 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b92d31f-0e47-499b-8b79-6bf005400a76 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:03.125135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-38f5f1d9-8edb-46d4-9558-756ac34a3ade tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:03.138431 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-38f5f1d9-8edb-46d4-9558-756ac34a3ade tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.434715 Jul 12 11:55:03.148631 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 784/1506] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:02 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:03.163704 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6c12f8d8-b9be-4bfe-91e5-67d2cca2967a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:03.165022 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6c12f8d8-b9be-4bfe-91e5-67d2cca2967a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:03.185811 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c12f8d8-b9be-4bfe-91e5-67d2cca2967a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:03.186290 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c12f8d8-b9be-4bfe-91e5-67d2cca2967a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:03.187062 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c12f8d8-b9be-4bfe-91e5-67d2cca2967a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:03.187496 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c12f8d8-b9be-4bfe-91e5-67d2cca2967a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:03.734965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6c12f8d8-b9be-4bfe-91e5-67d2cca2967a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:03.743461 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6c12f8d8-b9be-4bfe-91e5-67d2cca2967a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1313 microversion: 2.1 time: 0.590489 Jul 12 11:55:03.756053 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 785/1507] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:03 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1313 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:03.763129 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2126cebd-37eb-4cc6-b8bd-816affc1e389 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Action: 'create', calling method: .version_select at 0x7f5e0a6fd1f0>, body: {"security_group_rule": {"parent_group_id": "1e4f530f-7d84-4d85-8522-528df67155b5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:04.122272 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3b92d31f-0e47-499b-8b79-6bf005400a76 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:04.137235 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3b92d31f-0e47-499b-8b79-6bf005400a76 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1477 microversion: 2.1 time: 1.256021 Jul 12 11:55:04.138183 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 723/1508] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:02 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1477 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:04.145974 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-0486188c-1b7f-4eaa-a30b-55394e012e2c req-ffa28942-213a-4fdd-bff8-286328715ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec6989c-9a01-4cd9-a91b-421af9130b46", "name": "network-vif-unplugged", "status": "completed", "tag": "694302fc-4796-4f12-bc02-b17c9376ebbb"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:04.158237 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-0486188c-1b7f-4eaa-a30b-55394e012e2c req-ffa28942-213a-4fdd-bff8-286328715ec4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:04.160165 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-0486188c-1b7f-4eaa-a30b-55394e012e2c req-ffa28942-213a-4fdd-bff8-286328715ec4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:04.206183 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-0486188c-1b7f-4eaa-a30b-55394e012e2c req-ffa28942-213a-4fdd-bff8-286328715ec4 service nova] Creating event network-vif-unplugged:694302fc-4796-4f12-bc02-b17c9376ebbb for instance dec6989c-9a01-4cd9-a91b-421af9130b46 on n-h2-849104-4 Jul 12 11:55:04.214088 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-0486188c-1b7f-4eaa-a30b-55394e012e2c req-ffa28942-213a-4fdd-bff8-286328715ec4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074205 Jul 12 11:55:04.216491 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 724/1509] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:04.226399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0ef14637-2a2f-4463-837b-235537401eb3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:04.227582 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0ef14637-2a2f-4463-837b-235537401eb3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:04.235966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ef14637-2a2f-4463-837b-235537401eb3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:04.236445 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ef14637-2a2f-4463-837b-235537401eb3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:04.237227 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ef14637-2a2f-4463-837b-235537401eb3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:04.237975 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ef14637-2a2f-4463-837b-235537401eb3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:04.338108 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2126cebd-37eb-4cc6-b8bd-816affc1e389 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.578205 Jul 12 11:55:04.346469 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 786/1510] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Jul 12 11:55:03 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:04.349271 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d286760f-6ece-4967-a345-b63c249b0e08 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:04.358629 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d286760f-6ece-4967-a345-b63c249b0e08 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:04.374031 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d286760f-6ece-4967-a345-b63c249b0e08 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:04.384284 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d286760f-6ece-4967-a345-b63c249b0e08 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:04.385608 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d286760f-6ece-4967-a345-b63c249b0e08 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:04.386310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d286760f-6ece-4967-a345-b63c249b0e08 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:04.688332 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d286760f-6ece-4967-a345-b63c249b0e08 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:04.700373 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d286760f-6ece-4967-a345-b63c249b0e08 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.359133 Jul 12 11:55:04.701506 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 787/1511] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:04 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:04.706851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d81e876e-8015-4dfb-98bc-7ef6e5e577e0 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Action: 'create', calling method: .version_select at 0x7f5e09b36940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1440879206", "description": "tempest-description-116093833"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:05.005726 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d81e876e-8015-4dfb-98bc-7ef6e5e577e0 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.303005 Jul 12 11:55:05.006383 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 788/1512] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:55:04 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:05.011585 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3866e212-08f8-4a8e-a6ea-f7d08d677ea7 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:05.012914 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3866e212-08f8-4a8e-a6ea-f7d08d677ea7 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:05.026508 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3866e212-08f8-4a8e-a6ea-f7d08d677ea7 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:05.027365 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3866e212-08f8-4a8e-a6ea-f7d08d677ea7 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:05.029276 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3866e212-08f8-4a8e-a6ea-f7d08d677ea7 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:05.030108 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3866e212-08f8-4a8e-a6ea-f7d08d677ea7 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:05.274471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3866e212-08f8-4a8e-a6ea-f7d08d677ea7 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:05.283341 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3866e212-08f8-4a8e-a6ea-f7d08d677ea7 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1313 microversion: 2.1 time: 0.275395 Jul 12 11:55:05.293417 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 789/1513] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:05 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:05.293417 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-aba0b487-8271-4dfe-885d-c358631d4a03 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Action: 'create', calling method: .version_select at 0x7f5e09b36790>, body: {"security_group_rule": {"parent_group_id": "13af1009-9501-4ee1-b043-150e8da907a9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:05.302598 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0ef14637-2a2f-4463-837b-235537401eb3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:05.317616 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0ef14637-2a2f-4463-837b-235537401eb3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1314 microversion: 2.1 time: 1.099323 Jul 12 11:55:05.318502 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 725/1514] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:04 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1314 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:05.336689 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c2c840b2-3b45-49d2-854b-116a850c43ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:05.337624 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c2c840b2-3b45-49d2-854b-116a850c43ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:05.344174 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2c840b2-3b45-49d2-854b-116a850c43ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:05.344904 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2c840b2-3b45-49d2-854b-116a850c43ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:05.345884 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2c840b2-3b45-49d2-854b-116a850c43ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:05.346496 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2c840b2-3b45-49d2-854b-116a850c43ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:05.547965 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-aba0b487-8271-4dfe-885d-c358631d4a03 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.262629 Jul 12 11:55:05.549192 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 790/1515] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Jul 12 11:55:05 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:05.730008 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5182c4a3-f060-4b98-a398-8a549af82dcd tempest-FlavorsV255TestJSON-449677701 tempest-FlavorsV255TestJSON-449677701-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-8450736", "id": 700148146, "os-flavor-access:is_public": "True"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:05.731674 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:55:05.731674 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:55:05.751066 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5182c4a3-f060-4b98-a398-8a549af82dcd tempest-FlavorsV255TestJSON-449677701 tempest-FlavorsV255TestJSON-449677701-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 443 microversion: 2.55 time: 0.200426 Jul 12 11:55:05.752407 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 791/1516] 10.222.0.50 () {62 vars in 1187 bytes} [Tue Jul 12 11:55:05 2022] POST /compute/v2.1/flavors => generated 443 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:55:05.757889 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3c7c5a7a-8a77-4eb3-8f42-f5805e291230 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Action: 'create', calling method: .version_select at 0x7f5e09c131f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1001817690", "description": "tempest-description-2088146551"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:06.013209 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3c7c5a7a-8a77-4eb3-8f42-f5805e291230 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.259491 Jul 12 11:55:06.021502 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 792/1517] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:55:05 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:06.027637 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-46eb575b-36be-4ee0-9f92-c1c37f68fe98 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:06.028621 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-46eb575b-36be-4ee0-9f92-c1c37f68fe98 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:06.040869 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46eb575b-36be-4ee0-9f92-c1c37f68fe98 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:06.041924 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46eb575b-36be-4ee0-9f92-c1c37f68fe98 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:06.043864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46eb575b-36be-4ee0-9f92-c1c37f68fe98 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:06.045297 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46eb575b-36be-4ee0-9f92-c1c37f68fe98 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:06.101862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c2c840b2-3b45-49d2-854b-116a850c43ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:06.111984 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c2c840b2-3b45-49d2-854b-116a850c43ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1477 microversion: 2.1 time: 0.791549 Jul 12 11:55:06.112801 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 726/1518] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:05 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1477 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:06.322850 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-46eb575b-36be-4ee0-9f92-c1c37f68fe98 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:06.335821 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-46eb575b-36be-4ee0-9f92-c1c37f68fe98 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.312329 Jul 12 11:55:06.340218 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-67a97bd3-c3cc-4eeb-8f2f-9cfaa45f90f6 tempest-FlavorsV255TestJSON-1051423729 tempest-FlavorsV255TestJSON-1051423729-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:06.347743 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 793/1519] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:06 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:06.351808 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-67a97bd3-c3cc-4eeb-8f2f-9cfaa45f90f6 tempest-FlavorsV255TestJSON-1051423729 tempest-FlavorsV255TestJSON-1051423729-project] 10.222.0.50 "GET /compute/v2.1/flavors/700148146" status: 200 len: 443 microversion: 2.55 time: 0.224169 Jul 12 11:55:06.352425 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 727/1520] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Jul 12 11:55:06 2022] GET /compute/v2.1/flavors/700148146 => generated 443 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:55:06.361991 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ca79115d-518f-4764-91e2-958271e9c8d5 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Action: 'create', calling method: .version_select at 0x7f5e09c2d3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2147213618", "description": "tempest-description-721607802"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:06.368246 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6ae48741-f116-44b3-84df-3d66dfc1b506 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:06.369161 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6ae48741-f116-44b3-84df-3d66dfc1b506 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:06.375727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ae48741-f116-44b3-84df-3d66dfc1b506 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:06.376461 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ae48741-f116-44b3-84df-3d66dfc1b506 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:06.377723 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ae48741-f116-44b3-84df-3d66dfc1b506 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:06.378463 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ae48741-f116-44b3-84df-3d66dfc1b506 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:06.556537 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ca79115d-518f-4764-91e2-958271e9c8d5 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.203311 Jul 12 11:55:06.563378 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 794/1521] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:55:06 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:06.568864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f63ce590-dbf2-41f4-a273-db3c963d943a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:06.569815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f63ce590-dbf2-41f4-a273-db3c963d943a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:06.577555 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f63ce590-dbf2-41f4-a273-db3c963d943a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:06.578357 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f63ce590-dbf2-41f4-a273-db3c963d943a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:06.579415 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f63ce590-dbf2-41f4-a273-db3c963d943a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:06.580138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f63ce590-dbf2-41f4-a273-db3c963d943a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:06.746864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f63ce590-dbf2-41f4-a273-db3c963d943a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:06.756860 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f63ce590-dbf2-41f4-a273-db3c963d943a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1314 microversion: 2.1 time: 0.191822 Jul 12 11:55:06.768922 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 795/1522] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:06 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:06.775365 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6b51aa06-9ac7-42bf-874e-eec4b96d2491 tempest-FlavorsV255TestJSON-449677701 tempest-FlavorsV255TestJSON-449677701-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:06.778519 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:55:06.778519 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:55:06.806371 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6b51aa06-9ac7-42bf-874e-eec4b96d2491 tempest-FlavorsV255TestJSON-449677701 tempest-FlavorsV255TestJSON-449677701-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/700148146" status: 200 len: 444 microversion: 2.55 time: 0.035797 Jul 12 11:55:06.807388 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 796/1523] 10.222.0.50 () {62 vars in 1215 bytes} [Tue Jul 12 11:55:06 2022] PUT /compute/v2.1/flavors/700148146 => generated 444 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:55:06.817062 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bc5bebf6-b287-449f-bf4b-05a7cca69889 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Action: 'create', calling method: .version_select at 0x7f5e09b71c10>, body: {"security_group_rule": {"parent_group_id": "5a2db953-9ec9-4a6a-a092-26ccda22e85e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b35ffada-74bf-4bbc-a114-89bdc48d14f8"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:07.068393 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:07.132783 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:07.147613 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6ae48741-f116-44b3-84df-3d66dfc1b506 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:07.169769 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6ae48741-f116-44b3-84df-3d66dfc1b506 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1313 microversion: 2.1 time: 0.812248 Jul 12 11:55:07.170622 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 728/1524] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:06 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1313 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:07.185846 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bc5bebf6-b287-449f-bf4b-05a7cca69889 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.374018 Jul 12 11:55:07.186979 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 797/1525] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Jul 12 11:55:06 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:07.195715 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-400ffe4f-7101-4590-86bf-1945c60309b0 tempest-FlavorsV255TestJSON-1051423729 tempest-FlavorsV255TestJSON-1051423729-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:07.201482 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-e0ffdd0d-bef1-4857-a1fe-b89cc7a33b5b req-8698981d-9ac3-465e-951c-e9ffe98d03ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407593f6-2750-41da-94d7-2f786fa41200", "name": "network-vif-plugged", "status": "completed", "tag": "9695ca6b-f189-420a-8717-b24b42bc1233"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:07.212663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-e0ffdd0d-bef1-4857-a1fe-b89cc7a33b5b req-8698981d-9ac3-465e-951c-e9ffe98d03ee service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:07.213495 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-e0ffdd0d-bef1-4857-a1fe-b89cc7a33b5b req-8698981d-9ac3-465e-951c-e9ffe98d03ee service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:07.226815 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-e0ffdd0d-bef1-4857-a1fe-b89cc7a33b5b req-8698981d-9ac3-465e-951c-e9ffe98d03ee service nova] Creating event network-vif-plugged:9695ca6b-f189-420a-8717-b24b42bc1233 for instance 407593f6-2750-41da-94d7-2f786fa41200 on n-h1-849104-4 Jul 12 11:55:07.232899 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-e0ffdd0d-bef1-4857-a1fe-b89cc7a33b5b req-8698981d-9ac3-465e-951c-e9ffe98d03ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035116 Jul 12 11:55:07.234172 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 798/1526] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:07.239766 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-400ffe4f-7101-4590-86bf-1945c60309b0 tempest-FlavorsV255TestJSON-1051423729 tempest-FlavorsV255TestJSON-1051423729-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5719 microversion: 2.55 time: 0.066917 Jul 12 11:55:07.241132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f9536883-dd00-4e0a-87ff-474f707f3002 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:07.242233 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f9536883-dd00-4e0a-87ff-474f707f3002 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:07.249631 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9536883-dd00-4e0a-87ff-474f707f3002 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:07.250378 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9536883-dd00-4e0a-87ff-474f707f3002 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:07.251593 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9536883-dd00-4e0a-87ff-474f707f3002 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:07.252368 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9536883-dd00-4e0a-87ff-474f707f3002 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:07.252935 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 729/1527] 10.222.0.50 () {60 vars in 1186 bytes} [Tue Jul 12 11:55:07 2022] GET /compute/v2.1/flavors/detail => generated 5719 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:55:07.260966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-370fd35c-01f3-4fdc-96aa-ae2db573d7ef tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Action: 'create', calling method: .version_select at 0x7f5e0b100c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-440578771", "description": "tempest-description-2117556964"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:07.633230 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f9536883-dd00-4e0a-87ff-474f707f3002 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:07.641926 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f9536883-dd00-4e0a-87ff-474f707f3002 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1477 microversion: 2.1 time: 0.406226 Jul 12 11:55:07.645334 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 799/1528] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:07 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1477 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:07.657925 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b1d92957-7ef9-439a-b825-e9c908ff129d tempest-FlavorsV255TestJSON-1051423729 tempest-FlavorsV255TestJSON-1051423729-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:07.690819 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b1d92957-7ef9-439a-b825-e9c908ff129d tempest-FlavorsV255TestJSON-1051423729 tempest-FlavorsV255TestJSON-1051423729-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3151 microversion: 2.55 time: 0.044252 Jul 12 11:55:07.692100 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 800/1529] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Jul 12 11:55:07 2022] GET /compute/v2.1/flavors => generated 3151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:55:07.706074 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ac1804e0-0010-4e71-995a-2fbadbf7275d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:07.707097 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ac1804e0-0010-4e71-995a-2fbadbf7275d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:07.719926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac1804e0-0010-4e71-995a-2fbadbf7275d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:07.720737 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac1804e0-0010-4e71-995a-2fbadbf7275d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:07.721529 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac1804e0-0010-4e71-995a-2fbadbf7275d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:07.721967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac1804e0-0010-4e71-995a-2fbadbf7275d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:08.081002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ac1804e0-0010-4e71-995a-2fbadbf7275d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:08.091728 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ac1804e0-0010-4e71-995a-2fbadbf7275d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1718 microversion: 2.1 time: 0.398329 Jul 12 11:55:08.104399 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 801/1530] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:07 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1718 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:08.111647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-90f24bc3-ff38-4bda-83af-2b7bfc0c4559 tempest-FlavorsV255TestJSON-449677701 tempest-FlavorsV255TestJSON-449677701-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:08.112606 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:55:08.112606 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:55:08.136750 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-90f24bc3-ff38-4bda-83af-2b7bfc0c4559 tempest-FlavorsV255TestJSON-449677701 tempest-FlavorsV255TestJSON-449677701-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/700148146" status: 202 len: 0 microversion: 2.55 time: 0.030293 Jul 12 11:55:08.137352 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 802/1531] 10.222.0.50 () {60 vars in 1198 bytes} [Tue Jul 12 11:55:08 2022] DELETE /compute/v2.1/flavors/700148146 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:55:08.146794 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a5881de1-4ee1-452e-8556-02f6de64272d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:08.147417 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a5881de1-4ee1-452e-8556-02f6de64272d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:08.155332 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5881de1-4ee1-452e-8556-02f6de64272d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:08.156131 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5881de1-4ee1-452e-8556-02f6de64272d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:08.157111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5881de1-4ee1-452e-8556-02f6de64272d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:08.158310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5881de1-4ee1-452e-8556-02f6de64272d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:08.291625 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:08.412087 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a5881de1-4ee1-452e-8556-02f6de64272d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:08.424305 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a5881de1-4ee1-452e-8556-02f6de64272d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1314 microversion: 2.1 time: 0.281626 Jul 12 11:55:08.425210 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 803/1532] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:08 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:08.434522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-21c9bd9d-d51a-4b2f-a350-187d5e2e8a66 tempest-FlavorsV255TestJSON-449677701 tempest-FlavorsV255TestJSON-449677701-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:08.473218 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-21c9bd9d-d51a-4b2f-a350-187d5e2e8a66 tempest-FlavorsV255TestJSON-449677701 tempest-FlavorsV255TestJSON-449677701-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.046114 Jul 12 11:55:08.482527 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 804/1533] 10.222.0.50 () {60 vars in 1186 bytes} [Tue Jul 12 11:55:08 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:55:08.497501 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e0a7c4ef-9a26-4824-952b-241c22f98d29 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:08.498116 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e0a7c4ef-9a26-4824-952b-241c22f98d29 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:08.517843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e0a7c4ef-9a26-4824-952b-241c22f98d29 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:08.518297 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e0a7c4ef-9a26-4824-952b-241c22f98d29 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:08.519089 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e0a7c4ef-9a26-4824-952b-241c22f98d29 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:08.519530 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e0a7c4ef-9a26-4824-952b-241c22f98d29 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:08.988321 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e0a7c4ef-9a26-4824-952b-241c22f98d29 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:09.000091 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e0a7c4ef-9a26-4824-952b-241c22f98d29 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1334 microversion: 2.1 time: 0.514668 Jul 12 11:55:09.000775 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 805/1534] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:08 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1334 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:09.028098 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8cb874c4-3e3a-4123-a521-6125789efdde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:09.028719 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8cb874c4-3e3a-4123-a521-6125789efdde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:09.069956 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8cb874c4-3e3a-4123-a521-6125789efdde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:09.070906 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8cb874c4-3e3a-4123-a521-6125789efdde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:09.074581 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8cb874c4-3e3a-4123-a521-6125789efdde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:09.077679 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8cb874c4-3e3a-4123-a521-6125789efdde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:09.091432 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-370fd35c-01f3-4fdc-96aa-ae2db573d7ef tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.837295 Jul 12 11:55:09.092055 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 730/1535] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:55:07 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:09.104657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-24627b1b-13dc-4e2f-94a8-a184d5915ef3 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Action: 'create', calling method: .version_select at 0x7f5e0a8830d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-962873987", "description": "tempest-description-659263455"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:09.114278 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:09.339924 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8cb874c4-3e3a-4123-a521-6125789efdde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:09.351405 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8cb874c4-3e3a-4123-a521-6125789efdde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1477 microversion: 2.1 time: 0.330137 Jul 12 11:55:09.352642 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 806/1536] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:09 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1477 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:09.369162 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0f7efa32-8260-40e1-b19e-839c794e8ea1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:09.369864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0f7efa32-8260-40e1-b19e-839c794e8ea1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:09.377568 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f7efa32-8260-40e1-b19e-839c794e8ea1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:09.378025 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f7efa32-8260-40e1-b19e-839c794e8ea1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:09.382358 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f7efa32-8260-40e1-b19e-839c794e8ea1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:09.382823 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f7efa32-8260-40e1-b19e-839c794e8ea1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:09.767739 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0f7efa32-8260-40e1-b19e-839c794e8ea1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:09.780927 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0f7efa32-8260-40e1-b19e-839c794e8ea1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1708 microversion: 2.1 time: 0.426694 Jul 12 11:55:09.781748 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 807/1537] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:09 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1708 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:09.799147 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fa565b9a-06b5-46e3-9839-34a2a7d1e9dd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:09.799778 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fa565b9a-06b5-46e3-9839-34a2a7d1e9dd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:09.813068 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fa565b9a-06b5-46e3-9839-34a2a7d1e9dd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:09.813889 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fa565b9a-06b5-46e3-9839-34a2a7d1e9dd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:09.814913 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fa565b9a-06b5-46e3-9839-34a2a7d1e9dd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:09.815636 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fa565b9a-06b5-46e3-9839-34a2a7d1e9dd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:10.069872 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fa565b9a-06b5-46e3-9839-34a2a7d1e9dd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:10.085780 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fa565b9a-06b5-46e3-9839-34a2a7d1e9dd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1501 microversion: 2.1 time: 0.303174 Jul 12 11:55:10.086604 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 808/1538] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:09 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1501 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:10.105501 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3d49f199-5c36-4457-aa3a-b7bb3d44268d tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '.version_select at 0x7f5e09b50ca0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:10.108185 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d49f199-5c36-4457-aa3a-b7bb3d44268d tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:10.108879 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d49f199-5c36-4457-aa3a-b7bb3d44268d tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:10.126965 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3d49f199-5c36-4457-aa3a-b7bb3d44268d tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 2737 microversion: 2.1 time: 0.028938 Jul 12 11:55:10.127601 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 809/1539] 10.222.0.50 () {58 vars in 1142 bytes} [Tue Jul 12 11:55:10 2022] GET /compute/v2.1/os-migrations => generated 2737 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:10.136225 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f7fa682e-b6f0-437f-9399-f961f52b3540 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:10.137139 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f7fa682e-b6f0-437f-9399-f961f52b3540 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:10.147516 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f7fa682e-b6f0-437f-9399-f961f52b3540 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:10.148272 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f7fa682e-b6f0-437f-9399-f961f52b3540 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:10.149520 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f7fa682e-b6f0-437f-9399-f961f52b3540 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:10.149971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f7fa682e-b6f0-437f-9399-f961f52b3540 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:10.201752 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-24627b1b-13dc-4e2f-94a8-a184d5915ef3 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.101123 Jul 12 11:55:10.204574 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 731/1540] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:55:09 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:10.219513 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-649d1f14-511c-4198-b0cd-27def5abe549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:10.219513 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-649d1f14-511c-4198-b0cd-27def5abe549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:10.228262 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-649d1f14-511c-4198-b0cd-27def5abe549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:10.229256 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-649d1f14-511c-4198-b0cd-27def5abe549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:10.230385 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-649d1f14-511c-4198-b0cd-27def5abe549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:10.232303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-649d1f14-511c-4198-b0cd-27def5abe549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:10.440929 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-649d1f14-511c-4198-b0cd-27def5abe549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "POST /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200/action" status: 202 len: 0 microversion: 2.1 time: 0.233878 Jul 12 11:55:10.445580 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 732/1541] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:55:10 2022] POST /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:55:10.467454 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-70996401-1f26-4f3c-89a6-b9e68b00f440 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:10.468214 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-70996401-1f26-4f3c-89a6-b9e68b00f440 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:10.484826 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-70996401-1f26-4f3c-89a6-b9e68b00f440 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:10.485392 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-70996401-1f26-4f3c-89a6-b9e68b00f440 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:10.489415 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-70996401-1f26-4f3c-89a6-b9e68b00f440 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:10.489840 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-70996401-1f26-4f3c-89a6-b9e68b00f440 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:10.501350 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f7fa682e-b6f0-437f-9399-f961f52b3540 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:10.528234 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f7fa682e-b6f0-437f-9399-f961f52b3540 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1334 microversion: 2.1 time: 0.385495 Jul 12 11:55:10.547232 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 810/1542] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:10 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1334 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:10.559863 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d7529e58-695c-45e7-b3e9-3b467dd994c9 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Action: 'create', calling method: .version_select at 0x7f5e09b50f70>, body: {"security_group_rule": {"parent_group_id": "c650767c-cb89-475d-bd02-a46764c1bb0f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "fe2f27f8-458f-4ec5-bbc4-857405e69e5d"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:10.926980 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-70996401-1f26-4f3c-89a6-b9e68b00f440 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1859 microversion: 2.1 time: 0.469316 Jul 12 11:55:10.932233 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 733/1543] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:10 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1859 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:10.946038 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c4fd726f-b4b3-4828-b844-e2322ece340d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:10.947217 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c4fd726f-b4b3-4828-b844-e2322ece340d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:10.961504 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c4fd726f-b4b3-4828-b844-e2322ece340d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:10.964402 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c4fd726f-b4b3-4828-b844-e2322ece340d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:10.966039 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c4fd726f-b4b3-4828-b844-e2322ece340d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:10.968766 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c4fd726f-b4b3-4828-b844-e2322ece340d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:11.713249 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c4fd726f-b4b3-4828-b844-e2322ece340d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:11.748015 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c4fd726f-b4b3-4828-b844-e2322ece340d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1477 microversion: 2.1 time: 0.812071 Jul 12 11:55:11.748278 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d7529e58-695c-45e7-b3e9-3b467dd994c9 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.199363 Jul 12 11:55:11.752183 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 734/1544] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:10 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1477 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:11.755393 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 811/1545] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Jul 12 11:55:10 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:11.762099 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-94dfbd1b-5c1b-4386-aee4-7227c1dffded tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:11.764270 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-94dfbd1b-5c1b-4386-aee4-7227c1dffded tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:11.765151 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0c60295c-a4f8-4d92-83d4-7c604eaa1ce3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:11.770435 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0c60295c-a4f8-4d92-83d4-7c604eaa1ce3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:11.784135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94dfbd1b-5c1b-4386-aee4-7227c1dffded tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:11.784589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94dfbd1b-5c1b-4386-aee4-7227c1dffded tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:11.796984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94dfbd1b-5c1b-4386-aee4-7227c1dffded tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:11.798962 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94dfbd1b-5c1b-4386-aee4-7227c1dffded tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:11.800208 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c60295c-a4f8-4d92-83d4-7c604eaa1ce3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:11.800878 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c60295c-a4f8-4d92-83d4-7c604eaa1ce3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:11.802489 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c60295c-a4f8-4d92-83d4-7c604eaa1ce3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:11.803550 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c60295c-a4f8-4d92-83d4-7c604eaa1ce3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:12.237401 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-94dfbd1b-5c1b-4386-aee4-7227c1dffded tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1859 microversion: 2.1 time: 0.480018 Jul 12 11:55:12.254423 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 812/1546] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:11 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1859 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:12.269420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-f79bf314-311f-45aa-b53d-260a78c321e8 req-004e202e-94a4-4e82-b6a3-36280cb9eec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a41bff-2e83-4c3d-abda-10a811857771", "tag": "69a137c8-1ef0-46cc-8217-9bb85907e487"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:12.288201 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-f79bf314-311f-45aa-b53d-260a78c321e8 req-004e202e-94a4-4e82-b6a3-36280cb9eec8 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:12.289167 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-f79bf314-311f-45aa-b53d-260a78c321e8 req-004e202e-94a4-4e82-b6a3-36280cb9eec8 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:12.310899 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-f79bf314-311f-45aa-b53d-260a78c321e8 req-004e202e-94a4-4e82-b6a3-36280cb9eec8 service nova] Creating event network-changed:69a137c8-1ef0-46cc-8217-9bb85907e487 for instance 06a41bff-2e83-4c3d-abda-10a811857771 on n-h2-849104-4 Jul 12 11:55:12.326678 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-f79bf314-311f-45aa-b53d-260a78c321e8 req-004e202e-94a4-4e82-b6a3-36280cb9eec8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070612 Jul 12 11:55:12.327715 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 813/1547] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:12.335568 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9c1488db-20d5-4e80-a068-b14d379ec02e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:12.337428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9c1488db-20d5-4e80-a068-b14d379ec02e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:12.347519 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c1488db-20d5-4e80-a068-b14d379ec02e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:12.348260 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c1488db-20d5-4e80-a068-b14d379ec02e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:12.349409 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c1488db-20d5-4e80-a068-b14d379ec02e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:12.350255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c1488db-20d5-4e80-a068-b14d379ec02e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:12.641497 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9c1488db-20d5-4e80-a068-b14d379ec02e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:12.655527 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9c1488db-20d5-4e80-a068-b14d379ec02e tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1334 microversion: 2.1 time: 0.324709 Jul 12 11:55:12.664945 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 814/1548] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:12 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1334 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:12.683254 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a434039b-a882-4175-a0ec-c18a4055c046 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Calling method '.version_select at 0x7f5e09c5e430>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:13.023231 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0c60295c-a4f8-4d92-83d4-7c604eaa1ce3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:13.034864 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0c60295c-a4f8-4d92-83d4-7c604eaa1ce3 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1486 microversion: 2.1 time: 1.280368 Jul 12 11:55:13.036734 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 735/1549] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:11 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1486 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:13.063130 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-04a2feba-7f6d-464b-b01c-b0f07c37bbdf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:13.065347 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-04a2feba-7f6d-464b-b01c-b0f07c37bbdf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:13.081117 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-04a2feba-7f6d-464b-b01c-b0f07c37bbdf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:13.081849 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-04a2feba-7f6d-464b-b01c-b0f07c37bbdf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:13.082839 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-04a2feba-7f6d-464b-b01c-b0f07c37bbdf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:13.086007 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-04a2feba-7f6d-464b-b01c-b0f07c37bbdf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:13.257071 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-04a2feba-7f6d-464b-b01c-b0f07c37bbdf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lazy-loading 'services' on Instance uuid dec6989c-9a01-4cd9-a91b-421af9130b46 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:55:13.503403 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:13.526190 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-04a2feba-7f6d-464b-b01c-b0f07c37bbdf tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments/0428fd7b-c4ab-4c67-98fc-66e4951042fc" status: 202 len: 0 microversion: 2.1 time: 0.473138 Jul 12 11:55:13.531421 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 736/1550] 10.222.0.50 () {58 vars in 1415 bytes} [Tue Jul 12 11:55:13 2022] DELETE /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments/0428fd7b-c4ab-4c67-98fc-66e4951042fc => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:55:13.548182 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-70336945-18e4-4722-ae27-d9c3732d9945 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:13.551476 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-70336945-18e4-4722-ae27-d9c3732d9945 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:13.576982 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-70336945-18e4-4722-ae27-d9c3732d9945 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:13.577455 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-70336945-18e4-4722-ae27-d9c3732d9945 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:13.578354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-70336945-18e4-4722-ae27-d9c3732d9945 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:13.583569 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-70336945-18e4-4722-ae27-d9c3732d9945 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:13.942864 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a434039b-a882-4175-a0ec-c18a4055c046 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/fe2f27f8-458f-4ec5-bbc4-857405e69e5d" status: 202 len: 0 microversion: 2.1 time: 1.273663 Jul 12 11:55:13.943586 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 815/1551] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:55:12 2022] DELETE /compute/v2.1/os-security-groups/fe2f27f8-458f-4ec5-bbc4-857405e69e5d => generated 0 bytes in 1276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:55:13.953429 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2558205d-5cef-45c5-8f01-a0ba43e6cd95 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:13.954389 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2558205d-5cef-45c5-8f01-a0ba43e6cd95 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:13.968875 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2558205d-5cef-45c5-8f01-a0ba43e6cd95 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:13.972719 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2558205d-5cef-45c5-8f01-a0ba43e6cd95 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:13.973628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2558205d-5cef-45c5-8f01-a0ba43e6cd95 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:13.982293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2558205d-5cef-45c5-8f01-a0ba43e6cd95 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:14.043797 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2558205d-5cef-45c5-8f01-a0ba43e6cd95 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:55:14.328631 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2558205d-5cef-45c5-8f01-a0ba43e6cd95 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 204 len: 0 microversion: 2.1 time: 0.383286 Jul 12 11:55:14.329235 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 816/1552] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:55:13 2022] DELETE /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:55:14.355150 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d0481120-69cd-4286-984e-7ce948ad81ef tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:14.358432 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d0481120-69cd-4286-984e-7ce948ad81ef tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:14.374554 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0481120-69cd-4286-984e-7ce948ad81ef tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:14.377289 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0481120-69cd-4286-984e-7ce948ad81ef tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:14.378571 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0481120-69cd-4286-984e-7ce948ad81ef tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:14.381434 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0481120-69cd-4286-984e-7ce948ad81ef tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:14.447157 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d0481120-69cd-4286-984e-7ce948ad81ef tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103113 Jul 12 11:55:14.450756 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 817/1553] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:55:14 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:14.469273 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-65a5b775-2147-40e2-8da4-c50785727cb5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:14.476306 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-65a5b775-2147-40e2-8da4-c50785727cb5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:14.495755 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-70336945-18e4-4722-ae27-d9c3732d9945 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:14.511742 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65a5b775-2147-40e2-8da4-c50785727cb5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:14.515232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65a5b775-2147-40e2-8da4-c50785727cb5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:14.519136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65a5b775-2147-40e2-8da4-c50785727cb5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:14.519855 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65a5b775-2147-40e2-8da4-c50785727cb5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:14.529333 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-70336945-18e4-4722-ae27-d9c3732d9945 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1477 microversion: 2.1 time: 0.987538 Jul 12 11:55:14.530199 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 737/1554] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:13 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1477 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:14.543731 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-38b75033-579c-472e-9c55-7425f97094e5 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Calling method '.version_select at 0x7f5e0a740e50>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:14.963543 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-65a5b775-2147-40e2-8da4-c50785727cb5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:14.975672 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-65a5b775-2147-40e2-8da4-c50785727cb5 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1334 microversion: 2.1 time: 0.522407 Jul 12 11:55:14.977677 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 818/1555] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:14 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1334 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:14.987200 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-17ed5745-dc08-4170-b48b-923e9a757339 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:14.988311 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-17ed5745-dc08-4170-b48b-923e9a757339 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:14.996521 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17ed5745-dc08-4170-b48b-923e9a757339 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:14.997151 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17ed5745-dc08-4170-b48b-923e9a757339 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:14.998093 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17ed5745-dc08-4170-b48b-923e9a757339 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:14.998696 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17ed5745-dc08-4170-b48b-923e9a757339 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:15.123694 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-38b75033-579c-472e-9c55-7425f97094e5 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/c650767c-cb89-475d-bd02-a46764c1bb0f" status: 200 len: 247 microversion: 2.1 time: 0.588799 Jul 12 11:55:15.124700 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 738/1556] 10.222.0.50 () {58 vars in 1268 bytes} [Tue Jul 12 11:55:14 2022] GET /compute/v2.1/os-security-groups/c650767c-cb89-475d-bd02-a46764c1bb0f => generated 247 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:15.137769 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-0b68f557-1dbf-48bd-a7f7-03a163dca3b8 req-ae6c6602-008e-45c5-a4a2-006be19500b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a41bff-2e83-4c3d-abda-10a811857771", "tag": "158941a6-d5e0-4179-8cb6-b66ad6b9c6bf"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:15.160506 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-0b68f557-1dbf-48bd-a7f7-03a163dca3b8 req-ae6c6602-008e-45c5-a4a2-006be19500b5 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:15.160958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-0b68f557-1dbf-48bd-a7f7-03a163dca3b8 req-ae6c6602-008e-45c5-a4a2-006be19500b5 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:15.213516 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-0b68f557-1dbf-48bd-a7f7-03a163dca3b8 req-ae6c6602-008e-45c5-a4a2-006be19500b5 service nova] Creating event network-changed:158941a6-d5e0-4179-8cb6-b66ad6b9c6bf for instance 06a41bff-2e83-4c3d-abda-10a811857771 on n-h2-849104-4 Jul 12 11:55:15.230331 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-0b68f557-1dbf-48bd-a7f7-03a163dca3b8 req-ae6c6602-008e-45c5-a4a2-006be19500b5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102543 Jul 12 11:55:15.231214 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 739/1557] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:15.236851 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2fd1bf32-bc03-4711-8427-6c824fc02c2e tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Action: 'create', calling method: .version_select at 0x7f5e0a7404c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1465697831", "description": "tempest-description-982146956"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:15.400130 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-17ed5745-dc08-4170-b48b-923e9a757339 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:15.410079 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-17ed5745-dc08-4170-b48b-923e9a757339 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1492 microversion: 2.1 time: 0.430828 Jul 12 11:55:15.410702 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 819/1558] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:14 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1492 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:15.458993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-493dfaa8-1ecc-49f4-ba75-9127abe136b7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:15.459937 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-493dfaa8-1ecc-49f4-ba75-9127abe136b7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:15.476991 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-493dfaa8-1ecc-49f4-ba75-9127abe136b7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:15.477449 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-493dfaa8-1ecc-49f4-ba75-9127abe136b7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:15.478240 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-493dfaa8-1ecc-49f4-ba75-9127abe136b7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:15.478681 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-493dfaa8-1ecc-49f4-ba75-9127abe136b7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:15.576915 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-493dfaa8-1ecc-49f4-ba75-9127abe136b7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117532 Jul 12 11:55:15.580108 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 820/1559] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:55:15 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:15.582765 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f51a5398-9da7-47aa-8791-45b4fb1c5237 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:15.583662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f51a5398-9da7-47aa-8791-45b4fb1c5237 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:15.613743 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f51a5398-9da7-47aa-8791-45b4fb1c5237 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:15.614157 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f51a5398-9da7-47aa-8791-45b4fb1c5237 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:15.614952 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f51a5398-9da7-47aa-8791-45b4fb1c5237 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:15.615979 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f51a5398-9da7-47aa-8791-45b4fb1c5237 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:15.924917 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f51a5398-9da7-47aa-8791-45b4fb1c5237 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:15.937365 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f51a5398-9da7-47aa-8791-45b4fb1c5237 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1476 microversion: 2.1 time: 0.357511 Jul 12 11:55:15.937905 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 821/1560] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:15 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1476 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:16.144869 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-047b8765-4495-4146-b022-df3cd2f77500 tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Action: 'create', calling method: .version_select at 0x7f5e09ae2550>, body: {"keypair": {"name": "tempest-keypair-2011652710", "type": "ssh", "user_id": "e0d088b39ef64a60882bdc6fd48a4d0e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWztuhU/PsH5CV5B8ttW1/d0ex3cL1Z9MG1SGYeOrGO3NH0yRuOLl0J2WE1noG4xgO0K1BianK+rEThyuTORCCw6VUQTqkXwDq42sWEAK9I/O7g/ehfGrqHUDLqj2/YIw=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:16.193213 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-047b8765-4495-4146-b022-df3cd2f77500 tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Getting quotas for project 14ea5cad88ac4e84b954a1138c013d3c. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:55:16.207137 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-047b8765-4495-4146-b022-df3cd2f77500 tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Getting quotas for user 6461824790684abfbb10c381cfbb504b and project 14ea5cad88ac4e84b954a1138c013d3c. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:55:16.259140 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-047b8765-4495-4146-b022-df3cd2f77500 tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.319985 Jul 12 11:55:16.268131 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 822/1561] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Jul 12 11:55:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 329 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 11:55:16.275365 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f340b2f7-5b26-462a-8222-38a8867be4c0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:16.276448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f340b2f7-5b26-462a-8222-38a8867be4c0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:16.284330 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f340b2f7-5b26-462a-8222-38a8867be4c0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:16.285008 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f340b2f7-5b26-462a-8222-38a8867be4c0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:16.285968 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f340b2f7-5b26-462a-8222-38a8867be4c0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:16.286462 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f340b2f7-5b26-462a-8222-38a8867be4c0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:16.561159 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2fd1bf32-bc03-4711-8427-6c824fc02c2e tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.328054 Jul 12 11:55:16.562435 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 740/1562] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:55:15 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:16.571209 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0ea224b7-7756-4498-8682-c20c9c09d3fb tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Action: 'create', calling method: .version_select at 0x7f5e0a88f940>, body: {"keypair": {"name": "tempest-keypair-1358434331", "type": "ssh", "user_id": "e0d088b39ef64a60882bdc6fd48a4d0e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPF5j8XKbypXqeJFy0KIJMMXWfPKAHvrjhzt/g38hy1sANidhI3zRtfvgMMHQ5a4xXjklwc+9zDdXzelEeo7cFilieuJRLdqpczrvysewGMgv2cKFNQiycqGKVD/JwzkA=="}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:16.619354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-0ea224b7-7756-4498-8682-c20c9c09d3fb tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Getting quotas for project 14ea5cad88ac4e84b954a1138c013d3c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:55:16.632402 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-0ea224b7-7756-4498-8682-c20c9c09d3fb tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Getting quotas for user 6461824790684abfbb10c381cfbb504b and project 14ea5cad88ac4e84b954a1138c013d3c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:55:16.696131 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0ea224b7-7756-4498-8682-c20c9c09d3fb tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.132287 Jul 12 11:55:16.697390 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 741/1563] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Jul 12 11:55:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 11:55:16.712778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5f8baf41-4256-446a-8077-f980a6411a5f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:16.713971 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5f8baf41-4256-446a-8077-f980a6411a5f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:16.722453 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5f8baf41-4256-446a-8077-f980a6411a5f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:16.723650 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5f8baf41-4256-446a-8077-f980a6411a5f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:16.725375 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5f8baf41-4256-446a-8077-f980a6411a5f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:16.726058 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5f8baf41-4256-446a-8077-f980a6411a5f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:17.013774 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f340b2f7-5b26-462a-8222-38a8867be4c0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:17.023846 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f340b2f7-5b26-462a-8222-38a8867be4c0 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1334 microversion: 2.1 time: 0.754493 Jul 12 11:55:17.025182 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 823/1564] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:16 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1334 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:17.032213 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7a0849d0-025d-4bb6-a532-78d0ea2936d3 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Action: 'create', calling method: .version_select at 0x7f5e09b36040>, body: {"security_group_rule": {"parent_group_id": "c5508591-39fb-4ce3-a2e2-a9da851a4521", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:17.192638 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5f8baf41-4256-446a-8077-f980a6411a5f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:17.207513 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5f8baf41-4256-446a-8077-f980a6411a5f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 200 len: 1492 microversion: 2.1 time: 0.508848 Jul 12 11:55:17.208780 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 742/1565] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:16 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 1492 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:17.217034 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-746bdc61-cefa-42d2-8414-c9d029bc8402 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:17.218178 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-746bdc61-cefa-42d2-8414-c9d029bc8402 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:17.240976 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-746bdc61-cefa-42d2-8414-c9d029bc8402 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:17.241679 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-746bdc61-cefa-42d2-8414-c9d029bc8402 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:17.242966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-746bdc61-cefa-42d2-8414-c9d029bc8402 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:17.243612 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-746bdc61-cefa-42d2-8414-c9d029bc8402 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:17.307779 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-746bdc61-cefa-42d2-8414-c9d029bc8402 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097654 Jul 12 11:55:17.309392 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 743/1566] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:55:17 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:17.314425 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-62b32e7c-690c-4a30-93a2-4c5266ab9e7a tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Calling method '.version_select at 0x7f5e0b039dc0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:17.320451 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=8,nova_api:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:17.324239 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-62b32e7c-690c-4a30-93a2-4c5266ab9e7a tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-2011652710?user_id=e0d088b39ef64a60882bdc6fd48a4d0e" status: 200 len: 513 microversion: 2.10 time: 0.013262 Jul 12 11:55:17.326272 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 744/1567] 10.222.0.50 () {60 vars in 1339 bytes} [Tue Jul 12 11:55:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2011652710?user_id=e0d088b39ef64a60882bdc6fd48a4d0e => generated 513 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:55:17.332800 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-442156ac-e5a8-41e4-a76d-0edafa33515f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:17.334515 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-442156ac-e5a8-41e4-a76d-0edafa33515f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:17.342182 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-442156ac-e5a8-41e4-a76d-0edafa33515f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:17.343418 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-442156ac-e5a8-41e4-a76d-0edafa33515f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:17.344511 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-442156ac-e5a8-41e4-a76d-0edafa33515f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:17.345248 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-442156ac-e5a8-41e4-a76d-0edafa33515f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:17.876280 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7a0849d0-025d-4bb6-a532-78d0ea2936d3 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.848997 Jul 12 11:55:17.902577 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 824/1568] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Jul 12 11:55:17 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:17.934741 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-20bab129-42e0-4671-aa18-195b77ab4d9d tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Action: 'create', calling method: .version_select at 0x7f5e09ae2af0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-997959709", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDq+uMeUWEZ5ZR7VE/ACqMbkPy1U94dq7gZ0rH9XeKVUpFGqJ7O40M3hOl8nxIYeEa6lyXFzQ3JRsVUAAx+ivqAUXY/le/nH/yGvpBXt8PzGHQuu3pZVnKbBh60wkPIG8w=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:17.983400 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-20bab129-42e0-4671-aa18-195b77ab4d9d tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Getting quotas for project 14ea5cad88ac4e84b954a1138c013d3c. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:55:17.985975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:17.999381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-20bab129-42e0-4671-aa18-195b77ab4d9d tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Getting quotas for user 6461824790684abfbb10c381cfbb504b and project 14ea5cad88ac4e84b954a1138c013d3c. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:55:18.061571 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-20bab129-42e0-4671-aa18-195b77ab4d9d tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.157063 Jul 12 11:55:18.062663 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 825/1569] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Jul 12 11:55:17 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 11:55:18.070849 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-028b1f53-ca9a-44a9-9c93-e2ca4c327292 req-26b1e30d-cf60-4f3f-8281-b231b3ade69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bfc910-f0c8-4290-a296-881b4381b84e", "name": "network-vif-unplugged", "status": "completed", "tag": "9888919a-4e04-47ae-b8f2-1a4693dcc22a"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:18.080775 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-028b1f53-ca9a-44a9-9c93-e2ca4c327292 req-26b1e30d-cf60-4f3f-8281-b231b3ade69c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:18.082128 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-028b1f53-ca9a-44a9-9c93-e2ca4c327292 req-26b1e30d-cf60-4f3f-8281-b231b3ade69c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:18.095770 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-028b1f53-ca9a-44a9-9c93-e2ca4c327292 req-26b1e30d-cf60-4f3f-8281-b231b3ade69c service nova] Creating event network-vif-unplugged:9888919a-4e04-47ae-b8f2-1a4693dcc22a for instance 69bfc910-f0c8-4290-a296-881b4381b84e on n-h1-849104-4 Jul 12 11:55:18.115035 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [req-028b1f53-ca9a-44a9-9c93-e2ca4c327292 req-26b1e30d-cf60-4f3f-8281-b231b3ade69c service nova] Instance 69bfc910-f0c8-4290-a296-881b4381b84e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849104-4', 'n-h1-849104-4'} {{(pid=125984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 12 11:55:18.135115 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-028b1f53-ca9a-44a9-9c93-e2ca4c327292 req-26b1e30d-cf60-4f3f-8281-b231b3ade69c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070895 Jul 12 11:55:18.142398 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 826/1570] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:18.149282 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-078b1a70-232f-40a1-b78d-1258d5612793 req-eb68da04-72ea-4cea-ba3a-2658cdb3386f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407593f6-2750-41da-94d7-2f786fa41200", "name": "network-vif-deleted", "tag": "9695ca6b-f189-420a-8717-b24b42bc1233"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:18.186128 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-078b1a70-232f-40a1-b78d-1258d5612793 req-eb68da04-72ea-4cea-ba3a-2658cdb3386f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:18.189309 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-078b1a70-232f-40a1-b78d-1258d5612793 req-eb68da04-72ea-4cea-ba3a-2658cdb3386f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:18.201807 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-078b1a70-232f-40a1-b78d-1258d5612793 req-eb68da04-72ea-4cea-ba3a-2658cdb3386f service nova] Creating event network-vif-deleted:9695ca6b-f189-420a-8717-b24b42bc1233 for instance 407593f6-2750-41da-94d7-2f786fa41200 on n-h1-849104-4 Jul 12 11:55:18.207840 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-078b1a70-232f-40a1-b78d-1258d5612793 req-eb68da04-72ea-4cea-ba3a-2658cdb3386f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063887 Jul 12 11:55:18.214151 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 827/1571] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:18.221165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a36512f1-2e3d-4826-b5fd-105c31f2fa8b tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Action: 'create', calling method: .version_select at 0x7f5e09b36160>, body: {"security_group_rule": {"parent_group_id": "c5508591-39fb-4ce3-a2e2-a9da851a4521", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:18.344049 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-442156ac-e5a8-41e4-a76d-0edafa33515f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:18.363344 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-442156ac-e5a8-41e4-a76d-0edafa33515f tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1476 microversion: 2.1 time: 1.035364 Jul 12 11:55:18.364481 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 745/1572] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:17 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1476 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:18.369814 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6e11cf97-82fa-4624-83ae-c15163f0a008 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:18.370429 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6e11cf97-82fa-4624-83ae-c15163f0a008 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:18.384714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e11cf97-82fa-4624-83ae-c15163f0a008 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:18.392522 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e11cf97-82fa-4624-83ae-c15163f0a008 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:18.393564 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e11cf97-82fa-4624-83ae-c15163f0a008 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:18.394181 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6e11cf97-82fa-4624-83ae-c15163f0a008 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:18.669163 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a36512f1-2e3d-4826-b5fd-105c31f2fa8b tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.453468 Jul 12 11:55:18.677318 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 828/1573] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Jul 12 11:55:18 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:18.682187 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fcd26c40-ccda-4377-8248-bc7f9e722b0d tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Calling method '.version_select at 0x7f5e09a8df70>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:18.684918 n-d-849104-4 devstack@n-api.service[125984]: WARNING oslo_db.sqlalchemy.utils [None req-fcd26c40-ccda-4377-8248-bc7f9e722b0d tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 12 11:55:18.696288 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fcd26c40-ccda-4377-8248-bc7f9e722b0d tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] 10.222.0.50 "GET /compute/v2.1/os-keypairs?user_id=e0d088b39ef64a60882bdc6fd48a4d0e" status: 200 len: 726 microversion: 2.10 time: 0.017691 Jul 12 11:55:18.712331 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 829/1574] 10.222.0.50 () {60 vars in 1258 bytes} [Tue Jul 12 11:55:18 2022] GET /compute/v2.1/os-keypairs?user_id=e0d088b39ef64a60882bdc6fd48a4d0e => generated 726 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:55:18.722403 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-58d7f4cc-c5f9-47e6-b05b-587b9da50e94 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:18.723160 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-58d7f4cc-c5f9-47e6-b05b-587b9da50e94 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:18.751078 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58d7f4cc-c5f9-47e6-b05b-587b9da50e94 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:18.754338 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58d7f4cc-c5f9-47e6-b05b-587b9da50e94 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:18.757729 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58d7f4cc-c5f9-47e6-b05b-587b9da50e94 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:18.758666 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58d7f4cc-c5f9-47e6-b05b-587b9da50e94 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:18.798304 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-58d7f4cc-c5f9-47e6-b05b-587b9da50e94 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-58d7f4cc-c5f9-47e6-b05b-587b9da50e94 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 HTTP/1.1 Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '407593f6-2750-41da-94d7-2f786fa41200'} Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:18.806551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:18.812133 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:18.812133 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:18.812133 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:18.812133 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:55:18.812133 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:55:18.812133 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:55:18.812133 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:18.812133 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-58d7f4cc-c5f9-47e6-b05b-587b9da50e94 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:55:18.812785 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-58d7f4cc-c5f9-47e6-b05b-587b9da50e94 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 404 len: 111 microversion: 2.1 time: 0.098933 Jul 12 11:55:18.814650 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 830/1575] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:18 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:55:18.823425 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7f9bbbb3-8792-451c-b832-350ee0c1643c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:18.824392 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7f9bbbb3-8792-451c-b832-350ee0c1643c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:18.837347 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7f9bbbb3-8792-451c-b832-350ee0c1643c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:18.837814 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7f9bbbb3-8792-451c-b832-350ee0c1643c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:18.838612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7f9bbbb3-8792-451c-b832-350ee0c1643c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:18.839056 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7f9bbbb3-8792-451c-b832-350ee0c1643c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:18.874080 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:18.936501 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7f9bbbb3-8792-451c-b832-350ee0c1643c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114401 Jul 12 11:55:18.937555 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 831/1576] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:55:18 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:18.953743 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7750b025-5666-4977-b5a0-4f1d6daa1cc4 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Calling method '.version_select at 0x7f5e09a9e670>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:19.064060 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7750b025-5666-4977-b5a0-4f1d6daa1cc4 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/c5508591-39fb-4ce3-a2e2-a9da851a4521" status: 200 len: 664 microversion: 2.1 time: 0.124989 Jul 12 11:55:19.070953 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 832/1577] 10.222.0.50 () {58 vars in 1268 bytes} [Tue Jul 12 11:55:18 2022] GET /compute/v2.1/os-security-groups/c5508591-39fb-4ce3-a2e2-a9da851a4521 => generated 664 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:19.079489 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e3aa7b1b-e273-4db3-a15a-f03a29f9947c tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Calling method '.version_select at 0x7f5e09a9eca0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:19.099998 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e3aa7b1b-e273-4db3-a15a-f03a29f9947c tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-997959709" status: 204 len: 0 microversion: 2.10 time: 0.024515 Jul 12 11:55:19.100863 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 833/1578] 10.222.0.50 () {60 vars in 1321 bytes} [Tue Jul 12 11:55:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-997959709 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 11:55:19.106534 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-791ff513-47b6-422d-a799-7956ea60fdf8 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Calling method '.version_select at 0x7f5e09c2d550>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:19.342352 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-791ff513-47b6-422d-a799-7956ea60fdf8 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/ceb8d822-bef8-4abe-957a-c8a30af6f674" status: 202 len: 0 microversion: 2.1 time: 0.239994 Jul 12 11:55:19.343373 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 834/1579] 10.222.0.50 () {58 vars in 1286 bytes} [Tue Jul 12 11:55:19 2022] DELETE /compute/v2.1/os-security-group-rules/ceb8d822-bef8-4abe-957a-c8a30af6f674 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:55:19.355572 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-529644187", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "24a2b846-48a0-496a-b982-522753a2dd1f"}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:19.367062 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6e11cf97-82fa-4624-83ae-c15163f0a008 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:19.379582 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6e11cf97-82fa-4624-83ae-c15163f0a008 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1334 microversion: 2.1 time: 1.013662 Jul 12 11:55:19.380521 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 746/1580] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:18 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1334 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:19.387056 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cc08a663-63a9-439f-9f75-3066fa192392 tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Calling method '.version_select at 0x7f5e0a740b80>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:19.446009 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cc08a663-63a9-439f-9f75-3066fa192392 tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358434331?user_id=e0d088b39ef64a60882bdc6fd48a4d0e" status: 204 len: 0 microversion: 2.10 time: 0.063639 Jul 12 11:55:19.449952 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 747/1581] 10.222.0.50 () {60 vars in 1342 bytes} [Tue Jul 12 11:55:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358434331?user_id=e0d088b39ef64a60882bdc6fd48a4d0e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 11:55:19.451503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] validate_networks() for [('24a2b846-48a0-496a-b982-522753a2dd1f', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:55:19.456555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5972caa7-1d66-4ef8-905b-133a3ff0fbe2 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Calling method '.version_select at 0x7f5e0acca280>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:20.149034 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:55:20.149587 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:55:20.149913 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:55:20.150817 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:55:20.151643 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:55:20.167616 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:20.168758 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:20.169848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:20.170468 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:20.194251 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Getting quotas for project 6acea80b1e154ffcb3e657056d6e8dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:55:20.203939 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Getting quotas for user 4c93078ac6044bf6b62ca073b3850016 and project 6acea80b1e154ffcb3e657056d6e8dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:55:20.220173 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:55:20.223795 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:55:20.303983 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ee164392-25e0-44a4-baaf-ba5bbb88064d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.958754 Jul 12 11:55:20.304889 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 835/1582] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:55:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:55:20.318988 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b9434889-1ff5-43f4-8e14-cec6f093c2ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:20.319862 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b9434889-1ff5-43f4-8e14-cec6f093c2ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:20.328257 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b9434889-1ff5-43f4-8e14-cec6f093c2ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:20.329360 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b9434889-1ff5-43f4-8e14-cec6f093c2ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:20.330393 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b9434889-1ff5-43f4-8e14-cec6f093c2ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:20.331887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b9434889-1ff5-43f4-8e14-cec6f093c2ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:20.620467 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b9434889-1ff5-43f4-8e14-cec6f093c2ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:20.633066 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b9434889-1ff5-43f4-8e14-cec6f093c2ba tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1476 microversion: 2.1 time: 0.320853 Jul 12 11:55:20.633469 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 836/1583] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:20 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1476 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:20.645844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-49e4811b-bf71-4664-a6d1-382464779da7 tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] Calling method '.version_select at 0x7f5e09c2d9d0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:20.694459 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-49e4811b-bf71-4664-a6d1-382464779da7 tempest-KeyPairsV210TestJSON-1351331598 tempest-KeyPairsV210TestJSON-1351331598-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011652710?user_id=e0d088b39ef64a60882bdc6fd48a4d0e" status: 204 len: 0 microversion: 2.10 time: 0.057690 Jul 12 11:55:20.699193 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 837/1584] 10.222.0.50 () {60 vars in 1342 bytes} [Tue Jul 12 11:55:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011652710?user_id=e0d088b39ef64a60882bdc6fd48a4d0e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 11:55:20.705161 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d1cb3083-9e7a-40fd-a8ef-7f0b9b03c9fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:20.708134 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d1cb3083-9e7a-40fd-a8ef-7f0b9b03c9fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:20.726895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d1cb3083-9e7a-40fd-a8ef-7f0b9b03c9fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:20.728669 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d1cb3083-9e7a-40fd-a8ef-7f0b9b03c9fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:20.729665 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d1cb3083-9e7a-40fd-a8ef-7f0b9b03c9fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:20.734114 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d1cb3083-9e7a-40fd-a8ef-7f0b9b03c9fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:20.801656 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d1cb3083-9e7a-40fd-a8ef-7f0b9b03c9fd tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105057 Jul 12 11:55:20.806717 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 838/1585] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:55:20 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:20.813829 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-091743c9-c62d-4239-ba67-c8f281cc8ca0 req-7ed8a607-2a0e-4934-ad05-6e4bb0001416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69bfc910-f0c8-4290-a296-881b4381b84e", "tag": "9888919a-4e04-47ae-b8f2-1a4693dcc22a"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:20.827083 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-091743c9-c62d-4239-ba67-c8f281cc8ca0 req-7ed8a607-2a0e-4934-ad05-6e4bb0001416 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:20.827751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-091743c9-c62d-4239-ba67-c8f281cc8ca0 req-7ed8a607-2a0e-4934-ad05-6e4bb0001416 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:20.846603 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-091743c9-c62d-4239-ba67-c8f281cc8ca0 req-7ed8a607-2a0e-4934-ad05-6e4bb0001416 service nova] Creating event network-changed:9888919a-4e04-47ae-b8f2-1a4693dcc22a for instance 69bfc910-f0c8-4290-a296-881b4381b84e on n-h1-849104-4 Jul 12 11:55:20.853557 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [req-091743c9-c62d-4239-ba67-c8f281cc8ca0 req-7ed8a607-2a0e-4934-ad05-6e4bb0001416 service nova] Instance 69bfc910-f0c8-4290-a296-881b4381b84e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849104-4', 'n-h1-849104-4'} {{(pid=125984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 12 11:55:20.869754 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-091743c9-c62d-4239-ba67-c8f281cc8ca0 req-7ed8a607-2a0e-4934-ad05-6e4bb0001416 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059317 Jul 12 11:55:20.871427 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 839/1586] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:20.877898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-52e0f2a5-caa4-47cb-9c2b-7f2bb9198016 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:20.878901 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-52e0f2a5-caa4-47cb-9c2b-7f2bb9198016 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:21.035013 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-52e0f2a5-caa4-47cb-9c2b-7f2bb9198016 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:21.049004 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-52e0f2a5-caa4-47cb-9c2b-7f2bb9198016 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1214 microversion: 2.1 time: 0.171461 Jul 12 11:55:21.051487 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 840/1587] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:20 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1214 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:21.067332 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-02663eea-cecd-422b-a931-635725a83cf1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:21.067997 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-02663eea-cecd-422b-a931-635725a83cf1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:21.086817 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-02663eea-cecd-422b-a931-635725a83cf1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:21.088176 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-02663eea-cecd-422b-a931-635725a83cf1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:21.090016 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-02663eea-cecd-422b-a931-635725a83cf1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:21.091370 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-02663eea-cecd-422b-a931-635725a83cf1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:21.286492 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5972caa7-1d66-4ef8-905b-133a3ff0fbe2 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c5508591-39fb-4ce3-a2e2-a9da851a4521" status: 202 len: 0 microversion: 2.1 time: 1.834120 Jul 12 11:55:21.287116 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 748/1588] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:55:19 2022] DELETE /compute/v2.1/os-security-groups/c5508591-39fb-4ce3-a2e2-a9da851a4521 => generated 0 bytes in 1836 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:55:21.295819 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-670d7cf4-9b33-4c50-89c9-a234f2af1ec5 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Calling method '.version_select at 0x7f5e0abf61f0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:21.413095 n-d-849104-4 devstack@n-api.service[125983]: DEBUG neutronclient.v2_0.client [None req-670d7cf4-9b33-4c50-89c9-a234f2af1ec5 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe2f27f8-458f-4ec5-bbc4-857405e69e5d does not exist", "detail": ""}} {{(pid=125983) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 12 11:55:21.413727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.security_group_api [None req-670d7cf4-9b33-4c50-89c9-a234f2af1ec5 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Neutron security group fe2f27f8-458f-4ec5-bbc4-857405e69e5d not found {{(pid=125983) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 12 11:55:21.415295 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-670d7cf4-9b33-4c50-89c9-a234f2af1ec5 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] HTTP exception thrown: Security group fe2f27f8-458f-4ec5-bbc4-857405e69e5d does not exist Jul 12 11:55:21.415295 n-d-849104-4 devstack@n-api.service[125983]: Neutron server returns request_ids: ['req-bed9a0df-aedd-48ee-b3f4-826f26aac081'] Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-670d7cf4-9b33-4c50-89c9-a234f2af1ec5 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Request method failure captured: Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/os-security-groups/fe2f27f8-458f-4ec5-bbc4-857405e69e5d HTTP/1.1 Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWEVeXnInfvOTUMXM4oYdUIIQDoqyi2Fg1kDi9zO-px4pkgQkmeDVx5uwqqGC8I6uolyv5GK5pzxlM4NG7meacyF1vUzfuOuiL_rMdLBK0DVuMgTUtVIw0tLNzuhMgj1FX4VQ67pIY6OjxLZwEJvYqC6HhT6Cm_6IlUiCMtBInkWhUg Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 156f4d9ef74c49d6920cf525c9b564ee Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-891433634 Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/156f4d9ef74c49d6920cf525c9b564ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/156f4d9ef74c49d6920cf525c9b564ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/156f4d9ef74c49d6920cf525c9b564ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_156f4d9ef74c49d6920cf525c9b564ee", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-SecurityGroupRulesTestJSON-891433634 Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 156f4d9ef74c49d6920cf525c9b564ee Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-891433634 Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-SecurityGroupRulesTestJSON-891433634-project Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: f92af15562c94ab8aae8e2e2a16037e3 Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-SecurityGroupRulesTestJSON-891433634-project Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: exception: Security group fe2f27f8-458f-4ec5-bbc4-857405e69e5d does not exist Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: Neutron server returns request_ids: ['req-bed9a0df-aedd-48ee-b3f4-826f26aac081'] Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'fe2f27f8-458f-4ec5-bbc4-857405e69e5d'} Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 12 11:55:21.417688 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe2f27f8-458f-4ec5-bbc4-857405e69e5d does not exist Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bed9a0df-aedd-48ee-b3f4-826f26aac081'] Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe2f27f8-458f-4ec5-bbc4-857405e69e5d does not exist Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bed9a0df-aedd-48ee-b3f4-826f26aac081'] Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe2f27f8-458f-4ec5-bbc4-857405e69e5d does not exist Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bed9a0df-aedd-48ee-b3f4-826f26aac081'] Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe2f27f8-458f-4ec5-bbc4-857405e69e5d does not exist Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bed9a0df-aedd-48ee-b3f4-826f26aac081'] Jul 12 11:55:21.422626 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:21.426191 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-670d7cf4-9b33-4c50-89c9-a234f2af1ec5 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Returning 404 to user: Security group fe2f27f8-458f-4ec5-bbc4-857405e69e5d does not exist Jul 12 11:55:21.426191 n-d-849104-4 devstack@n-api.service[125983]: Neutron server returns request_ids: ['req-bed9a0df-aedd-48ee-b3f4-826f26aac081'] {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:55:21.429208 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-670d7cf4-9b33-4c50-89c9-a234f2af1ec5 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/fe2f27f8-458f-4ec5-bbc4-857405e69e5d" status: 404 len: 194 microversion: 2.1 time: 0.137964 Jul 12 11:55:21.430299 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 749/1589] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:55:21 2022] DELETE /compute/v2.1/os-security-groups/fe2f27f8-458f-4ec5-bbc4-857405e69e5d => generated 194 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:55:21.438549 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1be17a3d-40eb-4c22-9a46-95128e27abb8 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Calling method '.version_select at 0x7f5e0a6e7040>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:21.803400 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-02663eea-cecd-422b-a931-635725a83cf1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:21.814044 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-02663eea-cecd-422b-a931-635725a83cf1 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1334 microversion: 2.1 time: 0.751046 Jul 12 11:55:21.827163 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 841/1590] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:21 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1334 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:21.837893 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-31992aaa-e744-422d-ac4c-a8ed3bd405fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:21.838519 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-31992aaa-e744-422d-ac4c-a8ed3bd405fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:21.851877 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31992aaa-e744-422d-ac4c-a8ed3bd405fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:21.852739 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31992aaa-e744-422d-ac4c-a8ed3bd405fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:21.853693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31992aaa-e744-422d-ac4c-a8ed3bd405fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:21.854388 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31992aaa-e744-422d-ac4c-a8ed3bd405fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:22.064130 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-31992aaa-e744-422d-ac4c-a8ed3bd405fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:22.078805 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-31992aaa-e744-422d-ac4c-a8ed3bd405fc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1476 microversion: 2.1 time: 0.250270 Jul 12 11:55:22.085660 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 842/1591] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:21 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1476 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:22.095405 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fb1b9cda-a686-4df4-9593-ab3a8f30285b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:22.097648 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fb1b9cda-a686-4df4-9593-ab3a8f30285b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:22.110964 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb1b9cda-a686-4df4-9593-ab3a8f30285b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:22.111986 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb1b9cda-a686-4df4-9593-ab3a8f30285b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:22.115287 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb1b9cda-a686-4df4-9593-ab3a8f30285b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:22.116915 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb1b9cda-a686-4df4-9593-ab3a8f30285b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:22.180892 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fb1b9cda-a686-4df4-9593-ab3a8f30285b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093063 Jul 12 11:55:22.188500 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 843/1592] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 11:55:22 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 11:55:22.201455 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8d141bdf-79d8-49a9-b178-9e795e3a564c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:22.202061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8d141bdf-79d8-49a9-b178-9e795e3a564c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:22.215457 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8d141bdf-79d8-49a9-b178-9e795e3a564c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:22.215895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8d141bdf-79d8-49a9-b178-9e795e3a564c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:22.218935 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8d141bdf-79d8-49a9-b178-9e795e3a564c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:22.219753 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8d141bdf-79d8-49a9-b178-9e795e3a564c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:22.411181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8d141bdf-79d8-49a9-b178-9e795e3a564c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:22.421482 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8d141bdf-79d8-49a9-b178-9e795e3a564c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1284 microversion: 2.1 time: 0.228912 Jul 12 11:55:22.423361 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 844/1593] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:22 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1284 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:22.839283 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-14ae6de6-9aaa-4b26-ab07-a80d8f1c4ac3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:22.841369 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-14ae6de6-9aaa-4b26-ab07-a80d8f1c4ac3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:22.856930 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-14ae6de6-9aaa-4b26-ab07-a80d8f1c4ac3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:22.859518 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-14ae6de6-9aaa-4b26-ab07-a80d8f1c4ac3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:22.862214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-14ae6de6-9aaa-4b26-ab07-a80d8f1c4ac3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:22.863907 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-14ae6de6-9aaa-4b26-ab07-a80d8f1c4ac3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:22.943205 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1be17a3d-40eb-4c22-9a46-95128e27abb8 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c650767c-cb89-475d-bd02-a46764c1bb0f" status: 202 len: 0 microversion: 2.1 time: 1.508707 Jul 12 11:55:22.944100 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 750/1594] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:55:21 2022] DELETE /compute/v2.1/os-security-groups/c650767c-cb89-475d-bd02-a46764c1bb0f => generated 0 bytes in 1510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:55:22.954970 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-02df22d1-bf1e-410b-a27b-db7dc3698491 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Calling method '.version_select at 0x7f5e0abf6700>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:23.342287 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-14ae6de6-9aaa-4b26-ab07-a80d8f1c4ac3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:23.351903 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-14ae6de6-9aaa-4b26-ab07-a80d8f1c4ac3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1334 microversion: 2.1 time: 0.522840 Jul 12 11:55:23.361661 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 845/1595] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:22 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1334 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:23.381912 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-eb6fa792-f8e7-4c61-89b2-04de23ba9840 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:23.384260 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-eb6fa792-f8e7-4c61-89b2-04de23ba9840 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:23.415290 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eb6fa792-f8e7-4c61-89b2-04de23ba9840 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:23.420129 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eb6fa792-f8e7-4c61-89b2-04de23ba9840 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:23.421028 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eb6fa792-f8e7-4c61-89b2-04de23ba9840 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:23.421726 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eb6fa792-f8e7-4c61-89b2-04de23ba9840 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:23.729199 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-eb6fa792-f8e7-4c61-89b2-04de23ba9840 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:23.740637 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-eb6fa792-f8e7-4c61-89b2-04de23ba9840 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1474 microversion: 2.1 time: 0.380635 Jul 12 11:55:23.744236 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 846/1596] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:23 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1474 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:23.763597 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7d6a1bf5-0cd4-4408-bc71-35324216efcc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:23.764407 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7d6a1bf5-0cd4-4408-bc71-35324216efcc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:23.778539 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d6a1bf5-0cd4-4408-bc71-35324216efcc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:23.788180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d6a1bf5-0cd4-4408-bc71-35324216efcc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:23.789444 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d6a1bf5-0cd4-4408-bc71-35324216efcc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:23.790060 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d6a1bf5-0cd4-4408-bc71-35324216efcc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:24.188749 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7d6a1bf5-0cd4-4408-bc71-35324216efcc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:24.200890 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7d6a1bf5-0cd4-4408-bc71-35324216efcc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1314 microversion: 2.1 time: 0.452927 Jul 12 11:55:24.204464 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 847/1597] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:23 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:24.296171 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-02df22d1-bf1e-410b-a27b-db7dc3698491 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/b35ffada-74bf-4bbc-a114-89bdc48d14f8" status: 202 len: 0 microversion: 2.1 time: 1.348017 Jul 12 11:55:24.297232 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 751/1598] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:55:22 2022] DELETE /compute/v2.1/os-security-groups/b35ffada-74bf-4bbc-a114-89bdc48d14f8 => generated 0 bytes in 1350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:55:24.307586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9505bd93-8668-47f0-b5d2-fb0dca0e8282 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Calling method '.version_select at 0x7f5e09b36af0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:24.371037 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ce5f5f17-9fcf-4029-a875-3a28c5232b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:24.371761 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ce5f5f17-9fcf-4029-a875-3a28c5232b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:24.385475 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce5f5f17-9fcf-4029-a875-3a28c5232b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:24.386255 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce5f5f17-9fcf-4029-a875-3a28c5232b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:24.387316 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce5f5f17-9fcf-4029-a875-3a28c5232b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:24.390482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce5f5f17-9fcf-4029-a875-3a28c5232b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:25.210814 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ce5f5f17-9fcf-4029-a875-3a28c5232b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:25.221660 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ce5f5f17-9fcf-4029-a875-3a28c5232b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1334 microversion: 2.1 time: 0.856438 Jul 12 11:55:25.223675 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 752/1599] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:24 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1334 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:25.232198 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-074df42f-bddf-4389-b59e-d8b53e822435 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:25.233190 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-074df42f-bddf-4389-b59e-d8b53e822435 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:25.274156 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-074df42f-bddf-4389-b59e-d8b53e822435 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:25.275508 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-074df42f-bddf-4389-b59e-d8b53e822435 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:25.278054 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-074df42f-bddf-4389-b59e-d8b53e822435 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:25.280316 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-074df42f-bddf-4389-b59e-d8b53e822435 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:25.931962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-074df42f-bddf-4389-b59e-d8b53e822435 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:25.947687 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-074df42f-bddf-4389-b59e-d8b53e822435 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1471 microversion: 2.1 time: 0.720955 Jul 12 11:55:25.961963 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 753/1600] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:25 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1471 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:25.968667 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6583be52-d398-4941-8d85-53c096d8d77f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:25.969600 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6583be52-d398-4941-8d85-53c096d8d77f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:25.982108 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6583be52-d398-4941-8d85-53c096d8d77f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:25.982931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6583be52-d398-4941-8d85-53c096d8d77f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:25.984306 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6583be52-d398-4941-8d85-53c096d8d77f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:25.984977 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6583be52-d398-4941-8d85-53c096d8d77f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:26.035928 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9505bd93-8668-47f0-b5d2-fb0dca0e8282 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/5a2db953-9ec9-4a6a-a092-26ccda22e85e" status: 202 len: 0 microversion: 2.1 time: 1.733999 Jul 12 11:55:26.038143 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 848/1601] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:55:24 2022] DELETE /compute/v2.1/os-security-groups/5a2db953-9ec9-4a6a-a092-26ccda22e85e => generated 0 bytes in 1737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:55:26.045770 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-3baf1167-7f6f-46e8-9e99-d6de876931bc req-3bf49c6f-f25b-4a9a-a8a6-2002fbab68bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a41bff-2e83-4c3d-abda-10a811857771", "name": "network-vif-plugged", "status": "completed", "tag": "158941a6-d5e0-4179-8cb6-b66ad6b9c6bf"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:26.079131 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-3baf1167-7f6f-46e8-9e99-d6de876931bc req-3bf49c6f-f25b-4a9a-a8a6-2002fbab68bf service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:26.079557 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-3baf1167-7f6f-46e8-9e99-d6de876931bc req-3bf49c6f-f25b-4a9a-a8a6-2002fbab68bf service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:26.142300 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-3baf1167-7f6f-46e8-9e99-d6de876931bc req-3bf49c6f-f25b-4a9a-a8a6-2002fbab68bf service nova] Creating event network-vif-plugged:158941a6-d5e0-4179-8cb6-b66ad6b9c6bf for instance 06a41bff-2e83-4c3d-abda-10a811857771 on n-h2-849104-4 Jul 12 11:55:26.161085 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-3baf1167-7f6f-46e8-9e99-d6de876931bc req-3bf49c6f-f25b-4a9a-a8a6-2002fbab68bf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119499 Jul 12 11:55:26.162570 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 849/1602] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:26.179659 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6cc70a13-12c5-4369-b12d-1c6de24757df tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:26.184903 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6cc70a13-12c5-4369-b12d-1c6de24757df tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:26.198080 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6cc70a13-12c5-4369-b12d-1c6de24757df tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:26.198954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6cc70a13-12c5-4369-b12d-1c6de24757df tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:26.202827 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6cc70a13-12c5-4369-b12d-1c6de24757df tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:26.206828 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6cc70a13-12c5-4369-b12d-1c6de24757df tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:26.488015 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6cc70a13-12c5-4369-b12d-1c6de24757df tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "POST /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e/action" status: 202 len: 0 microversion: 2.1 time: 0.323719 Jul 12 11:55:26.498190 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 850/1603] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:55:26 2022] POST /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:55:26.524348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8b3535fd-446f-4c99-9a3b-6815f9ccc8af tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Calling method '.version_select at 0x7f5e09ca1c10>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:26.593833 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6583be52-d398-4941-8d85-53c096d8d77f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:26.607276 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6583be52-d398-4941-8d85-53c096d8d77f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1314 microversion: 2.1 time: 0.642527 Jul 12 11:55:26.609559 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 754/1604] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:25 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:26.625066 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-88928b6b-e259-478a-add6-7ec750fe5aaf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:26.630353 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-88928b6b-e259-478a-add6-7ec750fe5aaf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:26.649091 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-88928b6b-e259-478a-add6-7ec750fe5aaf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:26.651890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-88928b6b-e259-478a-add6-7ec750fe5aaf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:26.653003 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-88928b6b-e259-478a-add6-7ec750fe5aaf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:26.656343 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-88928b6b-e259-478a-add6-7ec750fe5aaf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:26.657052 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=4 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:27.736212 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-88928b6b-e259-478a-add6-7ec750fe5aaf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:27.755487 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-88928b6b-e259-478a-add6-7ec750fe5aaf tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1334 microversion: 2.1 time: 1.142276 Jul 12 11:55:27.758564 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 755/1605] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:26 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1334 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:27.775299 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fdf8ff68-6d7b-45de-8f95-e88d49511520 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:27.778283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fdf8ff68-6d7b-45de-8f95-e88d49511520 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:27.780803 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8b3535fd-446f-4c99-9a3b-6815f9ccc8af tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/13af1009-9501-4ee1-b043-150e8da907a9" status: 202 len: 0 microversion: 2.1 time: 1.280045 Jul 12 11:55:27.783090 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 851/1606] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:55:26 2022] DELETE /compute/v2.1/os-security-groups/13af1009-9501-4ee1-b043-150e8da907a9 => generated 0 bytes in 1283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:55:27.789837 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b71b99b6-7a86-4150-9383-70d6a91910ee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:27.791665 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b71b99b6-7a86-4150-9383-70d6a91910ee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:27.801700 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fdf8ff68-6d7b-45de-8f95-e88d49511520 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:27.803533 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fdf8ff68-6d7b-45de-8f95-e88d49511520 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:27.808420 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fdf8ff68-6d7b-45de-8f95-e88d49511520 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:27.810940 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fdf8ff68-6d7b-45de-8f95-e88d49511520 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:27.812163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b71b99b6-7a86-4150-9383-70d6a91910ee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:27.816794 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b71b99b6-7a86-4150-9383-70d6a91910ee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:27.817632 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b71b99b6-7a86-4150-9383-70d6a91910ee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:27.822416 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b71b99b6-7a86-4150-9383-70d6a91910ee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:28.412227 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fdf8ff68-6d7b-45de-8f95-e88d49511520 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:28.433696 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fdf8ff68-6d7b-45de-8f95-e88d49511520 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1470 microversion: 2.1 time: 0.672424 Jul 12 11:55:28.434564 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 756/1607] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:27 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1470 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:28.451394 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8004d9aa-9a64-41e8-a3d7-d06fd58863b3 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] Calling method '.version_select at 0x7f5e0a91c700>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:28.599756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b71b99b6-7a86-4150-9383-70d6a91910ee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:28.619400 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b71b99b6-7a86-4150-9383-70d6a91910ee tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1314 microversion: 2.1 time: 0.834948 Jul 12 11:55:28.620544 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 852/1608] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:27 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1314 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:28.625609 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-d69fcda1-978d-4b3c-8661-7a53bd7d0b5e req-8acf5815-8e05-4c34-9b64-490ccbadfcc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a41bff-2e83-4c3d-abda-10a811857771", "name": "network-vif-plugged", "status": "completed", "tag": "69a137c8-1ef0-46cc-8217-9bb85907e487"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:28.646993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d69fcda1-978d-4b3c-8661-7a53bd7d0b5e req-8acf5815-8e05-4c34-9b64-490ccbadfcc7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:28.647472 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d69fcda1-978d-4b3c-8661-7a53bd7d0b5e req-8acf5815-8e05-4c34-9b64-490ccbadfcc7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:28.683080 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-d69fcda1-978d-4b3c-8661-7a53bd7d0b5e req-8acf5815-8e05-4c34-9b64-490ccbadfcc7 service nova] Creating event network-vif-plugged:69a137c8-1ef0-46cc-8217-9bb85907e487 for instance 06a41bff-2e83-4c3d-abda-10a811857771 on n-h2-849104-4 Jul 12 11:55:28.704247 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-d69fcda1-978d-4b3c-8661-7a53bd7d0b5e req-8acf5815-8e05-4c34-9b64-490ccbadfcc7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081799 Jul 12 11:55:28.705942 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 853/1609] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:28.715300 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-f3c15801-fc1d-4d3b-a987-ab8fca22f236 req-65e9574b-3af6-4994-9f19-8cc4bbc78f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e416e34a-0097-4379-aa3d-6193730a9304", "tag": "71279d83-e64a-4032-bd91-c8d30df42bf3"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:28.734830 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-f3c15801-fc1d-4d3b-a987-ab8fca22f236 req-65e9574b-3af6-4994-9f19-8cc4bbc78f60 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:28.749010 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-f3c15801-fc1d-4d3b-a987-ab8fca22f236 req-65e9574b-3af6-4994-9f19-8cc4bbc78f60 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:28.791416 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-f3c15801-fc1d-4d3b-a987-ab8fca22f236 req-65e9574b-3af6-4994-9f19-8cc4bbc78f60 service nova] Creating event network-changed:71279d83-e64a-4032-bd91-c8d30df42bf3 for instance e416e34a-0097-4379-aa3d-6193730a9304 on n-h1-849104-4 Jul 12 11:55:28.809618 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-f3c15801-fc1d-4d3b-a987-ab8fca22f236 req-65e9574b-3af6-4994-9f19-8cc4bbc78f60 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099743 Jul 12 11:55:28.819230 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 854/1610] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:28.829006 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-53d4ed5d-795a-4bd4-bdb8-2cbd75938eff tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:28.830871 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-53d4ed5d-795a-4bd4-bdb8-2cbd75938eff tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:28.848795 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53d4ed5d-795a-4bd4-bdb8-2cbd75938eff tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:28.849675 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53d4ed5d-795a-4bd4-bdb8-2cbd75938eff tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:28.850634 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53d4ed5d-795a-4bd4-bdb8-2cbd75938eff tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:28.852613 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53d4ed5d-795a-4bd4-bdb8-2cbd75938eff tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:29.374232 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8004d9aa-9a64-41e8-a3d7-d06fd58863b3 tempest-SecurityGroupRulesTestJSON-891433634 tempest-SecurityGroupRulesTestJSON-891433634-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/1e4f530f-7d84-4d85-8522-528df67155b5" status: 202 len: 0 microversion: 2.1 time: 0.936670 Jul 12 11:55:29.374833 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 757/1611] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:55:28 2022] DELETE /compute/v2.1/os-security-groups/1e4f530f-7d84-4d85-8522-528df67155b5 => generated 0 bytes in 940 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:55:29.455856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-541156c8-c7eb-4276-bfe8-96c4e7dc1d1d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:29.457360 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-541156c8-c7eb-4276-bfe8-96c4e7dc1d1d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:29.478674 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-541156c8-c7eb-4276-bfe8-96c4e7dc1d1d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:29.482229 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-541156c8-c7eb-4276-bfe8-96c4e7dc1d1d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:29.483086 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-541156c8-c7eb-4276-bfe8-96c4e7dc1d1d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:29.485536 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-541156c8-c7eb-4276-bfe8-96c4e7dc1d1d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:29.919374 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-541156c8-c7eb-4276-bfe8-96c4e7dc1d1d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:29.932046 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-541156c8-c7eb-4276-bfe8-96c4e7dc1d1d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1470 microversion: 2.1 time: 0.484236 Jul 12 11:55:29.932760 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 758/1612] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:29 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1470 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:29.971186 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cb1437df-bfaf-4344-aff1-0d4f932cc1e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:29.976545 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cb1437df-bfaf-4344-aff1-0d4f932cc1e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:30.003739 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb1437df-bfaf-4344-aff1-0d4f932cc1e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:30.004848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb1437df-bfaf-4344-aff1-0d4f932cc1e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:30.010685 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb1437df-bfaf-4344-aff1-0d4f932cc1e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:30.013576 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb1437df-bfaf-4344-aff1-0d4f932cc1e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:30.018903 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-53d4ed5d-795a-4bd4-bdb8-2cbd75938eff tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:30.029665 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-53d4ed5d-795a-4bd4-bdb8-2cbd75938eff tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1334 microversion: 2.1 time: 1.208542 Jul 12 11:55:30.040867 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 855/1613] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:28 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1334 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:30.914229 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-cb1437df-bfaf-4344-aff1-0d4f932cc1e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:30.925315 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cb1437df-bfaf-4344-aff1-0d4f932cc1e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1314 microversion: 2.1 time: 0.976836 Jul 12 11:55:30.931139 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 759/1614] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:29 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1314 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:30.941017 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-6895d145-f8f4-4088-bde2-521d2e2649b6 req-bb2c9e98-ad66-4574-a2de-1d33c1f2bd60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bfc910-f0c8-4290-a296-881b4381b84e", "name": "network-vif-plugged", "status": "completed", "tag": "9888919a-4e04-47ae-b8f2-1a4693dcc22a"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:30.951257 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:30.952311 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9b7bde16-d4cb-464d-9cf2-0fc64772752c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:30.952789 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9b7bde16-d4cb-464d-9cf2-0fc64772752c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:30.961367 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-6895d145-f8f4-4088-bde2-521d2e2649b6 req-bb2c9e98-ad66-4574-a2de-1d33c1f2bd60 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:30.961833 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-6895d145-f8f4-4088-bde2-521d2e2649b6 req-bb2c9e98-ad66-4574-a2de-1d33c1f2bd60 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:30.987311 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9b7bde16-d4cb-464d-9cf2-0fc64772752c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:30.987804 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9b7bde16-d4cb-464d-9cf2-0fc64772752c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:30.988657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9b7bde16-d4cb-464d-9cf2-0fc64772752c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:30.989105 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9b7bde16-d4cb-464d-9cf2-0fc64772752c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:30.997956 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:31.068887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=16 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:31.079560 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-6895d145-f8f4-4088-bde2-521d2e2649b6 req-bb2c9e98-ad66-4574-a2de-1d33c1f2bd60 service nova] Creating event network-vif-plugged:9888919a-4e04-47ae-b8f2-1a4693dcc22a for instance 69bfc910-f0c8-4290-a296-881b4381b84e on n-h1-849104-4 Jul 12 11:55:31.125626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [req-6895d145-f8f4-4088-bde2-521d2e2649b6 req-bb2c9e98-ad66-4574-a2de-1d33c1f2bd60 service nova] Instance 69bfc910-f0c8-4290-a296-881b4381b84e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849104-4', 'n-h1-849104-4'} {{(pid=125984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 12 11:55:31.171607 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-6895d145-f8f4-4088-bde2-521d2e2649b6 req-bb2c9e98-ad66-4574-a2de-1d33c1f2bd60 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250838 Jul 12 11:55:31.184969 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 856/1615] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:55:31.201346 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f7bcbb17-e28c-4919-9259-ce88ed3f4c9a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:31.208911 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f7bcbb17-e28c-4919-9259-ce88ed3f4c9a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:31.257917 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f7bcbb17-e28c-4919-9259-ce88ed3f4c9a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:31.258489 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f7bcbb17-e28c-4919-9259-ce88ed3f4c9a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:31.263057 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f7bcbb17-e28c-4919-9259-ce88ed3f4c9a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:31.264401 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f7bcbb17-e28c-4919-9259-ce88ed3f4c9a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:32.298827 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9b7bde16-d4cb-464d-9cf2-0fc64772752c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:32.320717 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9b7bde16-d4cb-464d-9cf2-0fc64772752c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1470 microversion: 2.1 time: 1.365601 Jul 12 11:55:32.322500 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 760/1616] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:30 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1470 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:32.342741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-432531f9-51a7-465b-9258-391eed7fe22b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:32.344700 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-432531f9-51a7-465b-9258-391eed7fe22b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:32.369594 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-432531f9-51a7-465b-9258-391eed7fe22b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:32.370078 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-432531f9-51a7-465b-9258-391eed7fe22b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:32.370858 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-432531f9-51a7-465b-9258-391eed7fe22b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:32.371309 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-432531f9-51a7-465b-9258-391eed7fe22b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:33.305508 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f7bcbb17-e28c-4919-9259-ce88ed3f4c9a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:33.325794 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f7bcbb17-e28c-4919-9259-ce88ed3f4c9a tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1669 microversion: 2.1 time: 2.139150 Jul 12 11:55:33.329486 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 857/1617] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:31 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1669 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:33.355201 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-43fa337d-aed7-414b-a8fa-8f1cd20ef4ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:33.365619 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-43fa337d-aed7-414b-a8fa-8f1cd20ef4ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:33.384149 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43fa337d-aed7-414b-a8fa-8f1cd20ef4ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:33.384828 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43fa337d-aed7-414b-a8fa-8f1cd20ef4ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:33.385789 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43fa337d-aed7-414b-a8fa-8f1cd20ef4ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:33.386422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43fa337d-aed7-414b-a8fa-8f1cd20ef4ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:33.422172 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-432531f9-51a7-465b-9258-391eed7fe22b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:33.434782 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-432531f9-51a7-465b-9258-391eed7fe22b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1314 microversion: 2.1 time: 1.108468 Jul 12 11:55:33.440652 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 761/1618] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:32 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1314 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:33.459259 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-dc8c483e-c41f-4e08-999d-bb4963c7e497 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:33.459765 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-dc8c483e-c41f-4e08-999d-bb4963c7e497 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:33.488553 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dc8c483e-c41f-4e08-999d-bb4963c7e497 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:33.490588 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dc8c483e-c41f-4e08-999d-bb4963c7e497 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:33.496452 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dc8c483e-c41f-4e08-999d-bb4963c7e497 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:33.499776 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dc8c483e-c41f-4e08-999d-bb4963c7e497 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:33.580123 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-dc8c483e-c41f-4e08-999d-bb4963c7e497 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771/ips" status: 200 len: 179 microversion: 2.1 time: 0.138030 Jul 12 11:55:33.589133 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 762/1619] 10.222.0.50 () {58 vars in 1247 bytes} [Tue Jul 12 11:55:33 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771/ips => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:33.629637 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a2fc6e74-2849-43a2-be90-eb23bc9af9e6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:33.637643 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a2fc6e74-2849-43a2-be90-eb23bc9af9e6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:33.714100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a2fc6e74-2849-43a2-be90-eb23bc9af9e6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:33.715306 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a2fc6e74-2849-43a2-be90-eb23bc9af9e6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:33.716618 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a2fc6e74-2849-43a2-be90-eb23bc9af9e6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:33.721562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a2fc6e74-2849-43a2-be90-eb23bc9af9e6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:33.827086 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a2fc6e74-2849-43a2-be90-eb23bc9af9e6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:55:33.895824 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:33.966425 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-43fa337d-aed7-414b-a8fa-8f1cd20ef4ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:33.986419 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-43fa337d-aed7-414b-a8fa-8f1cd20ef4ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1470 microversion: 2.1 time: 0.637492 Jul 12 11:55:33.996435 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 858/1620] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:33 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1470 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:34.023859 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a2fc6e74-2849-43a2-be90-eb23bc9af9e6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "DELETE /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 204 len: 0 microversion: 2.1 time: 0.430044 Jul 12 11:55:34.033671 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 763/1621] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:55:33 2022] DELETE /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 11:55:34.034997 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0056a465-d1ef-4ca7-b1f1-ca3a78b0b0f3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:34.035628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0056a465-d1ef-4ca7-b1f1-ca3a78b0b0f3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:34.061415 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0056a465-d1ef-4ca7-b1f1-ca3a78b0b0f3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:34.062931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0056a465-d1ef-4ca7-b1f1-ca3a78b0b0f3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:34.063771 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0056a465-d1ef-4ca7-b1f1-ca3a78b0b0f3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:34.070156 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0056a465-d1ef-4ca7-b1f1-ca3a78b0b0f3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:34.456005 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3c9e1cd4-c878-4812-aa81-343e4be3185b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:34.457516 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3c9e1cd4-c878-4812-aa81-343e4be3185b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:34.472201 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3c9e1cd4-c878-4812-aa81-343e4be3185b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:34.472892 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3c9e1cd4-c878-4812-aa81-343e4be3185b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:34.474414 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3c9e1cd4-c878-4812-aa81-343e4be3185b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:34.477886 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3c9e1cd4-c878-4812-aa81-343e4be3185b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:35.003569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0056a465-d1ef-4ca7-b1f1-ca3a78b0b0f3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:35.019973 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0056a465-d1ef-4ca7-b1f1-ca3a78b0b0f3 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1675 microversion: 2.1 time: 0.988395 Jul 12 11:55:35.021399 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 859/1622] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:34 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1675 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:55:35.037853 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-91e58b5d-8e63-4f45-81aa-8381e564e415 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:35.040600 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-91e58b5d-8e63-4f45-81aa-8381e564e415 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:35.058992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-91e58b5d-8e63-4f45-81aa-8381e564e415 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:35.060563 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-91e58b5d-8e63-4f45-81aa-8381e564e415 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:35.073721 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-91e58b5d-8e63-4f45-81aa-8381e564e415 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:35.074360 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-91e58b5d-8e63-4f45-81aa-8381e564e415 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:35.988468 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3c9e1cd4-c878-4812-aa81-343e4be3185b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:36.024061 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3c9e1cd4-c878-4812-aa81-343e4be3185b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1314 microversion: 2.1 time: 1.558350 Jul 12 11:55:36.025868 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 764/1623] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:34 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1314 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:36.047874 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4eb4a011-6808-45eb-9b94-fa48ee8df38d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:36.050226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4eb4a011-6808-45eb-9b94-fa48ee8df38d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:36.063985 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4eb4a011-6808-45eb-9b94-fa48ee8df38d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:36.066377 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4eb4a011-6808-45eb-9b94-fa48ee8df38d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:36.069443 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4eb4a011-6808-45eb-9b94-fa48ee8df38d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:36.070088 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4eb4a011-6808-45eb-9b94-fa48ee8df38d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:36.410971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-91e58b5d-8e63-4f45-81aa-8381e564e415 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:36.430782 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-91e58b5d-8e63-4f45-81aa-8381e564e415 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1470 microversion: 2.1 time: 1.404453 Jul 12 11:55:36.434328 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 860/1624] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:35 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1470 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:36.453938 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-586eae45-237b-4ecd-8857-5d02f297f18c req-11f6496d-8d1d-48e1-8a8a-8634cde9905b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bfc910-f0c8-4290-a296-881b4381b84e", "name": "network-vif-unplugged", "status": "completed", "tag": "9888919a-4e04-47ae-b8f2-1a4693dcc22a"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:36.479786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-586eae45-237b-4ecd-8857-5d02f297f18c req-11f6496d-8d1d-48e1-8a8a-8634cde9905b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:36.488463 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-586eae45-237b-4ecd-8857-5d02f297f18c req-11f6496d-8d1d-48e1-8a8a-8634cde9905b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:36.527914 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-586eae45-237b-4ecd-8857-5d02f297f18c req-11f6496d-8d1d-48e1-8a8a-8634cde9905b service nova] Creating event network-vif-unplugged:9888919a-4e04-47ae-b8f2-1a4693dcc22a for instance 69bfc910-f0c8-4290-a296-881b4381b84e on n-h2-849104-4 Jul 12 11:55:36.550143 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [req-586eae45-237b-4ecd-8857-5d02f297f18c req-11f6496d-8d1d-48e1-8a8a-8634cde9905b service nova] Instance 69bfc910-f0c8-4290-a296-881b4381b84e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849104-4', 'n-h1-849104-4'} {{(pid=125984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 12 11:55:36.578959 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-586eae45-237b-4ecd-8857-5d02f297f18c req-11f6496d-8d1d-48e1-8a8a-8634cde9905b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137674 Jul 12 11:55:36.592353 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 861/1625] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:37.043551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8c8084c3-1528-42fd-8631-b2f1a83e513d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:37.045291 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8c8084c3-1528-42fd-8631-b2f1a83e513d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:37.063298 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c8084c3-1528-42fd-8631-b2f1a83e513d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:37.072177 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c8084c3-1528-42fd-8631-b2f1a83e513d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:37.075550 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c8084c3-1528-42fd-8631-b2f1a83e513d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:37.078184 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c8084c3-1528-42fd-8631-b2f1a83e513d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:37.717340 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4eb4a011-6808-45eb-9b94-fa48ee8df38d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:37.730968 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4eb4a011-6808-45eb-9b94-fa48ee8df38d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1675 microversion: 2.1 time: 1.688599 Jul 12 11:55:37.733913 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 765/1626] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:36 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1675 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:37.748124 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e31a7a8f-1958-4f1f-8d87-7f4b4b13908c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:37.748676 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e31a7a8f-1958-4f1f-8d87-7f4b4b13908c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:37.790077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e31a7a8f-1958-4f1f-8d87-7f4b4b13908c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:37.790705 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e31a7a8f-1958-4f1f-8d87-7f4b4b13908c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:37.791740 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e31a7a8f-1958-4f1f-8d87-7f4b4b13908c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:37.792464 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e31a7a8f-1958-4f1f-8d87-7f4b4b13908c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:38.655136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8c8084c3-1528-42fd-8631-b2f1a83e513d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:38.670631 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8c8084c3-1528-42fd-8631-b2f1a83e513d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1314 microversion: 2.1 time: 1.632113 Jul 12 11:55:38.671256 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 862/1627] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:37 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1314 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:55:38.700620 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-6cf2bc5e-348f-4195-8daf-40ed89924981 req-17d72917-f77c-4181-abd5-4d3c7c007603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69bfc910-f0c8-4290-a296-881b4381b84e", "tag": "9888919a-4e04-47ae-b8f2-1a4693dcc22a"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:38.737237 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-6cf2bc5e-348f-4195-8daf-40ed89924981 req-17d72917-f77c-4181-abd5-4d3c7c007603 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:38.737691 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-6cf2bc5e-348f-4195-8daf-40ed89924981 req-17d72917-f77c-4181-abd5-4d3c7c007603 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:38.760982 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-6cf2bc5e-348f-4195-8daf-40ed89924981 req-17d72917-f77c-4181-abd5-4d3c7c007603 service nova] Creating event network-changed:9888919a-4e04-47ae-b8f2-1a4693dcc22a for instance 69bfc910-f0c8-4290-a296-881b4381b84e on n-h2-849104-4 Jul 12 11:55:38.770305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [req-6cf2bc5e-348f-4195-8daf-40ed89924981 req-17d72917-f77c-4181-abd5-4d3c7c007603 service nova] Instance 69bfc910-f0c8-4290-a296-881b4381b84e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849104-4', 'n-h1-849104-4'} {{(pid=125984) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 12 11:55:38.791831 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-6cf2bc5e-348f-4195-8daf-40ed89924981 req-17d72917-f77c-4181-abd5-4d3c7c007603 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109532 Jul 12 11:55:38.792751 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 863/1628] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:38.797857 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f94af2eb-97ae-4c47-aa16-04fafe4bb134 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:38.798762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f94af2eb-97ae-4c47-aa16-04fafe4bb134 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:38.832998 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f94af2eb-97ae-4c47-aa16-04fafe4bb134 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:38.834878 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f94af2eb-97ae-4c47-aa16-04fafe4bb134 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:38.835883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f94af2eb-97ae-4c47-aa16-04fafe4bb134 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:38.836520 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f94af2eb-97ae-4c47-aa16-04fafe4bb134 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:39.398696 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e31a7a8f-1958-4f1f-8d87-7f4b4b13908c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:39.418429 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e31a7a8f-1958-4f1f-8d87-7f4b4b13908c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1470 microversion: 2.1 time: 1.674056 Jul 12 11:55:39.442665 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 766/1629] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:37 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1470 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:39.691312 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-febeb223-7d19-41b1-8b1d-92a89016379b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:39.691939 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-febeb223-7d19-41b1-8b1d-92a89016379b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:39.719722 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-febeb223-7d19-41b1-8b1d-92a89016379b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:39.720638 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-febeb223-7d19-41b1-8b1d-92a89016379b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:39.722405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-febeb223-7d19-41b1-8b1d-92a89016379b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:39.725750 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-febeb223-7d19-41b1-8b1d-92a89016379b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:39.895208 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f94af2eb-97ae-4c47-aa16-04fafe4bb134 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:39.905771 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f94af2eb-97ae-4c47-aa16-04fafe4bb134 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1675 microversion: 2.1 time: 1.111625 Jul 12 11:55:39.925893 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 864/1630] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:38 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1675 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:40.437329 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-04e6c116-b9b5-454c-8b49-d7c2c898127c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:40.438282 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-04e6c116-b9b5-454c-8b49-d7c2c898127c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:40.441270 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:40.464328 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04e6c116-b9b5-454c-8b49-d7c2c898127c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:40.469445 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04e6c116-b9b5-454c-8b49-d7c2c898127c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:40.477957 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04e6c116-b9b5-454c-8b49-d7c2c898127c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:40.478680 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04e6c116-b9b5-454c-8b49-d7c2c898127c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:41.078492 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-04e6c116-b9b5-454c-8b49-d7c2c898127c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:41.100283 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-04e6c116-b9b5-454c-8b49-d7c2c898127c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1470 microversion: 2.1 time: 0.666714 Jul 12 11:55:41.101682 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 865/1631] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:40 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1470 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:55:41.113188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-bf9d1b22-ba5e-4a00-acd4-a36b325dafeb req-48364da8-9f75-4899-a418-34dcd8af2c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a41bff-2e83-4c3d-abda-10a811857771", "name": "network-vif-deleted", "tag": "69a137c8-1ef0-46cc-8217-9bb85907e487"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:41.138924 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-bf9d1b22-ba5e-4a00-acd4-a36b325dafeb req-48364da8-9f75-4899-a418-34dcd8af2c24 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:41.142880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-bf9d1b22-ba5e-4a00-acd4-a36b325dafeb req-48364da8-9f75-4899-a418-34dcd8af2c24 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:41.172757 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-bf9d1b22-ba5e-4a00-acd4-a36b325dafeb req-48364da8-9f75-4899-a418-34dcd8af2c24 service nova] Creating event network-vif-deleted:69a137c8-1ef0-46cc-8217-9bb85907e487 for instance 06a41bff-2e83-4c3d-abda-10a811857771 on n-h2-849104-4 Jul 12 11:55:41.185754 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-bf9d1b22-ba5e-4a00-acd4-a36b325dafeb req-48364da8-9f75-4899-a418-34dcd8af2c24 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082285 Jul 12 11:55:41.188115 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 866/1632] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:41.204983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-87c7c4d1-8867-4313-81d7-d1e7d46075f9 req-5e5c7f0c-9173-4689-a6b7-b78755d823c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a41bff-2e83-4c3d-abda-10a811857771", "name": "network-vif-unplugged", "status": "completed", "tag": "158941a6-d5e0-4179-8cb6-b66ad6b9c6bf"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:41.235685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-87c7c4d1-8867-4313-81d7-d1e7d46075f9 req-5e5c7f0c-9173-4689-a6b7-b78755d823c5 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:41.236909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-87c7c4d1-8867-4313-81d7-d1e7d46075f9 req-5e5c7f0c-9173-4689-a6b7-b78755d823c5 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:41.270982 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-87c7c4d1-8867-4313-81d7-d1e7d46075f9 req-5e5c7f0c-9173-4689-a6b7-b78755d823c5 service nova] Creating event network-vif-unplugged:158941a6-d5e0-4179-8cb6-b66ad6b9c6bf for instance 06a41bff-2e83-4c3d-abda-10a811857771 on n-h2-849104-4 Jul 12 11:55:41.286733 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-87c7c4d1-8867-4313-81d7-d1e7d46075f9 req-5e5c7f0c-9173-4689-a6b7-b78755d823c5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092718 Jul 12 11:55:41.288203 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 867/1633] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:41.296049 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b43607b2-904a-47bf-9f6b-63b8c2447918 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:41.297322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b43607b2-904a-47bf-9f6b-63b8c2447918 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:41.315195 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b43607b2-904a-47bf-9f6b-63b8c2447918 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:41.315692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b43607b2-904a-47bf-9f6b-63b8c2447918 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:41.318280 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b43607b2-904a-47bf-9f6b-63b8c2447918 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:41.318948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b43607b2-904a-47bf-9f6b-63b8c2447918 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:41.472358 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-febeb223-7d19-41b1-8b1d-92a89016379b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:41.496609 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-febeb223-7d19-41b1-8b1d-92a89016379b tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1314 microversion: 2.1 time: 1.812428 Jul 12 11:55:41.498544 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 767/1634] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:39 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1314 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:42.006076 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b43607b2-904a-47bf-9f6b-63b8c2447918 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:42.027753 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b43607b2-904a-47bf-9f6b-63b8c2447918 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1496 microversion: 2.1 time: 0.734463 Jul 12 11:55:42.028685 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 868/1635] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:41 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1496 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:42.120646 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-58f7155b-bb67-47c7-a2b1-bc21560a56f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:42.121282 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-58f7155b-bb67-47c7-a2b1-bc21560a56f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:42.138142 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-58f7155b-bb67-47c7-a2b1-bc21560a56f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:42.138677 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-58f7155b-bb67-47c7-a2b1-bc21560a56f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:42.139951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-58f7155b-bb67-47c7-a2b1-bc21560a56f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:42.140663 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-58f7155b-bb67-47c7-a2b1-bc21560a56f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:42.516830 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5c52db4b-8fa8-4805-808c-3bc616860856 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:42.517669 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5c52db4b-8fa8-4805-808c-3bc616860856 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:42.532163 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-58f7155b-bb67-47c7-a2b1-bc21560a56f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:42.566829 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5c52db4b-8fa8-4805-808c-3bc616860856 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:42.569308 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-58f7155b-bb67-47c7-a2b1-bc21560a56f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1470 microversion: 2.1 time: 0.455478 Jul 12 11:55:42.570487 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5c52db4b-8fa8-4805-808c-3bc616860856 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:42.572222 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5c52db4b-8fa8-4805-808c-3bc616860856 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:42.573109 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 768/1636] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:42 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1470 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:42.573856 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5c52db4b-8fa8-4805-808c-3bc616860856 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:43.047210 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-93847bc0-7e56-4625-b91a-496090f6c6fe tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:43.047860 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-93847bc0-7e56-4625-b91a-496090f6c6fe tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:43.062628 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93847bc0-7e56-4625-b91a-496090f6c6fe tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:43.063363 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93847bc0-7e56-4625-b91a-496090f6c6fe tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:43.065286 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93847bc0-7e56-4625-b91a-496090f6c6fe tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:43.065990 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93847bc0-7e56-4625-b91a-496090f6c6fe tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:43.139525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5c52db4b-8fa8-4805-808c-3bc616860856 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:43.148092 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93847bc0-7e56-4625-b91a-496090f6c6fe tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:43.153283 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5c52db4b-8fa8-4805-808c-3bc616860856 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1314 microversion: 2.1 time: 0.639589 Jul 12 11:55:43.154594 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 869/1637] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:42 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:55:43.157134 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93847bc0-7e56-4625-b91a-496090f6c6fe tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:43.161612 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-93847bc0-7e56-4625-b91a-496090f6c6fe tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lazy-loading 'fault' on Instance uuid 06a41bff-2e83-4c3d-abda-10a811857771 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:55:43.301043 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-93847bc0-7e56-4625-b91a-496090f6c6fe tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91215d432f74692b5b8129dab66bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526c888ef874e22b5d9496db4568cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:43.304779 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-5945d7fb-a423-48f9-a340-58e505aa7426 req-d2131491-2d7a-4229-9ec3-fcc54912cb9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a41bff-2e83-4c3d-abda-10a811857771", "name": "network-vif-deleted", "tag": "158941a6-d5e0-4179-8cb6-b66ad6b9c6bf"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:43.316494 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-93847bc0-7e56-4625-b91a-496090f6c6fe tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 200 len: 1303 microversion: 2.1 time: 0.273736 Jul 12 11:55:43.320074 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 769/1638] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:43 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 1303 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:55:43.323043 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-5945d7fb-a423-48f9-a340-58e505aa7426 req-d2131491-2d7a-4229-9ec3-fcc54912cb9e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:43.328064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-5945d7fb-a423-48f9-a340-58e505aa7426 req-d2131491-2d7a-4229-9ec3-fcc54912cb9e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:43.362596 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-5945d7fb-a423-48f9-a340-58e505aa7426 req-d2131491-2d7a-4229-9ec3-fcc54912cb9e service nova] Creating event network-vif-deleted:158941a6-d5e0-4179-8cb6-b66ad6b9c6bf for instance 06a41bff-2e83-4c3d-abda-10a811857771 on n-h2-849104-4 Jul 12 11:55:43.372700 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-5945d7fb-a423-48f9-a340-58e505aa7426 req-d2131491-2d7a-4229-9ec3-fcc54912cb9e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080323 Jul 12 11:55:43.374075 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 870/1639] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:55:43.464810 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-4e14ec28-5b8e-474f-ae04-338894e18311 req-ab478e57-cb73-4fa8-a60f-5b5da945d85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e416e34a-0097-4379-aa3d-6193730a9304", "name": "network-vif-plugged", "status": "completed", "tag": "71279d83-e64a-4032-bd91-c8d30df42bf3"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:43.479805 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4e14ec28-5b8e-474f-ae04-338894e18311 req-ab478e57-cb73-4fa8-a60f-5b5da945d85b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:43.480440 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4e14ec28-5b8e-474f-ae04-338894e18311 req-ab478e57-cb73-4fa8-a60f-5b5da945d85b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:43.518555 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-4e14ec28-5b8e-474f-ae04-338894e18311 req-ab478e57-cb73-4fa8-a60f-5b5da945d85b service nova] Creating event network-vif-plugged:71279d83-e64a-4032-bd91-c8d30df42bf3 for instance e416e34a-0097-4379-aa3d-6193730a9304 on n-h1-849104-4 Jul 12 11:55:43.524884 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-4e14ec28-5b8e-474f-ae04-338894e18311 req-ab478e57-cb73-4fa8-a60f-5b5da945d85b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063810 Jul 12 11:55:43.526182 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 770/1640] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:43.591148 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-20957944-cf18-40aa-b352-9df320c521dd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:43.592688 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-20957944-cf18-40aa-b352-9df320c521dd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:43.617688 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20957944-cf18-40aa-b352-9df320c521dd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:43.618552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20957944-cf18-40aa-b352-9df320c521dd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:43.619590 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20957944-cf18-40aa-b352-9df320c521dd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:43.620302 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20957944-cf18-40aa-b352-9df320c521dd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:44.175564 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-03530d5a-4095-40c5-bcd0-bc1a3ecb43b4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:44.176500 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-03530d5a-4095-40c5-bcd0-bc1a3ecb43b4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:44.195148 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-03530d5a-4095-40c5-bcd0-bc1a3ecb43b4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:44.202177 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-03530d5a-4095-40c5-bcd0-bc1a3ecb43b4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:44.204283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-03530d5a-4095-40c5-bcd0-bc1a3ecb43b4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:44.205439 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-03530d5a-4095-40c5-bcd0-bc1a3ecb43b4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:44.530263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-20957944-cf18-40aa-b352-9df320c521dd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:44.540506 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-20957944-cf18-40aa-b352-9df320c521dd tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1470 microversion: 2.1 time: 0.954509 Jul 12 11:55:44.541115 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 871/1641] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:43 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1470 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:44.555541 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-03530d5a-4095-40c5-bcd0-bc1a3ecb43b4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:44.572180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c16288e1-1947-44e8-8df3-cc9ac8cf20cb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:44.575046 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-03530d5a-4095-40c5-bcd0-bc1a3ecb43b4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1314 microversion: 2.1 time: 0.406078 Jul 12 11:55:44.576736 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c16288e1-1947-44e8-8df3-cc9ac8cf20cb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:44.577626 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 771/1642] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:44 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:44.610061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c16288e1-1947-44e8-8df3-cc9ac8cf20cb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:44.612286 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c16288e1-1947-44e8-8df3-cc9ac8cf20cb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:44.623253 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c16288e1-1947-44e8-8df3-cc9ac8cf20cb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:44.624161 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c16288e1-1947-44e8-8df3-cc9ac8cf20cb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:44.663037 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-c16288e1-1947-44e8-8df3-cc9ac8cf20cb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] HTTP exception thrown: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c16288e1-1947-44e8-8df3-cc9ac8cf20cb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Request method failure captured: Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 HTTP/1.1 Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWDAYARO2nK9svWM9gyIbH2BdaBbPEWUCqtweHg34jDocVm8zkTbuQPdp83eUR_Am_M-Bs5YIkKgfSDuin_mMd_3r6sBjUWLNamG90Pl0nhqekMlO6HpEV7NFoJGUniBwny585LDZ3D0Bbw2d-kQGDhTOUyzuRyqpwSNc1Ze1_uMmww Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 8526c888ef874e22b5d9496db4568cfa Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8526c888ef874e22b5d9496db4568cfa", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 8526c888ef874e22b5d9496db4568cfa Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersTestMultiNic-1782502585-project Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: f91215d432f74692b5b8129dab66bc51 Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersTestMultiNic-1782502585-project Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '06a41bff-2e83-4c3d-abda-10a811857771'} Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:44.673135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:44.681209 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:44.681209 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:44.681209 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:44.681209 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:55:44.681209 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:55:44.681209 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:44.681209 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:44.688924 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c16288e1-1947-44e8-8df3-cc9ac8cf20cb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Returning 404 to user: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:55:44.689806 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c16288e1-1947-44e8-8df3-cc9ac8cf20cb tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 404 len: 111 microversion: 2.1 time: 0.137036 Jul 12 11:55:44.691058 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 872/1643] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:44 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:55:44.932903 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-623399098", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "f8b910a9-6171-418a-9231-00298dc40684"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:45.558208 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b7a183b0-c319-4a06-8810-fcb8804c96d5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:45.558752 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b7a183b0-c319-4a06-8810-fcb8804c96d5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:45.585092 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7a183b0-c319-4a06-8810-fcb8804c96d5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:45.586976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7a183b0-c319-4a06-8810-fcb8804c96d5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:45.588325 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7a183b0-c319-4a06-8810-fcb8804c96d5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:45.589547 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7a183b0-c319-4a06-8810-fcb8804c96d5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:46.258907 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b7a183b0-c319-4a06-8810-fcb8804c96d5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:46.266865 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b7a183b0-c319-4a06-8810-fcb8804c96d5 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1463 microversion: 2.1 time: 0.712527 Jul 12 11:55:46.276169 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 873/1644] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:45 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1463 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:55:46.281206 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b298bc1c-42e7-4a00-ac11-8fba39cf3180 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:46.282888 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b298bc1c-42e7-4a00-ac11-8fba39cf3180 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:46.300948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b298bc1c-42e7-4a00-ac11-8fba39cf3180 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:46.304994 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b298bc1c-42e7-4a00-ac11-8fba39cf3180 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:46.306079 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b298bc1c-42e7-4a00-ac11-8fba39cf3180 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:46.306694 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b298bc1c-42e7-4a00-ac11-8fba39cf3180 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:46.791210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b298bc1c-42e7-4a00-ac11-8fba39cf3180 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:46.804271 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b298bc1c-42e7-4a00-ac11-8fba39cf3180 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1501 microversion: 2.1 time: 0.522372 Jul 12 11:55:46.806135 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 874/1645] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:46 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1501 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:47.124138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-90cfcf5d-bc12-4759-8d4f-2abbfaeb25eb tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:47.124138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-90cfcf5d-bc12-4759-8d4f-2abbfaeb25eb tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:47.149312 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90cfcf5d-bc12-4759-8d4f-2abbfaeb25eb tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:47.150183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90cfcf5d-bc12-4759-8d4f-2abbfaeb25eb tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:47.154652 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90cfcf5d-bc12-4759-8d4f-2abbfaeb25eb tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:47.155292 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90cfcf5d-bc12-4759-8d4f-2abbfaeb25eb tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:47.587718 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-90cfcf5d-bc12-4759-8d4f-2abbfaeb25eb tempest-MigrationsAdminTest-376677138 tempest-MigrationsAdminTest-376677138-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1614 microversion: 2.1 time: 0.779273 Jul 12 11:55:47.595142 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 875/1646] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:46 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1614 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:47.637790 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-571cde23-4a68-48ec-ba5a-7f848a89ebec tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:47.638242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-571cde23-4a68-48ec-ba5a-7f848a89ebec tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:47.666424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-571cde23-4a68-48ec-ba5a-7f848a89ebec tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:47.666875 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-571cde23-4a68-48ec-ba5a-7f848a89ebec tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:47.667658 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-571cde23-4a68-48ec-ba5a-7f848a89ebec tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:47.680333 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-571cde23-4a68-48ec-ba5a-7f848a89ebec tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:47.808990 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:47.825878 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-571cde23-4a68-48ec-ba5a-7f848a89ebec tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lazy-loading 'flavor' on Instance uuid e416e34a-0097-4379-aa3d-6193730a9304 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:55:49.842408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] validate_networks() for [('f8b910a9-6171-418a-9231-00298dc40684', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:55:50.195270 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-571cde23-4a68-48ec-ba5a-7f848a89ebec tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "POST /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304/action" status: 202 len: 0 microversion: 2.1 time: 2.598095 Jul 12 11:55:50.200281 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 876/1647] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:55:47 2022] POST /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304/action => generated 0 bytes in 2604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:55:50.215907 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5edbaf98-495a-4519-a1a8-e5f97d1ed02c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:50.218340 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5edbaf98-495a-4519-a1a8-e5f97d1ed02c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:50.237774 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5edbaf98-495a-4519-a1a8-e5f97d1ed02c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:50.240752 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5edbaf98-495a-4519-a1a8-e5f97d1ed02c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:50.242934 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5edbaf98-495a-4519-a1a8-e5f97d1ed02c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:50.247037 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5edbaf98-495a-4519-a1a8-e5f97d1ed02c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:50.337221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5edbaf98-495a-4519-a1a8-e5f97d1ed02c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:55:50.497817 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5edbaf98-495a-4519-a1a8-e5f97d1ed02c tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "DELETE /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 204 len: 0 microversion: 2.1 time: 0.295381 Jul 12 11:55:50.499073 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 877/1648] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:55:50 2022] DELETE /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:55:50.520615 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-265a2b6b-0aef-48f9-bb8e-9de23b3f2277 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:50.522699 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-265a2b6b-0aef-48f9-bb8e-9de23b3f2277 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:50.538734 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-265a2b6b-0aef-48f9-bb8e-9de23b3f2277 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:50.539816 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-265a2b6b-0aef-48f9-bb8e-9de23b3f2277 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:50.540947 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-265a2b6b-0aef-48f9-bb8e-9de23b3f2277 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:50.541399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-265a2b6b-0aef-48f9-bb8e-9de23b3f2277 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:50.939015 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-265a2b6b-0aef-48f9-bb8e-9de23b3f2277 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:50.961123 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-265a2b6b-0aef-48f9-bb8e-9de23b3f2277 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1507 microversion: 2.1 time: 0.454702 Jul 12 11:55:50.962479 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 878/1649] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:50 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1507 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:50.977928 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a32ca350-7795-4bf0-ab7d-319b78781284 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:50.980074 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a32ca350-7795-4bf0-ab7d-319b78781284 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:51.005837 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a32ca350-7795-4bf0-ab7d-319b78781284 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:51.006729 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a32ca350-7795-4bf0-ab7d-319b78781284 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:51.008103 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a32ca350-7795-4bf0-ab7d-319b78781284 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:51.010462 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a32ca350-7795-4bf0-ab7d-319b78781284 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:51.887343 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a32ca350-7795-4bf0-ab7d-319b78781284 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:51.893939 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:55:51.894452 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:55:51.895535 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:55:51.895535 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:55:51.896070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:55:51.905623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:51.913917 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a32ca350-7795-4bf0-ab7d-319b78781284 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1469 microversion: 2.1 time: 0.949918 Jul 12 11:55:51.918320 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 879/1650] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:50 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1469 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:51.922863 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:51.923362 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:51.924487 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:51.925082 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:51.933377 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-5731351b-985c-43a9-89f7-acb50a0bf7e2 req-e62381fa-0802-4c99-a24b-eed7241d98be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bfc910-f0c8-4290-a296-881b4381b84e", "name": "network-vif-plugged", "status": "completed", "tag": "9888919a-4e04-47ae-b8f2-1a4693dcc22a"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:51.956418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-5731351b-985c-43a9-89f7-acb50a0bf7e2 req-e62381fa-0802-4c99-a24b-eed7241d98be service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:51.956879 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-5731351b-985c-43a9-89f7-acb50a0bf7e2 req-e62381fa-0802-4c99-a24b-eed7241d98be service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:52.000377 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Getting quotas for project d8030002dc7940b0a1bdf4f252fd5a8c. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:55:52.007272 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-5731351b-985c-43a9-89f7-acb50a0bf7e2 req-e62381fa-0802-4c99-a24b-eed7241d98be service nova] Creating event network-vif-plugged:9888919a-4e04-47ae-b8f2-1a4693dcc22a for instance 69bfc910-f0c8-4290-a296-881b4381b84e on n-h2-849104-4 Jul 12 11:55:52.018512 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-5731351b-985c-43a9-89f7-acb50a0bf7e2 req-e62381fa-0802-4c99-a24b-eed7241d98be service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095031 Jul 12 11:55:52.020678 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Getting quotas for user 0123721160c94b6785ed308618a2efc8 and project d8030002dc7940b0a1bdf4f252fd5a8c. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:55:52.022527 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 880/1651] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:52.038441 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-eb65c467-7681-45f7-b463-755e22f6ed3d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:52.041817 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-eb65c467-7681-45f7-b463-755e22f6ed3d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:52.054512 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:55:52.057531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:55:52.062164 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eb65c467-7681-45f7-b463-755e22f6ed3d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:52.062929 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eb65c467-7681-45f7-b463-755e22f6ed3d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:52.064880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eb65c467-7681-45f7-b463-755e22f6ed3d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:52.065336 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eb65c467-7681-45f7-b463-755e22f6ed3d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:52.113127 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-eb65c467-7681-45f7-b463-755e22f6ed3d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] HTTP exception thrown: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-eb65c467-7681-45f7-b463-755e22f6ed3d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Request method failure captured: Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 HTTP/1.1 Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWDAYARO2nK9svWM9gyIbH2BdaBbPEWUCqtweHg34jDocVm8zkTbuQPdp83eUR_Am_M-Bs5YIkKgfSDuin_mMd_3r6sBjUWLNamG90Pl0nhqekMlO6HpEV7NFoJGUniBwny585LDZ3D0Bbw2d-kQGDhTOUyzuRyqpwSNc1Ze1_uMmww Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 8526c888ef874e22b5d9496db4568cfa Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8526c888ef874e22b5d9496db4568cfa", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 8526c888ef874e22b5d9496db4568cfa Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersTestMultiNic-1782502585-project Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: f91215d432f74692b5b8129dab66bc51 Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersTestMultiNic-1782502585-project Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '06a41bff-2e83-4c3d-abda-10a811857771'} Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:55:52.118743 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:55:52.126598 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:52.126598 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.126598 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:52.126598 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.126598 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:52.126598 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:52.126598 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:52.126598 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:55:52.126598 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:55:52.126598 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:52.126598 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.126598 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-eb65c467-7681-45f7-b463-755e22f6ed3d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Returning 404 to user: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:55:52.126598 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-eb65c467-7681-45f7-b463-755e22f6ed3d tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "DELETE /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 404 len: 111 microversion: 2.1 time: 0.097743 Jul 12 11:55:52.126598 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 881/1652] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:55:52 2022] DELETE /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:55:52.141235 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c76df083-6a80-40e9-9fc4-d6a785f4c9de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:52.141235 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c76df083-6a80-40e9-9fc4-d6a785f4c9de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:52.145166 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ad7d6a91-15e3-4217-80fd-09cc67cdc0fc tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.520697 Jul 12 11:55:52.147558 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 772/1653] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:55:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 7525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:55:52.164487 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-07eebcf8-0787-4540-9b5a-09870e3f37d6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:52.166678 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-07eebcf8-0787-4540-9b5a-09870e3f37d6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: 06a41bff-2e83-4c3d-abda-10a811857771] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:52.181586 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-07eebcf8-0787-4540-9b5a-09870e3f37d6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:52.182141 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-07eebcf8-0787-4540-9b5a-09870e3f37d6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:52.183266 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-07eebcf8-0787-4540-9b5a-09870e3f37d6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:52.183520 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-07eebcf8-0787-4540-9b5a-09870e3f37d6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:52.202630 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-07eebcf8-0787-4540-9b5a-09870e3f37d6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] HTTP exception thrown: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-07eebcf8-0787-4540-9b5a-09870e3f37d6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Request method failure captured: Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 HTTP/1.1 Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWDAYARO2nK9svWM9gyIbH2BdaBbPEWUCqtweHg34jDocVm8zkTbuQPdp83eUR_Am_M-Bs5YIkKgfSDuin_mMd_3r6sBjUWLNamG90Pl0nhqekMlO6HpEV7NFoJGUniBwny585LDZ3D0Bbw2d-kQGDhTOUyzuRyqpwSNc1Ze1_uMmww Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 8526c888ef874e22b5d9496db4568cfa Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8526c888ef874e22b5d9496db4568cfa", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 8526c888ef874e22b5d9496db4568cfa Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServersTestMultiNic-1782502585-project Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: f91215d432f74692b5b8129dab66bc51 Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServersTestMultiNic-1782502585-project Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '06a41bff-2e83-4c3d-abda-10a811857771'} Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:52.204357 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.209090 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:52.209090 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:52.209090 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:52.209090 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:55:52.209090 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:55:52.209090 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. Jul 12 11:55:52.209090 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.209090 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-07eebcf8-0787-4540-9b5a-09870e3f37d6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Returning 404 to user: Instance 06a41bff-2e83-4c3d-abda-10a811857771 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:55:52.209090 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-07eebcf8-0787-4540-9b5a-09870e3f37d6 tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771" status: 404 len: 111 microversion: 2.1 time: 0.056029 Jul 12 11:55:52.213646 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c76df083-6a80-40e9-9fc4-d6a785f4c9de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:52.213646 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c76df083-6a80-40e9-9fc4-d6a785f4c9de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:52.213646 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c76df083-6a80-40e9-9fc4-d6a785f4c9de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:52.213646 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c76df083-6a80-40e9-9fc4-d6a785f4c9de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:52.214442 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 773/1654] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:52 2022] GET /compute/v2.1/servers/06a41bff-2e83-4c3d-abda-10a811857771 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:55:52.214442 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c7ba1a03-143c-4c40-a57e-3ed5fca820f0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:52.215145 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c7ba1a03-143c-4c40-a57e-3ed5fca820f0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:52.425440 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c7ba1a03-143c-4c40-a57e-3ed5fca820f0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:52.434086 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c7ba1a03-143c-4c40-a57e-3ed5fca820f0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1224 microversion: 2.1 time: 0.223328 Jul 12 11:55:52.451172 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 774/1655] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:52 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1224 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:52.464819 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-13230dbc-2772-40f5-9e1f-de049d6b84dc tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:52.465332 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-13230dbc-2772-40f5-9e1f-de049d6b84dc tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:52.486455 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-13230dbc-2772-40f5-9e1f-de049d6b84dc tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:52.486914 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-13230dbc-2772-40f5-9e1f-de049d6b84dc tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:52.490574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-13230dbc-2772-40f5-9e1f-de049d6b84dc tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:52.491035 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-13230dbc-2772-40f5-9e1f-de049d6b84dc tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:52.540358 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-13230dbc-2772-40f5-9e1f-de049d6b84dc tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] HTTP exception thrown: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-13230dbc-2772-40f5-9e1f-de049d6b84dc tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Request method failure captured: Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b HTTP/1.1 Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWDAYARO2nK9svWM9gyIbH2BdaBbPEWUCqtweHg34jDocVm8zkTbuQPdp83eUR_Am_M-Bs5YIkKgfSDuin_mMd_3r6sBjUWLNamG90Pl0nhqekMlO6HpEV7NFoJGUniBwny585LDZ3D0Bbw2d-kQGDhTOUyzuRyqpwSNc1Ze1_uMmww Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 8526c888ef874e22b5d9496db4568cfa Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8526c888ef874e22b5d9496db4568cfa", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 8526c888ef874e22b5d9496db4568cfa Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServersTestMultiNic-1782502585-project Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: f91215d432f74692b5b8129dab66bc51 Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServersTestMultiNic-1782502585-project Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'c8de68ee-82f3-4e97-ac78-5be719aa8c6b'} Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:55:52.542259 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:55:52.547178 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:55:52.547178 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.547178 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:52.547178 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.547178 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:52.547178 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:52.547178 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:52.547178 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:55:52.547178 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:55:52.547178 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:55:52.547178 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.554159 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-13230dbc-2772-40f5-9e1f-de049d6b84dc tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Returning 404 to user: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:55:52.555832 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-13230dbc-2772-40f5-9e1f-de049d6b84dc tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 404 len: 111 microversion: 2.1 time: 0.103533 Jul 12 11:55:52.556620 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 775/1656] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:55:52 2022] DELETE /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:55:52.566218 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-588df306-c0d6-43f9-ae30-4e48eae19b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:52.567105 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-588df306-c0d6-43f9-ae30-4e48eae19b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] [instance: c8de68ee-82f3-4e97-ac78-5be719aa8c6b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:52.576906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-588df306-c0d6-43f9-ae30-4e48eae19b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:52.577578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-588df306-c0d6-43f9-ae30-4e48eae19b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:52.578974 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-588df306-c0d6-43f9-ae30-4e48eae19b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:52.580390 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-588df306-c0d6-43f9-ae30-4e48eae19b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:52.611742 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-588df306-c0d6-43f9-ae30-4e48eae19b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] HTTP exception thrown: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-588df306-c0d6-43f9-ae30-4e48eae19b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Request method failure captured: Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b HTTP/1.1 Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWDAYARO2nK9svWM9gyIbH2BdaBbPEWUCqtweHg34jDocVm8zkTbuQPdp83eUR_Am_M-Bs5YIkKgfSDuin_mMd_3r6sBjUWLNamG90Pl0nhqekMlO6HpEV7NFoJGUniBwny585LDZ3D0Bbw2d-kQGDhTOUyzuRyqpwSNc1Ze1_uMmww Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 8526c888ef874e22b5d9496db4568cfa Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8526c888ef874e22b5d9496db4568cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8526c888ef874e22b5d9496db4568cfa", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 8526c888ef874e22b5d9496db4568cfa Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServersTestMultiNic-1782502585 Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServersTestMultiNic-1782502585-project Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: f91215d432f74692b5b8129dab66bc51 Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServersTestMultiNic-1782502585-project Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'c8de68ee-82f3-4e97-ac78-5be719aa8c6b'} Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:52.623701 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.629035 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:52.629035 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:52.629035 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:52.629035 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:55:52.629035 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:55:52.629035 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. Jul 12 11:55:52.629035 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:55:52.629035 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-588df306-c0d6-43f9-ae30-4e48eae19b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] Returning 404 to user: Instance c8de68ee-82f3-4e97-ac78-5be719aa8c6b could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:55:52.629035 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-588df306-c0d6-43f9-ae30-4e48eae19b8b tempest-ServersTestMultiNic-1782502585 tempest-ServersTestMultiNic-1782502585-project] 10.222.0.50 "GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b" status: 404 len: 111 microversion: 2.1 time: 0.067067 Jul 12 11:55:52.629035 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 776/1657] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:52 2022] GET /compute/v2.1/servers/c8de68ee-82f3-4e97-ac78-5be719aa8c6b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:55:52.936193 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-eb0a7c76-c541-41ad-a34b-cd277196c3eb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:52.937672 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-eb0a7c76-c541-41ad-a34b-cd277196c3eb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:52.958634 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb0a7c76-c541-41ad-a34b-cd277196c3eb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:52.959745 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb0a7c76-c541-41ad-a34b-cd277196c3eb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:52.961442 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb0a7c76-c541-41ad-a34b-cd277196c3eb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:52.963974 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb0a7c76-c541-41ad-a34b-cd277196c3eb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:53.436016 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c76df083-6a80-40e9-9fc4-d6a785f4c9de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:53.451638 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c76df083-6a80-40e9-9fc4-d6a785f4c9de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1507 microversion: 2.1 time: 1.324328 Jul 12 11:55:53.475790 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 882/1658] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:52 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1507 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:53.487127 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-be843623-d9fe-4ced-8a85-530b0cf28668 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:53.490885 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-be843623-d9fe-4ced-8a85-530b0cf28668 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:53.499530 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-be843623-d9fe-4ced-8a85-530b0cf28668 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:53.500275 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-be843623-d9fe-4ced-8a85-530b0cf28668 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:53.501714 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-be843623-d9fe-4ced-8a85-530b0cf28668 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:53.502698 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-be843623-d9fe-4ced-8a85-530b0cf28668 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:54.230518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eb0a7c76-c541-41ad-a34b-cd277196c3eb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:54.242674 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-eb0a7c76-c541-41ad-a34b-cd277196c3eb tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1469 microversion: 2.1 time: 1.311177 Jul 12 11:55:54.248457 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 777/1659] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:52 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1469 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:54.260475 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-be843623-d9fe-4ced-8a85-530b0cf28668 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:54.269745 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-be843623-d9fe-4ced-8a85-530b0cf28668 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1228 microversion: 2.1 time: 0.792574 Jul 12 11:55:54.292202 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 883/1660] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:53 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1228 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:54.483045 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-28861ba4-e89c-4fde-9f5d-61eeac953d28 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:54.484097 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-28861ba4-e89c-4fde-9f5d-61eeac953d28 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:54.525276 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-28861ba4-e89c-4fde-9f5d-61eeac953d28 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:54.528251 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-28861ba4-e89c-4fde-9f5d-61eeac953d28 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:54.529704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-28861ba4-e89c-4fde-9f5d-61eeac953d28 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:54.531789 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-28861ba4-e89c-4fde-9f5d-61eeac953d28 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:55.265866 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-23c6b56d-9945-4cd8-ad1b-46fe7bd91131 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:55.266465 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-23c6b56d-9945-4cd8-ad1b-46fe7bd91131 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:55.278349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-23c6b56d-9945-4cd8-ad1b-46fe7bd91131 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:55.281091 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-23c6b56d-9945-4cd8-ad1b-46fe7bd91131 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:55.281926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-23c6b56d-9945-4cd8-ad1b-46fe7bd91131 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:55.282371 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-23c6b56d-9945-4cd8-ad1b-46fe7bd91131 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:55.555971 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-28861ba4-e89c-4fde-9f5d-61eeac953d28 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:55.583036 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-28861ba4-e89c-4fde-9f5d-61eeac953d28 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1507 microversion: 2.1 time: 1.103523 Jul 12 11:55:55.590580 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 778/1661] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:54 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1507 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:55.615228 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2677ef6e-691f-40a8-a041-aa7f963647df tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:55.616200 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2677ef6e-691f-40a8-a041-aa7f963647df tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:55.642628 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2677ef6e-691f-40a8-a041-aa7f963647df tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:55.643070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2677ef6e-691f-40a8-a041-aa7f963647df tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:55.644002 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2677ef6e-691f-40a8-a041-aa7f963647df tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:55.644352 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2677ef6e-691f-40a8-a041-aa7f963647df tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:55.831859 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2677ef6e-691f-40a8-a041-aa7f963647df tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:55.859454 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2677ef6e-691f-40a8-a041-aa7f963647df tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1282 microversion: 2.1 time: 0.261949 Jul 12 11:55:55.860849 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 779/1662] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:55 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1282 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:56.485185 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-23c6b56d-9945-4cd8-ad1b-46fe7bd91131 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:56.503957 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-23c6b56d-9945-4cd8-ad1b-46fe7bd91131 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 200 len: 1469 microversion: 2.1 time: 1.241958 Jul 12 11:55:56.514952 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 884/1663] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:55 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 1469 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:56.607693 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8f319a56-96e3-46f9-a3a6-f8bbe1fb925d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:56.609090 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8f319a56-96e3-46f9-a3a6-f8bbe1fb925d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:56.624203 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8f319a56-96e3-46f9-a3a6-f8bbe1fb925d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:56.633566 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8f319a56-96e3-46f9-a3a6-f8bbe1fb925d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:56.634789 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8f319a56-96e3-46f9-a3a6-f8bbe1fb925d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:56.635430 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8f319a56-96e3-46f9-a3a6-f8bbe1fb925d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:56.711773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-8dc79d4a-bd7c-4314-b50a-04de445b8684 req-e12aa092-37fc-4fc0-8b05-47bcd8cb8574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bfc910-f0c8-4290-a296-881b4381b84e", "name": "network-vif-deleted", "tag": "9888919a-4e04-47ae-b8f2-1a4693dcc22a"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:55:56.752219 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-8dc79d4a-bd7c-4314-b50a-04de445b8684 req-e12aa092-37fc-4fc0-8b05-47bcd8cb8574 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:56.753575 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-8dc79d4a-bd7c-4314-b50a-04de445b8684 req-e12aa092-37fc-4fc0-8b05-47bcd8cb8574 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:56.792883 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-8dc79d4a-bd7c-4314-b50a-04de445b8684 req-e12aa092-37fc-4fc0-8b05-47bcd8cb8574 service nova] Creating event network-vif-deleted:9888919a-4e04-47ae-b8f2-1a4693dcc22a for instance 69bfc910-f0c8-4290-a296-881b4381b84e on n-h2-849104-4 Jul 12 11:55:56.805661 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-8dc79d4a-bd7c-4314-b50a-04de445b8684 req-e12aa092-37fc-4fc0-8b05-47bcd8cb8574 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098235 Jul 12 11:55:56.810509 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 885/1664] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:55:56.883371 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7ed7e4ae-fe8a-46f7-9ceb-11d24b73727e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:56.884448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7ed7e4ae-fe8a-46f7-9ceb-11d24b73727e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:56.906155 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ed7e4ae-fe8a-46f7-9ceb-11d24b73727e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:56.909569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ed7e4ae-fe8a-46f7-9ceb-11d24b73727e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:56.911152 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ed7e4ae-fe8a-46f7-9ceb-11d24b73727e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:56.912215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ed7e4ae-fe8a-46f7-9ceb-11d24b73727e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:57.206990 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7ed7e4ae-fe8a-46f7-9ceb-11d24b73727e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:57.222513 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7ed7e4ae-fe8a-46f7-9ceb-11d24b73727e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1282 microversion: 2.1 time: 0.343352 Jul 12 11:55:57.224484 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 886/1665] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:56 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1282 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:57.524194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b80efc54-9b81-48ce-87d9-a6d5099bf171 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:57.525872 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b80efc54-9b81-48ce-87d9-a6d5099bf171 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: 69bfc910-f0c8-4290-a296-881b4381b84e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:57.544546 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b80efc54-9b81-48ce-87d9-a6d5099bf171 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:57.545569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b80efc54-9b81-48ce-87d9-a6d5099bf171 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:57.549310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b80efc54-9b81-48ce-87d9-a6d5099bf171 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:57.550061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b80efc54-9b81-48ce-87d9-a6d5099bf171 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:57.580836 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-b80efc54-9b81-48ce-87d9-a6d5099bf171 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] HTTP exception thrown: Instance 69bfc910-f0c8-4290-a296-881b4381b84e could not be found. Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b80efc54-9b81-48ce-87d9-a6d5099bf171 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Request method failure captured: Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e HTTP/1.1 Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_LAnQ8j0cPZz1xBwr7wjdHU-dbIgv9RGwWE90rXduHNjvf0SEDc8ctsEAIhNwEZGy9xHYHzGAr5lvnzrwZOwxCgX0EmuaUjvXXJCBLXqYHaANV2j7HrofICjWWXZlkuc7JiIHye8dD3Oib7NPH4bzW6JmKkMk_tSn7GZKMtR1M7SU Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 4c6a6e22d13840698ada0866ea3f4913 Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-MigrationsAdminTest-1356239622 Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c6a6e22d13840698ada0866ea3f4913"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c6a6e22d13840698ada0866ea3f4913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c6a6e22d13840698ada0866ea3f4913"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c6a6e22d13840698ada0866ea3f4913", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-MigrationsAdminTest-1356239622 Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 4c6a6e22d13840698ada0866ea3f4913 Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-MigrationsAdminTest-1356239622 Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-MigrationsAdminTest-1356239622-project Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: d42140cf6bac4674ba0515ca28531222 Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-MigrationsAdminTest-1356239622-project Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 69bfc910-f0c8-4290-a296-881b4381b84e could not be found. Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '69bfc910-f0c8-4290-a296-881b4381b84e'} Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69bfc910-f0c8-4290-a296-881b4381b84e could not be found. Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69bfc910-f0c8-4290-a296-881b4381b84e could not be found. Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:55:57.583560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:57.588147 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:55:57.588147 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:55:57.588147 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:55:57.588147 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:55:57.588147 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:55:57.588147 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69bfc910-f0c8-4290-a296-881b4381b84e could not be found. Jul 12 11:55:57.588147 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:55:57.591277 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b80efc54-9b81-48ce-87d9-a6d5099bf171 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Returning 404 to user: Instance 69bfc910-f0c8-4290-a296-881b4381b84e could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:55:57.592461 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b80efc54-9b81-48ce-87d9-a6d5099bf171 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e" status: 404 len: 111 microversion: 2.1 time: 0.073602 Jul 12 11:55:57.597043 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 887/1666] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:57 2022] GET /compute/v2.1/servers/69bfc910-f0c8-4290-a296-881b4381b84e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 11:55:57.604904 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bc99fc28-3adb-4ca5-9894-0e6b73e270b6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:57.605681 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bc99fc28-3adb-4ca5-9894-0e6b73e270b6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:57.613750 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc99fc28-3adb-4ca5-9894-0e6b73e270b6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:57.614619 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc99fc28-3adb-4ca5-9894-0e6b73e270b6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:57.616130 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc99fc28-3adb-4ca5-9894-0e6b73e270b6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:57.617015 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc99fc28-3adb-4ca5-9894-0e6b73e270b6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:57.680105 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bc99fc28-3adb-4ca5-9894-0e6b73e270b6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:55:57.908464 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bc99fc28-3adb-4ca5-9894-0e6b73e270b6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 204 len: 0 microversion: 2.1 time: 0.306546 Jul 12 11:55:57.914321 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 888/1667] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:55:57 2022] DELETE /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:55:57.932119 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3824a7a1-75eb-473f-9d31-60c4210ecba6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:57.934154 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3824a7a1-75eb-473f-9d31-60c4210ecba6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:57.955649 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3824a7a1-75eb-473f-9d31-60c4210ecba6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:57.958412 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3824a7a1-75eb-473f-9d31-60c4210ecba6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:57.960408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8f319a56-96e3-46f9-a3a6-f8bbe1fb925d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:57.964105 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3824a7a1-75eb-473f-9d31-60c4210ecba6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:57.966204 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3824a7a1-75eb-473f-9d31-60c4210ecba6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:57.975605 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8f319a56-96e3-46f9-a3a6-f8bbe1fb925d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1507 microversion: 2.1 time: 1.369794 Jul 12 11:55:57.977897 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 780/1668] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:56 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1507 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:58.246544 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b44073a9-4585-4bc6-9195-4eb46c062ea5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:58.247233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b44073a9-4585-4bc6-9195-4eb46c062ea5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:58.258950 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b44073a9-4585-4bc6-9195-4eb46c062ea5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:58.259409 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b44073a9-4585-4bc6-9195-4eb46c062ea5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:58.266618 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b44073a9-4585-4bc6-9195-4eb46c062ea5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:58.267109 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b44073a9-4585-4bc6-9195-4eb46c062ea5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:58.595705 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3824a7a1-75eb-473f-9d31-60c4210ecba6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:58.608695 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3824a7a1-75eb-473f-9d31-60c4210ecba6 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1534 microversion: 2.1 time: 0.692844 Jul 12 11:55:58.611718 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 889/1669] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:57 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1534 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:58.997166 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b339aad6-99ab-4b41-a239-15fa094e600e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:58.998120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b339aad6-99ab-4b41-a239-15fa094e600e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:59.019119 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b339aad6-99ab-4b41-a239-15fa094e600e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:59.019611 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b339aad6-99ab-4b41-a239-15fa094e600e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:59.020451 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b339aad6-99ab-4b41-a239-15fa094e600e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:59.024694 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b339aad6-99ab-4b41-a239-15fa094e600e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:59.071424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:55:59.722396 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b44073a9-4585-4bc6-9195-4eb46c062ea5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:55:59.773182 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b44073a9-4585-4bc6-9195-4eb46c062ea5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1324 microversion: 2.1 time: 1.526234 Jul 12 11:55:59.776998 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 781/1670] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:58 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1324 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:55:59.798423 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-26615639-62a3-4878-8f39-0f3e5a21123d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:55:59.809775 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-26615639-62a3-4878-8f39-0f3e5a21123d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:55:59.834794 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26615639-62a3-4878-8f39-0f3e5a21123d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:59.839755 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26615639-62a3-4878-8f39-0f3e5a21123d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:55:59.841330 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26615639-62a3-4878-8f39-0f3e5a21123d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:55:59.844598 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26615639-62a3-4878-8f39-0f3e5a21123d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:00.081087 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b339aad6-99ab-4b41-a239-15fa094e600e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:00.097469 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b339aad6-99ab-4b41-a239-15fa094e600e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1507 microversion: 2.1 time: 1.102234 Jul 12 11:56:00.099074 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 890/1671] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:58 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1507 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:56:00.792202 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-020d8cc8-da8b-4f7d-afa5-29a0e8125369 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:00.793011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-020d8cc8-da8b-4f7d-afa5-29a0e8125369 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:00.809919 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-020d8cc8-da8b-4f7d-afa5-29a0e8125369 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:00.814227 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-020d8cc8-da8b-4f7d-afa5-29a0e8125369 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:00.815509 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-020d8cc8-da8b-4f7d-afa5-29a0e8125369 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:00.816262 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-020d8cc8-da8b-4f7d-afa5-29a0e8125369 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:01.241895 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-26615639-62a3-4878-8f39-0f3e5a21123d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:01.251299 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-26615639-62a3-4878-8f39-0f3e5a21123d tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1534 microversion: 2.1 time: 1.466840 Jul 12 11:56:01.258579 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 782/1672] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:55:59 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1534 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:01.266622 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d53adbe2-ce4d-451b-85ab-8a4b64741817 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:01.273325 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d53adbe2-ce4d-451b-85ab-8a4b64741817 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:01.282292 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d53adbe2-ce4d-451b-85ab-8a4b64741817 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:01.287527 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d53adbe2-ce4d-451b-85ab-8a4b64741817 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:01.289139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d53adbe2-ce4d-451b-85ab-8a4b64741817 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:01.300750 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d53adbe2-ce4d-451b-85ab-8a4b64741817 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:01.340803 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:01.685698 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-020d8cc8-da8b-4f7d-afa5-29a0e8125369 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:01.719286 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-020d8cc8-da8b-4f7d-afa5-29a0e8125369 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1324 microversion: 2.1 time: 0.930239 Jul 12 11:56:01.750162 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 891/1673] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:00 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1324 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:56:01.960343 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:02.029144 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d53adbe2-ce4d-451b-85ab-8a4b64741817 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:02.042241 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d53adbe2-ce4d-451b-85ab-8a4b64741817 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1507 microversion: 2.1 time: 0.782236 Jul 12 11:56:02.042876 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 783/1674] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:01 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1507 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:02.276177 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9ae38e16-9fac-45ca-b754-2f8394d836de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:02.277099 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9ae38e16-9fac-45ca-b754-2f8394d836de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:02.291411 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9ae38e16-9fac-45ca-b754-2f8394d836de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:02.298915 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9ae38e16-9fac-45ca-b754-2f8394d836de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:02.300454 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9ae38e16-9fac-45ca-b754-2f8394d836de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:02.305809 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9ae38e16-9fac-45ca-b754-2f8394d836de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:02.444088 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-b25042a7-56c7-4a33-8c02-6fba453cf144 req-71246b06-c4b4-4810-b9b0-fe6011a8c92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c311469b-29d4-4011-b455-8fe3ffd81d3c", "name": "network-vif-deleted", "tag": "4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:02.469965 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=8 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:02.527463 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-b25042a7-56c7-4a33-8c02-6fba453cf144 req-71246b06-c4b4-4810-b9b0-fe6011a8c92c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:02.527980 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-b25042a7-56c7-4a33-8c02-6fba453cf144 req-71246b06-c4b4-4810-b9b0-fe6011a8c92c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:02.629733 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-b25042a7-56c7-4a33-8c02-6fba453cf144 req-71246b06-c4b4-4810-b9b0-fe6011a8c92c service nova] Creating event network-vif-deleted:4f6e7792-0bf4-4bd0-83da-b90ed8ee5dec for instance c311469b-29d4-4011-b455-8fe3ffd81d3c on n-h2-849104-4 Jul 12 11:56:02.673086 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-b25042a7-56c7-4a33-8c02-6fba453cf144 req-71246b06-c4b4-4810-b9b0-fe6011a8c92c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220669 Jul 12 11:56:02.674484 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 784/1675] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:56:02.740468 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a89fd4c9-44ec-400e-8ee0-bb42c04fee09 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:02.742469 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a89fd4c9-44ec-400e-8ee0-bb42c04fee09 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:02.774117 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a89fd4c9-44ec-400e-8ee0-bb42c04fee09 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:02.774461 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a89fd4c9-44ec-400e-8ee0-bb42c04fee09 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:02.781542 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a89fd4c9-44ec-400e-8ee0-bb42c04fee09 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:02.781925 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a89fd4c9-44ec-400e-8ee0-bb42c04fee09 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:02.825607 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9ae38e16-9fac-45ca-b754-2f8394d836de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:02.838970 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9ae38e16-9fac-45ca-b754-2f8394d836de tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 200 len: 1492 microversion: 2.1 time: 0.566940 Jul 12 11:56:02.859293 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 892/1676] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:02 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 1492 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:03.060738 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8e52ace5-6d18-4d2e-adb0-7b14a3857501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:03.062075 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8e52ace5-6d18-4d2e-adb0-7b14a3857501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:03.078501 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8e52ace5-6d18-4d2e-adb0-7b14a3857501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:03.079294 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8e52ace5-6d18-4d2e-adb0-7b14a3857501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:03.080344 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8e52ace5-6d18-4d2e-adb0-7b14a3857501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:03.081072 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8e52ace5-6d18-4d2e-adb0-7b14a3857501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:03.625638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8e52ace5-6d18-4d2e-adb0-7b14a3857501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:03.649344 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8e52ace5-6d18-4d2e-adb0-7b14a3857501 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1507 microversion: 2.1 time: 0.578369 Jul 12 11:56:03.652892 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 893/1677] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:03 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1507 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:56:03.830373 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a89fd4c9-44ec-400e-8ee0-bb42c04fee09 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:03.850724 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a89fd4c9-44ec-400e-8ee0-bb42c04fee09 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1324 microversion: 2.1 time: 1.106296 Jul 12 11:56:03.853688 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 785/1678] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:02 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1324 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:56:03.866434 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-27eb6cbc-9fc8-4013-84fc-d00e2ef62ab7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:03.867061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-27eb6cbc-9fc8-4013-84fc-d00e2ef62ab7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: c311469b-29d4-4011-b455-8fe3ffd81d3c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:03.889773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27eb6cbc-9fc8-4013-84fc-d00e2ef62ab7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:03.890268 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27eb6cbc-9fc8-4013-84fc-d00e2ef62ab7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:03.891074 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27eb6cbc-9fc8-4013-84fc-d00e2ef62ab7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:03.891518 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-27eb6cbc-9fc8-4013-84fc-d00e2ef62ab7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:03.930985 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-27eb6cbc-9fc8-4013-84fc-d00e2ef62ab7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] HTTP exception thrown: Instance c311469b-29d4-4011-b455-8fe3ffd81d3c could not be found. Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-27eb6cbc-9fc8-4013-84fc-d00e2ef62ab7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Request method failure captured: Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c HTTP/1.1 Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_LAnQ8j0cPZz1xBwr7wjdHU-dbIgv9RGwWE90rXduHNjvf0SEDc8ctsEAIhNwEZGy9xHYHzGAr5lvnzrwZOwxCgX0EmuaUjvXXJCBLXqYHaANV2j7HrofICjWWXZlkuc7JiIHye8dD3Oib7NPH4bzW6JmKkMk_tSn7GZKMtR1M7SU Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 4c6a6e22d13840698ada0866ea3f4913 Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-MigrationsAdminTest-1356239622 Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c6a6e22d13840698ada0866ea3f4913"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c6a6e22d13840698ada0866ea3f4913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c6a6e22d13840698ada0866ea3f4913"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c6a6e22d13840698ada0866ea3f4913", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-MigrationsAdminTest-1356239622 Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 4c6a6e22d13840698ada0866ea3f4913 Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-MigrationsAdminTest-1356239622 Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-MigrationsAdminTest-1356239622-project Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: d42140cf6bac4674ba0515ca28531222 Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-MigrationsAdminTest-1356239622-project Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance c311469b-29d4-4011-b455-8fe3ffd81d3c could not be found. Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'c311469b-29d4-4011-b455-8fe3ffd81d3c'} Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c311469b-29d4-4011-b455-8fe3ffd81d3c could not be found. Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c311469b-29d4-4011-b455-8fe3ffd81d3c could not be found. Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:03.946389 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:03.952903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:03.952903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:03.952903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:03.952903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:56:03.952903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:56:03.952903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c311469b-29d4-4011-b455-8fe3ffd81d3c could not be found. Jul 12 11:56:03.952903 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:03.952903 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-27eb6cbc-9fc8-4013-84fc-d00e2ef62ab7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Returning 404 to user: Instance c311469b-29d4-4011-b455-8fe3ffd81d3c could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:56:03.952903 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-27eb6cbc-9fc8-4013-84fc-d00e2ef62ab7 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c" status: 404 len: 111 microversion: 2.1 time: 0.085953 Jul 12 11:56:03.956757 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 894/1679] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:03 2022] GET /compute/v2.1/servers/c311469b-29d4-4011-b455-8fe3ffd81d3c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:56:03.957246 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-acdc25a3-3d3b-44c8-af72-749bca2b9a17 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '.version_select at 0x7f5e13b9e310>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:03.998139 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-acdc25a3-3d3b-44c8-af72-749bca2b9a17 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487431781" status: 202 len: 0 microversion: 2.1 time: 0.045169 Jul 12 11:56:03.999087 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 786/1680] 10.222.0.50 () {58 vars in 1220 bytes} [Tue Jul 12 11:56:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487431781 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:56:04.668772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6c6e8015-5aea-46db-8a45-8f0ed75a8913 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:04.669555 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6c6e8015-5aea-46db-8a45-8f0ed75a8913 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:04.687624 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c6e8015-5aea-46db-8a45-8f0ed75a8913 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:04.688126 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c6e8015-5aea-46db-8a45-8f0ed75a8913 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:04.688923 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c6e8015-5aea-46db-8a45-8f0ed75a8913 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:04.689361 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c6e8015-5aea-46db-8a45-8f0ed75a8913 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:04.750908 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-ad3e5c00-5cac-4262-ad53-ce62560aec90 req-e633ee2c-8761-4e32-ad8d-d46b7949557d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00c4b145-fdb3-4993-9354-f18a94e807ed", "tag": "8eee7d5e-b4aa-4c8c-b2f5-7184c099dee2"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:04.820125 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-ad3e5c00-5cac-4262-ad53-ce62560aec90 req-e633ee2c-8761-4e32-ad8d-d46b7949557d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:04.820586 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-ad3e5c00-5cac-4262-ad53-ce62560aec90 req-e633ee2c-8761-4e32-ad8d-d46b7949557d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:04.873657 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-ad3e5c00-5cac-4262-ad53-ce62560aec90 req-e633ee2c-8761-4e32-ad8d-d46b7949557d service nova] Creating event network-changed:8eee7d5e-b4aa-4c8c-b2f5-7184c099dee2 for instance 00c4b145-fdb3-4993-9354-f18a94e807ed on n-h1-849104-4 Jul 12 11:56:04.890856 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-ad3e5c00-5cac-4262-ad53-ce62560aec90 req-e633ee2c-8761-4e32-ad8d-d46b7949557d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150113 Jul 12 11:56:04.898650 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 787/1681] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:04.936016 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-75dd8d5d-aa74-4fda-bf8e-0f52ab1592b4 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:04.936884 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-75dd8d5d-aa74-4fda-bf8e-0f52ab1592b4 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:04.946326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-75dd8d5d-aa74-4fda-bf8e-0f52ab1592b4 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:04.961421 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-75dd8d5d-aa74-4fda-bf8e-0f52ab1592b4 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:04.962778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-75dd8d5d-aa74-4fda-bf8e-0f52ab1592b4 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:04.963413 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-75dd8d5d-aa74-4fda-bf8e-0f52ab1592b4 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:05.919236 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6c6e8015-5aea-46db-8a45-8f0ed75a8913 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:05.954028 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6c6e8015-5aea-46db-8a45-8f0ed75a8913 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1507 microversion: 2.1 time: 1.283639 Jul 12 11:56:05.973466 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 895/1682] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:04 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1507 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:06.049461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1538087818", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d3804aae-e5e6-40af-a993-2653361ea3e0"}], "block_device_mapping_v2": [{"uuid": "def08a2a-9369-4694-a1c4-4573ac9f745d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:06.201749 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-75dd8d5d-aa74-4fda-bf8e-0f52ab1592b4 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:06.218255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] validate_networks() for [('d3804aae-e5e6-40af-a993-2653361ea3e0', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:56:06.226875 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-75dd8d5d-aa74-4fda-bf8e-0f52ab1592b4 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1324 microversion: 2.1 time: 1.322019 Jul 12 11:56:06.245559 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 788/1683] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:04 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1324 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:06.553064 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-44edf9e1-bc3a-4ba6-99e7-c2a68bfb1b03 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:06.553824 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-44edf9e1-bc3a-4ba6-99e7-c2a68bfb1b03 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:06.564537 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-44edf9e1-bc3a-4ba6-99e7-c2a68bfb1b03 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:06.577070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-44edf9e1-bc3a-4ba6-99e7-c2a68bfb1b03 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:06.578158 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-44edf9e1-bc3a-4ba6-99e7-c2a68bfb1b03 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:06.578763 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-44edf9e1-bc3a-4ba6-99e7-c2a68bfb1b03 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:06.624293 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-44edf9e1-bc3a-4ba6-99e7-c2a68bfb1b03 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:56:06.774160 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-44edf9e1-bc3a-4ba6-99e7-c2a68bfb1b03 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 204 len: 0 microversion: 2.1 time: 0.225777 Jul 12 11:56:06.775651 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 789/1684] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:56:06 2022] DELETE /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:56:06.792446 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a44818b4-52f5-4aa3-ac95-2f45ae9160bc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:06.794642 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a44818b4-52f5-4aa3-ac95-2f45ae9160bc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:06.810600 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a44818b4-52f5-4aa3-ac95-2f45ae9160bc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:06.811320 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a44818b4-52f5-4aa3-ac95-2f45ae9160bc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:06.813603 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a44818b4-52f5-4aa3-ac95-2f45ae9160bc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:06.814252 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a44818b4-52f5-4aa3-ac95-2f45ae9160bc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:07.307333 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:56:07.307852 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:56:07.308168 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:56:07.308912 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:56:07.309516 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:56:07.320606 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:07.321260 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:07.322382 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:07.323002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:07.342662 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a44818b4-52f5-4aa3-ac95-2f45ae9160bc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:07.344945 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Getting quotas for project d9393a32f934440e975f62b7d59eed32. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:56:07.351693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Getting quotas for user 86ca9c0d2f474f1f9c35aaf5fb9c6064 and project d9393a32f934440e975f62b7d59eed32. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:56:07.355746 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a44818b4-52f5-4aa3-ac95-2f45ae9160bc tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1468 microversion: 2.1 time: 0.575714 Jul 12 11:56:07.357592 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 790/1685] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:06 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1468 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:56:07.369541 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0787a1c4-81fa-40ee-854c-be626cc965c5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:07.371494 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0787a1c4-81fa-40ee-854c-be626cc965c5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:07.411636 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0787a1c4-81fa-40ee-854c-be626cc965c5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:07.412806 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0787a1c4-81fa-40ee-854c-be626cc965c5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:07.415829 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0787a1c4-81fa-40ee-854c-be626cc965c5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:07.417294 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0787a1c4-81fa-40ee-854c-be626cc965c5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:07.510558 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:56:07.513057 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='def08a2a-9369-4694-a1c4-4573ac9f745d',volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:56:07.849510 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b7156d12-9aa2-48b4-983b-045d1fc70d15 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.803804 Jul 12 11:56:07.851403 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 896/1686] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:56:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:56:07.864266 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4ddadce0-0ae4-4376-8e5d-794de3ddab59 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:07.865002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4ddadce0-0ae4-4376-8e5d-794de3ddab59 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:07.880636 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4ddadce0-0ae4-4376-8e5d-794de3ddab59 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:07.881158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4ddadce0-0ae4-4376-8e5d-794de3ddab59 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:07.881971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4ddadce0-0ae4-4376-8e5d-794de3ddab59 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:07.882416 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4ddadce0-0ae4-4376-8e5d-794de3ddab59 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:07.997939 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0787a1c4-81fa-40ee-854c-be626cc965c5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:08.007898 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0787a1c4-81fa-40ee-854c-be626cc965c5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1507 microversion: 2.1 time: 0.648822 Jul 12 11:56:08.012970 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 791/1687] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:07 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1507 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:08.033523 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-af3e600a-fb38-4179-a0e7-7c52e0e1c859 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:08.037592 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-af3e600a-fb38-4179-a0e7-7c52e0e1c859 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:08.313515 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-af3e600a-fb38-4179-a0e7-7c52e0e1c859 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:08.322982 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-af3e600a-fb38-4179-a0e7-7c52e0e1c859 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1053 microversion: 2.1 time: 0.305682 Jul 12 11:56:08.332134 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 792/1688] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:08 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1053 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:08.375318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ed64d408-e332-49fc-b8ea-0f5677b4fcde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:08.376010 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ed64d408-e332-49fc-b8ea-0f5677b4fcde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:08.383718 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ed64d408-e332-49fc-b8ea-0f5677b4fcde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:08.384328 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ed64d408-e332-49fc-b8ea-0f5677b4fcde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:08.385096 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ed64d408-e332-49fc-b8ea-0f5677b4fcde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:08.385488 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ed64d408-e332-49fc-b8ea-0f5677b4fcde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:08.586465 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4ddadce0-0ae4-4376-8e5d-794de3ddab59 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:08.595227 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4ddadce0-0ae4-4376-8e5d-794de3ddab59 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1324 microversion: 2.1 time: 0.742719 Jul 12 11:56:08.598228 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 897/1689] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:07 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1324 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:08.845869 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ed64d408-e332-49fc-b8ea-0f5677b4fcde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:08.868650 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ed64d408-e332-49fc-b8ea-0f5677b4fcde tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1468 microversion: 2.1 time: 0.498169 Jul 12 11:56:08.889698 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 793/1690] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:08 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1468 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:09.029689 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6d2a8796-2017-484c-bfbd-375e3873691d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:09.030313 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6d2a8796-2017-484c-bfbd-375e3873691d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:09.049959 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d2a8796-2017-484c-bfbd-375e3873691d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:09.050419 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d2a8796-2017-484c-bfbd-375e3873691d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:09.062943 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d2a8796-2017-484c-bfbd-375e3873691d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:09.063496 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d2a8796-2017-484c-bfbd-375e3873691d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:09.343452 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2c1a2922-126c-4266-a86e-9127439d7764 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:09.344624 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2c1a2922-126c-4266-a86e-9127439d7764 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:09.359862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2c1a2922-126c-4266-a86e-9127439d7764 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:09.360616 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2c1a2922-126c-4266-a86e-9127439d7764 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:09.361600 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2c1a2922-126c-4266-a86e-9127439d7764 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:09.362154 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2c1a2922-126c-4266-a86e-9127439d7764 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:09.451777 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6d2a8796-2017-484c-bfbd-375e3873691d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:09.474168 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6d2a8796-2017-484c-bfbd-375e3873691d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1507 microversion: 2.1 time: 0.444012 Jul 12 11:56:09.478713 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 898/1691] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:09 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1507 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:09.493461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-2aaaf2d4-c01a-4238-8a7a-00a77f942c15 req-d4166a66-55a5-4cbf-9847-721de12a26af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad134105-4265-45f8-8844-8f1ddfbeea10", "name": "network-vif-deleted", "tag": "85f8e57f-7584-4612-9d3a-a67d37236dcf"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:09.530143 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-2aaaf2d4-c01a-4238-8a7a-00a77f942c15 req-d4166a66-55a5-4cbf-9847-721de12a26af service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:09.533059 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-2aaaf2d4-c01a-4238-8a7a-00a77f942c15 req-d4166a66-55a5-4cbf-9847-721de12a26af service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:09.580292 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-2aaaf2d4-c01a-4238-8a7a-00a77f942c15 req-d4166a66-55a5-4cbf-9847-721de12a26af service nova] Creating event network-vif-deleted:85f8e57f-7584-4612-9d3a-a67d37236dcf for instance ad134105-4265-45f8-8844-8f1ddfbeea10 on n-h1-849104-4 Jul 12 11:56:09.595572 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-2aaaf2d4-c01a-4238-8a7a-00a77f942c15 req-d4166a66-55a5-4cbf-9847-721de12a26af service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110840 Jul 12 11:56:09.601781 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 899/1692] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:09.619965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f651f7c0-d815-4210-9ed8-6787080dae66 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:09.622273 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f651f7c0-d815-4210-9ed8-6787080dae66 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:09.638270 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f651f7c0-d815-4210-9ed8-6787080dae66 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:09.639175 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f651f7c0-d815-4210-9ed8-6787080dae66 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:09.640290 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f651f7c0-d815-4210-9ed8-6787080dae66 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:09.642532 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f651f7c0-d815-4210-9ed8-6787080dae66 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:09.887713 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2c1a2922-126c-4266-a86e-9127439d7764 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:09.902201 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2c1a2922-126c-4266-a86e-9127439d7764 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1151 microversion: 2.1 time: 0.566321 Jul 12 11:56:09.903148 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 794/1693] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:09 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1151 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:56:09.915962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6fa6c101-418a-4198-9dd8-04b04be5e9ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:09.918304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6fa6c101-418a-4198-9dd8-04b04be5e9ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:09.931447 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6fa6c101-418a-4198-9dd8-04b04be5e9ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:09.931986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6fa6c101-418a-4198-9dd8-04b04be5e9ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:09.934102 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6fa6c101-418a-4198-9dd8-04b04be5e9ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:09.934797 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6fa6c101-418a-4198-9dd8-04b04be5e9ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:10.041423 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6fa6c101-418a-4198-9dd8-04b04be5e9ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:10.041894 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6fa6c101-418a-4198-9dd8-04b04be5e9ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:10.042986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-6fa6c101-418a-4198-9dd8-04b04be5e9ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lazy-loading 'fault' on Instance uuid ad134105-4265-45f8-8844-8f1ddfbeea10 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:56:10.320442 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6fa6c101-418a-4198-9dd8-04b04be5e9ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:10.348365 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6fa6c101-418a-4198-9dd8-04b04be5e9ea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 200 len: 1302 microversion: 2.1 time: 0.440793 Jul 12 11:56:10.349067 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 795/1694] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:09 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 1302 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:10.635174 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-217164567", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "c11f1e67-c837-46a3-8b49-fe30b3169d9e"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:10.720622 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] validate_networks() for [('c11f1e67-c837-46a3-8b49-fe30b3169d9e', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:56:10.942785 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f651f7c0-d815-4210-9ed8-6787080dae66 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:10.958764 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f651f7c0-d815-4210-9ed8-6787080dae66 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1324 microversion: 2.1 time: 1.348482 Jul 12 11:56:10.960091 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 900/1695] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:09 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1324 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:56:10.970075 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7d796f63-d4f6-46f5-ab1b-e07bdeef92b6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:10.973638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7d796f63-d4f6-46f5-ab1b-e07bdeef92b6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:10.985951 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:10.996693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d796f63-d4f6-46f5-ab1b-e07bdeef92b6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:10.997163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d796f63-d4f6-46f5-ab1b-e07bdeef92b6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:10.997981 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d796f63-d4f6-46f5-ab1b-e07bdeef92b6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:10.998425 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d796f63-d4f6-46f5-ab1b-e07bdeef92b6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:11.541305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7d796f63-d4f6-46f5-ab1b-e07bdeef92b6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:11.552756 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7d796f63-d4f6-46f5-ab1b-e07bdeef92b6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1507 microversion: 2.1 time: 0.591274 Jul 12 11:56:11.564426 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 901/1696] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:10 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1507 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:11.569475 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-302ac227-3799-4337-a0f5-3251805bcc06 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:11.570146 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-302ac227-3799-4337-a0f5-3251805bcc06 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:11.584263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-302ac227-3799-4337-a0f5-3251805bcc06 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:11.584931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-302ac227-3799-4337-a0f5-3251805bcc06 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:11.585803 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-302ac227-3799-4337-a0f5-3251805bcc06 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:11.586260 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-302ac227-3799-4337-a0f5-3251805bcc06 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:12.191132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-302ac227-3799-4337-a0f5-3251805bcc06 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:12.200463 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-302ac227-3799-4337-a0f5-3251805bcc06 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1211 microversion: 2.1 time: 0.634796 Jul 12 11:56:12.201042 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 902/1697] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:11 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1211 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:12.228143 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-76a31ca8-d8f9-4314-a975-a165cbc1d3c4 req-41b28c1b-ea77-4409-aef7-fe15729d7533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c4b145-fdb3-4993-9354-f18a94e807ed", "name": "network-vif-plugged", "status": "completed", "tag": "8eee7d5e-b4aa-4c8c-b2f5-7184c099dee2"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:12.245551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-76a31ca8-d8f9-4314-a975-a165cbc1d3c4 req-41b28c1b-ea77-4409-aef7-fe15729d7533 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:12.246275 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-76a31ca8-d8f9-4314-a975-a165cbc1d3c4 req-41b28c1b-ea77-4409-aef7-fe15729d7533 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:12.269797 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-76a31ca8-d8f9-4314-a975-a165cbc1d3c4 req-41b28c1b-ea77-4409-aef7-fe15729d7533 service nova] Creating event network-vif-plugged:8eee7d5e-b4aa-4c8c-b2f5-7184c099dee2 for instance 00c4b145-fdb3-4993-9354-f18a94e807ed on n-h1-849104-4 Jul 12 11:56:12.284697 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-76a31ca8-d8f9-4314-a975-a165cbc1d3c4 req-41b28c1b-ea77-4409-aef7-fe15729d7533 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076432 Jul 12 11:56:12.285852 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 903/1698] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:12.305856 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6c552c7f-c034-4905-b7c4-5e3cd511c2f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:12.308946 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6c552c7f-c034-4905-b7c4-5e3cd511c2f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: ad134105-4265-45f8-8844-8f1ddfbeea10] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:12.328360 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c552c7f-c034-4905-b7c4-5e3cd511c2f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:12.328965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c552c7f-c034-4905-b7c4-5e3cd511c2f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:12.330735 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c552c7f-c034-4905-b7c4-5e3cd511c2f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:12.331191 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c552c7f-c034-4905-b7c4-5e3cd511c2f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:12.373249 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-6c552c7f-c034-4905-b7c4-5e3cd511c2f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] HTTP exception thrown: Instance ad134105-4265-45f8-8844-8f1ddfbeea10 could not be found. Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6c552c7f-c034-4905-b7c4-5e3cd511c2f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Request method failure captured: Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 HTTP/1.1 Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_LAnQ8j0cPZz1xBwr7wjdHU-dbIgv9RGwWE90rXduHNjvf0SEDc8ctsEAIhNwEZGy9xHYHzGAr5lvnzrwZOwxCgX0EmuaUjvXXJCBLXqYHaANV2j7HrofICjWWXZlkuc7JiIHye8dD3Oib7NPH4bzW6JmKkMk_tSn7GZKMtR1M7SU Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 4c6a6e22d13840698ada0866ea3f4913 Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-MigrationsAdminTest-1356239622 Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c6a6e22d13840698ada0866ea3f4913"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c6a6e22d13840698ada0866ea3f4913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c6a6e22d13840698ada0866ea3f4913"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c6a6e22d13840698ada0866ea3f4913", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-MigrationsAdminTest-1356239622 Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 4c6a6e22d13840698ada0866ea3f4913 Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-MigrationsAdminTest-1356239622 Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-MigrationsAdminTest-1356239622-project Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: d42140cf6bac4674ba0515ca28531222 Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-MigrationsAdminTest-1356239622-project Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance ad134105-4265-45f8-8844-8f1ddfbeea10 could not be found. Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'ad134105-4265-45f8-8844-8f1ddfbeea10'} Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad134105-4265-45f8-8844-8f1ddfbeea10 could not be found. Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad134105-4265-45f8-8844-8f1ddfbeea10 could not be found. Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:12.375031 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:12.380229 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:12.380229 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:12.380229 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:12.380229 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:56:12.380229 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:56:12.380229 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad134105-4265-45f8-8844-8f1ddfbeea10 could not be found. Jul 12 11:56:12.380229 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:12.385574 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6c552c7f-c034-4905-b7c4-5e3cd511c2f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Returning 404 to user: Instance ad134105-4265-45f8-8844-8f1ddfbeea10 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:56:12.386781 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6c552c7f-c034-4905-b7c4-5e3cd511c2f8 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10" status: 404 len: 111 microversion: 2.1 time: 0.099630 Jul 12 11:56:12.394806 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 904/1699] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:12 2022] GET /compute/v2.1/servers/ad134105-4265-45f8-8844-8f1ddfbeea10 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:56:12.404827 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4ae0ea2d-7e53-4a4e-9715-79e9a1128445 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:12.405816 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4ae0ea2d-7e53-4a4e-9715-79e9a1128445 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:12.423718 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4ae0ea2d-7e53-4a4e-9715-79e9a1128445 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:12.424576 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4ae0ea2d-7e53-4a4e-9715-79e9a1128445 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:12.425683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4ae0ea2d-7e53-4a4e-9715-79e9a1128445 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:12.426374 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4ae0ea2d-7e53-4a4e-9715-79e9a1128445 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:12.947634 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4ae0ea2d-7e53-4a4e-9715-79e9a1128445 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:12.959814 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4ae0ea2d-7e53-4a4e-9715-79e9a1128445 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1324 microversion: 2.1 time: 0.563586 Jul 12 11:56:12.963011 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 905/1700] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:12 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1324 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:12.973369 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fe58b9b7-9ba7-4156-baba-2a6de083ccea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:12.975090 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fe58b9b7-9ba7-4156-baba-2a6de083ccea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:12.986174 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fe58b9b7-9ba7-4156-baba-2a6de083ccea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:12.990443 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:56:12.991633 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fe58b9b7-9ba7-4156-baba-2a6de083ccea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:12.991815 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:56:12.993500 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:56:12.994163 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:56:12.994793 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fe58b9b7-9ba7-4156-baba-2a6de083ccea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:12.994952 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:56:12.996274 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fe58b9b7-9ba7-4156-baba-2a6de083ccea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:13.020756 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:13.022492 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:13.026916 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:13.027638 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:13.054393 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fe58b9b7-9ba7-4156-baba-2a6de083ccea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:56:13.105548 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Getting quotas for project 29fd5f6c853549a794c75ebff736ccf4. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:56:13.121295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Getting quotas for user ae0b32f84b7146d49338e7a2c06bc579 and project 29fd5f6c853549a794c75ebff736ccf4. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:56:13.175925 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:56:13.180158 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:56:13.275083 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fe58b9b7-9ba7-4156-baba-2a6de083ccea tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 204 len: 0 microversion: 2.1 time: 0.309372 Jul 12 11:56:13.277004 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 906/1701] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:56:12 2022] DELETE /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:56:13.290801 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-82bd8f83-69d9-44e9-a753-7dc8635c985e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.940629 Jul 12 11:56:13.292131 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 796/1702] 10.222.0.50 () {62 vars in 1187 bytes} [Tue Jul 12 11:56:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2942 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 11:56:13.297955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3d8b5703-05f3-4756-9f0d-e377d353abae tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:13.305062 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3d8b5703-05f3-4756-9f0d-e377d353abae tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:13.321287 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-879d2329-a45c-48d6-9327-81d76f45cb32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:13.321920 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-879d2329-a45c-48d6-9327-81d76f45cb32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:13.334740 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-879d2329-a45c-48d6-9327-81d76f45cb32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:13.335580 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-879d2329-a45c-48d6-9327-81d76f45cb32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:13.337146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-879d2329-a45c-48d6-9327-81d76f45cb32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:13.337959 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-879d2329-a45c-48d6-9327-81d76f45cb32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:13.349133 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d8b5703-05f3-4756-9f0d-e377d353abae tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:13.350958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d8b5703-05f3-4756-9f0d-e377d353abae tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:13.366138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d8b5703-05f3-4756-9f0d-e377d353abae tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:13.369843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d8b5703-05f3-4756-9f0d-e377d353abae tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:13.967460 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-879d2329-a45c-48d6-9327-81d76f45cb32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:13.983767 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-879d2329-a45c-48d6-9327-81d76f45cb32 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1211 microversion: 2.1 time: 0.690311 Jul 12 11:56:13.998007 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 797/1703] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:13 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1211 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:14.009920 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d65d3dd1-c0b6-4b7d-b3ba-7cc43142cee3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:14.010853 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d65d3dd1-c0b6-4b7d-b3ba-7cc43142cee3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:14.024181 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d65d3dd1-c0b6-4b7d-b3ba-7cc43142cee3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:14.027580 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d65d3dd1-c0b6-4b7d-b3ba-7cc43142cee3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:14.032477 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d65d3dd1-c0b6-4b7d-b3ba-7cc43142cee3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:14.033269 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d65d3dd1-c0b6-4b7d-b3ba-7cc43142cee3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:14.219317 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3d8b5703-05f3-4756-9f0d-e377d353abae tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:14.234472 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3d8b5703-05f3-4756-9f0d-e377d353abae tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1507 microversion: 2.1 time: 0.952883 Jul 12 11:56:14.241156 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 907/1704] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:13 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1507 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:14.254410 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dd872741-25fc-4adc-a151-4e4d5c3179ac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:14.260074 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dd872741-25fc-4adc-a151-4e4d5c3179ac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:14.453920 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dd872741-25fc-4adc-a151-4e4d5c3179ac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:14.469439 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dd872741-25fc-4adc-a151-4e4d5c3179ac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:14.477167 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dd872741-25fc-4adc-a151-4e4d5c3179ac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:14.481333 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dd872741-25fc-4adc-a151-4e4d5c3179ac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1261 microversion: 2.25 time: 0.238771 Jul 12 11:56:14.484926 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 908/1705] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:14 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1261 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:14.516420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5dd3dbd5-65a5-41c1-8364-97e7ecd709bf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:14.518816 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5dd3dbd5-65a5-41c1-8364-97e7ecd709bf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:14.571259 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5dd3dbd5-65a5-41c1-8364-97e7ecd709bf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:14.574345 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5dd3dbd5-65a5-41c1-8364-97e7ecd709bf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:14.578897 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5dd3dbd5-65a5-41c1-8364-97e7ecd709bf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:14.580005 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5dd3dbd5-65a5-41c1-8364-97e7ecd709bf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:15.146497 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d65d3dd1-c0b6-4b7d-b3ba-7cc43142cee3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42140cf6bac4674ba0515ca28531222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6e22d13840698ada0866ea3f4913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:15.183712 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d65d3dd1-c0b6-4b7d-b3ba-7cc43142cee3 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 200 len: 1468 microversion: 2.1 time: 1.184354 Jul 12 11:56:15.191994 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 798/1706] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:13 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 1468 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:15.204597 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-056e53ea-819e-48b0-af25-ff3dd71d489a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:15.208954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-056e53ea-819e-48b0-af25-ff3dd71d489a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:15.236673 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-056e53ea-819e-48b0-af25-ff3dd71d489a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:15.240666 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-056e53ea-819e-48b0-af25-ff3dd71d489a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:15.243510 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-056e53ea-819e-48b0-af25-ff3dd71d489a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:15.245479 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-056e53ea-819e-48b0-af25-ff3dd71d489a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:15.340744 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5dd3dbd5-65a5-41c1-8364-97e7ecd709bf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:15.344575 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:15.372794 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5dd3dbd5-65a5-41c1-8364-97e7ecd709bf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1520 microversion: 2.1 time: 0.886503 Jul 12 11:56:15.396839 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 909/1707] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:14 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1520 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:15.412194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a035dd26-ae47-45d0-891f-fb77ae0fd1fc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:15.412829 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a035dd26-ae47-45d0-891f-fb77ae0fd1fc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:15.463459 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a035dd26-ae47-45d0-891f-fb77ae0fd1fc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:15.464160 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a035dd26-ae47-45d0-891f-fb77ae0fd1fc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:15.464764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a035dd26-ae47-45d0-891f-fb77ae0fd1fc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:15.465210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a035dd26-ae47-45d0-891f-fb77ae0fd1fc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:16.339649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-056e53ea-819e-48b0-af25-ff3dd71d489a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:16.352381 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-056e53ea-819e-48b0-af25-ff3dd71d489a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1211 microversion: 2.1 time: 1.158871 Jul 12 11:56:16.353540 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 799/1708] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:15 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1211 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:16.363977 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f73bf2dd-4dd4-49e7-9ae1-0f4c39bf0044 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:16.364917 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f73bf2dd-4dd4-49e7-9ae1-0f4c39bf0044 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:16.379712 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f73bf2dd-4dd4-49e7-9ae1-0f4c39bf0044 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:16.380481 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f73bf2dd-4dd4-49e7-9ae1-0f4c39bf0044 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:16.381458 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f73bf2dd-4dd4-49e7-9ae1-0f4c39bf0044 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:16.382072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f73bf2dd-4dd4-49e7-9ae1-0f4c39bf0044 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:16.391308 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a035dd26-ae47-45d0-891f-fb77ae0fd1fc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:16.401449 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a035dd26-ae47-45d0-891f-fb77ae0fd1fc tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1507 microversion: 2.1 time: 1.005534 Jul 12 11:56:16.402055 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 910/1709] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:15 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1507 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:16.424201 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-57c6b2f7-9910-4e50-af2a-8f5a42aa411c req-ea44f951-0f81-4f11-8c81-1d6aa85c7200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e100f265-e0cc-405b-87d0-d4c524c2e333", "name": "network-vif-deleted", "tag": "46a1ed7f-84a2-4d5e-b3d7-20e1261b3c88"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:16.454729 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-57c6b2f7-9910-4e50-af2a-8f5a42aa411c req-ea44f951-0f81-4f11-8c81-1d6aa85c7200 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:16.455185 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-57c6b2f7-9910-4e50-af2a-8f5a42aa411c req-ea44f951-0f81-4f11-8c81-1d6aa85c7200 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:16.520002 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-57c6b2f7-9910-4e50-af2a-8f5a42aa411c req-ea44f951-0f81-4f11-8c81-1d6aa85c7200 service nova] Creating event network-vif-deleted:46a1ed7f-84a2-4d5e-b3d7-20e1261b3c88 for instance e100f265-e0cc-405b-87d0-d4c524c2e333 on n-h2-849104-4 Jul 12 11:56:16.539090 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-57c6b2f7-9910-4e50-af2a-8f5a42aa411c req-ea44f951-0f81-4f11-8c81-1d6aa85c7200 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134408 Jul 12 11:56:16.545253 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 911/1710] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:16.564830 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-05addd28-f909-43a4-af12-08973d805aba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:16.568139 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-05addd28-f909-43a4-af12-08973d805aba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:16.601029 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05addd28-f909-43a4-af12-08973d805aba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:16.601536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05addd28-f909-43a4-af12-08973d805aba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:16.605589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05addd28-f909-43a4-af12-08973d805aba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:16.606894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05addd28-f909-43a4-af12-08973d805aba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:16.855183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-05addd28-f909-43a4-af12-08973d805aba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:16.867031 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-05addd28-f909-43a4-af12-08973d805aba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:16.873264 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-05addd28-f909-43a4-af12-08973d805aba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:16.876941 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-05addd28-f909-43a4-af12-08973d805aba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1319 microversion: 2.25 time: 0.328517 Jul 12 11:56:16.879327 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 912/1711] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:16 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:16.896179 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f73bf2dd-4dd4-49e7-9ae1-0f4c39bf0044 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:16.909116 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f73bf2dd-4dd4-49e7-9ae1-0f4c39bf0044 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1520 microversion: 2.1 time: 0.554269 Jul 12 11:56:16.913712 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 800/1712] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:16 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1520 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:16.926134 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-d452118c-3ee5-41cf-92ff-aa072c0137a6 req-18aec9b1-d00b-41f0-b903-5b6440d96e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a2fb044-0422-4634-bd32-08f216c8f6ab", "tag": "76d05327-fea5-4bb0-aa1a-55e0103cdbcf"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:16.948318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-d452118c-3ee5-41cf-92ff-aa072c0137a6 req-18aec9b1-d00b-41f0-b903-5b6440d96e76 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:16.953625 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-d452118c-3ee5-41cf-92ff-aa072c0137a6 req-18aec9b1-d00b-41f0-b903-5b6440d96e76 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:16.984741 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-d452118c-3ee5-41cf-92ff-aa072c0137a6 req-18aec9b1-d00b-41f0-b903-5b6440d96e76 service nova] Creating event network-changed:76d05327-fea5-4bb0-aa1a-55e0103cdbcf for instance 1a2fb044-0422-4634-bd32-08f216c8f6ab on n-h2-849104-4 Jul 12 11:56:17.017102 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-d452118c-3ee5-41cf-92ff-aa072c0137a6 req-18aec9b1-d00b-41f0-b903-5b6440d96e76 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100499 Jul 12 11:56:17.021624 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 801/1713] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:17.047265 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-add05c07-92d2-4440-bafb-95fac9f49ab2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:17.048585 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-add05c07-92d2-4440-bafb-95fac9f49ab2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] [instance: e100f265-e0cc-405b-87d0-d4c524c2e333] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:17.064201 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:17.072759 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-add05c07-92d2-4440-bafb-95fac9f49ab2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:17.073760 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-add05c07-92d2-4440-bafb-95fac9f49ab2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:17.074818 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-add05c07-92d2-4440-bafb-95fac9f49ab2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:17.077989 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-add05c07-92d2-4440-bafb-95fac9f49ab2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:17.125994 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-add05c07-92d2-4440-bafb-95fac9f49ab2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] HTTP exception thrown: Instance e100f265-e0cc-405b-87d0-d4c524c2e333 could not be found. Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-add05c07-92d2-4440-bafb-95fac9f49ab2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Request method failure captured: Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 HTTP/1.1 Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_LAnQ8j0cPZz1xBwr7wjdHU-dbIgv9RGwWE90rXduHNjvf0SEDc8ctsEAIhNwEZGy9xHYHzGAr5lvnzrwZOwxCgX0EmuaUjvXXJCBLXqYHaANV2j7HrofICjWWXZlkuc7JiIHye8dD3Oib7NPH4bzW6JmKkMk_tSn7GZKMtR1M7SU Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 4c6a6e22d13840698ada0866ea3f4913 Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-MigrationsAdminTest-1356239622 Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c6a6e22d13840698ada0866ea3f4913"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c6a6e22d13840698ada0866ea3f4913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c6a6e22d13840698ada0866ea3f4913"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c6a6e22d13840698ada0866ea3f4913", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-MigrationsAdminTest-1356239622 Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 4c6a6e22d13840698ada0866ea3f4913 Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-MigrationsAdminTest-1356239622 Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-MigrationsAdminTest-1356239622-project Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: d42140cf6bac4674ba0515ca28531222 Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-MigrationsAdminTest-1356239622-project Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance e100f265-e0cc-405b-87d0-d4c524c2e333 could not be found. Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'e100f265-e0cc-405b-87d0-d4c524c2e333'} Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e100f265-e0cc-405b-87d0-d4c524c2e333 could not be found. Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e100f265-e0cc-405b-87d0-d4c524c2e333 could not be found. Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:17.135149 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:17.139762 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:17.139762 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:17.139762 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:17.139762 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:56:17.139762 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:56:17.139762 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e100f265-e0cc-405b-87d0-d4c524c2e333 could not be found. Jul 12 11:56:17.139762 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:17.141838 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-add05c07-92d2-4440-bafb-95fac9f49ab2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] Returning 404 to user: Instance e100f265-e0cc-405b-87d0-d4c524c2e333 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:56:17.142947 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-add05c07-92d2-4440-bafb-95fac9f49ab2 tempest-MigrationsAdminTest-1356239622 tempest-MigrationsAdminTest-1356239622-project] 10.222.0.50 "GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333" status: 404 len: 111 microversion: 2.1 time: 0.107310 Jul 12 11:56:17.147476 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 802/1714] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:17 2022] GET /compute/v2.1/servers/e100f265-e0cc-405b-87d0-d4c524c2e333 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:56:17.159764 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8ece9938-7d5f-4617-ae4f-3bf946bc79db tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1860458871", "metadata": {"": ""}}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8ece9938-7d5f-4617-ae4f-3bf946bc79db tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Request method failure captured: Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed/action HTTP/1.1 Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 107 Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWFAKIsN470Eihf_ppnEMm8ScuYYi-RlEoEhYKrKGQKnWRVVx8CL1_cx_wavxZ5Yb1nB9a1dc8SNphqIFzgLzRw54v5bQ1jw4-zQ4tTxc1iksIQtwaDQzo2UoXyxxwU1KRjPyEgUzHrMWJINvtRxEjh7-x3pnpa9F8J8cCj9xcSqENw Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8030002dc7940b0a1bdf4f252fd5a8c", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 0123721160c94b6785ed308618a2efc8 Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1860458871", "metadata": {"": ""}}} Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '00c4b145-fdb3-4993-9354-f18a94e807ed', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1860458871', 'metadata': {'': ''}}}} Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise error Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi {'': ''} Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:56:17.167431 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 12 11:56:17.172287 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:17.176808 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8ece9938-7d5f-4617-ae4f-3bf946bc79db tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:56:17.178246 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8ece9938-7d5f-4617-ae4f-3bf946bc79db tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "POST /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed/action" status: 400 len: 170 microversion: 2.1 time: 0.029160 Jul 12 11:56:17.179866 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 803/1715] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Jul 12 11:56:17 2022] POST /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed/action => generated 170 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:56:17.230469 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3483ac94-266c-4c29-815c-b6a60f7f5645 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:17.231786 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3483ac94-266c-4c29-815c-b6a60f7f5645 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:17.241292 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3483ac94-266c-4c29-815c-b6a60f7f5645 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:17.242577 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3483ac94-266c-4c29-815c-b6a60f7f5645 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:17.243652 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3483ac94-266c-4c29-815c-b6a60f7f5645 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:17.244684 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3483ac94-266c-4c29-815c-b6a60f7f5645 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:17.265604 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:17.333888 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-14cdbdd8-e3c3-4329-974c-346c1f35ba07 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Action: 'create', calling method: .version_select at 0x7f5e099cd820>, body: {"keypair": {"name": "tempest-keypair-10054068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVQqmhVsvQKj/bHow2VVArscGYjFoOkPqmAb2y1e3iv1RDCo0YbUPN3i4fu2CjmkuKiDELAgsgQ1+/odTiUT9vsQLG1NjH+39ykp0pXHNWBiXGskovTxRhCRz1jweBVZQ=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:17.371898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:17.423029 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-14cdbdd8-e3c3-4329-974c-346c1f35ba07 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Getting quotas for project bf0302b07f834b4ea63ce4acf974e7f8. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:56:17.442510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-14cdbdd8-e3c3-4329-974c-346c1f35ba07 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Getting quotas for user 964cbaadd80b4f5a9b9fb5e93ffb823b and project bf0302b07f834b4ea63ce4acf974e7f8. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:56:17.568087 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-14cdbdd8-e3c3-4329-974c-346c1f35ba07 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.687571 Jul 12 11:56:17.576260 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 913/1716] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:56:16 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:17.580340 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-da6d1501-4339-4809-9faf-a70afde52ce5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:17.581774 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-da6d1501-4339-4809-9faf-a70afde52ce5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:17.627172 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da6d1501-4339-4809-9faf-a70afde52ce5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:17.630572 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da6d1501-4339-4809-9faf-a70afde52ce5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:17.634935 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da6d1501-4339-4809-9faf-a70afde52ce5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:17.637387 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da6d1501-4339-4809-9faf-a70afde52ce5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:18.449589 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3483ac94-266c-4c29-815c-b6a60f7f5645 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:18.463041 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3483ac94-266c-4c29-815c-b6a60f7f5645 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1520 microversion: 2.1 time: 1.276527 Jul 12 11:56:18.464724 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 804/1717] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:17 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1520 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:18.484997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-44802d89-cdb5-430f-9f8e-f786066aa6b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:18.486684 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-44802d89-cdb5-430f-9f8e-f786066aa6b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:18.528063 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-44802d89-cdb5-430f-9f8e-f786066aa6b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:18.539350 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-44802d89-cdb5-430f-9f8e-f786066aa6b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:18.541783 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-44802d89-cdb5-430f-9f8e-f786066aa6b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:18.546068 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-44802d89-cdb5-430f-9f8e-f786066aa6b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:18.767955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-da6d1501-4339-4809-9faf-a70afde52ce5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:18.778784 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-da6d1501-4339-4809-9faf-a70afde52ce5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1211 microversion: 2.1 time: 1.207680 Jul 12 11:56:18.785772 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 914/1718] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:17 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1211 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:18.801746 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-de59a6c2-3bf1-42e3-9a46-9e734d1bdab0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:18.807608 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-de59a6c2-3bf1-42e3-9a46-9e734d1bdab0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:18.832420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de59a6c2-3bf1-42e3-9a46-9e734d1bdab0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:18.833203 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de59a6c2-3bf1-42e3-9a46-9e734d1bdab0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:18.836904 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de59a6c2-3bf1-42e3-9a46-9e734d1bdab0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:18.841363 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de59a6c2-3bf1-42e3-9a46-9e734d1bdab0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:19.142903 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-de59a6c2-3bf1-42e3-9a46-9e734d1bdab0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:19.156538 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-de59a6c2-3bf1-42e3-9a46-9e734d1bdab0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:19.163860 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-de59a6c2-3bf1-42e3-9a46-9e734d1bdab0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:19.167607 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-de59a6c2-3bf1-42e3-9a46-9e734d1bdab0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1319 microversion: 2.25 time: 0.378316 Jul 12 11:56:19.168469 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 915/1719] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:18 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:19.177905 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2cde2d5e-936a-43df-82d6-506118d1b60d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:19.179149 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2cde2d5e-936a-43df-82d6-506118d1b60d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:19.194624 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2cde2d5e-936a-43df-82d6-506118d1b60d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:19.195291 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2cde2d5e-936a-43df-82d6-506118d1b60d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:19.196883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2cde2d5e-936a-43df-82d6-506118d1b60d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:19.199275 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2cde2d5e-936a-43df-82d6-506118d1b60d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:19.544658 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2cde2d5e-936a-43df-82d6-506118d1b60d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:19.556193 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2cde2d5e-936a-43df-82d6-506118d1b60d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1520 microversion: 2.1 time: 0.386432 Jul 12 11:56:19.563335 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 916/1720] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:19 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:19.583444 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-33349343-c956-4e86-bcdd-bd4cdbc7fd32 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1871970565", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-33349343-c956-4e86-bcdd-bd4cdbc7fd32 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Request method failure captured: Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed/action HTTP/1.1 Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 619 Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWFAKIsN470Eihf_ppnEMm8ScuYYi-RlEoEhYKrKGQKnWRVVx8CL1_cx_wavxZ5Yb1nB9a1dc8SNphqIFzgLzRw54v5bQ1jw4-zQ4tTxc1iksIQtwaDQzo2UoXyxxwU1KRjPyEgUzHrMWJINvtRxEjh7-x3pnpa9F8J8cCj9xcSqENw Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8030002dc7940b0a1bdf4f252fd5a8c", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0123721160c94b6785ed308618a2efc8 Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1871970565", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '00c4b145-fdb3-4993-9354-f18a94e807ed', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1871970565', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 11:56:19.586451 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise error Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 12 11:56:19.589506 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:19.593277 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-33349343-c956-4e86-bcdd-bd4cdbc7fd32 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:56:19.599753 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-33349343-c956-4e86-bcdd-bd4cdbc7fd32 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "POST /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed/action" status: 400 len: 938 microversion: 2.1 time: 0.022673 Jul 12 11:56:19.605990 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 917/1721] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Jul 12 11:56:19 2022] POST /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed/action => generated 938 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:56:19.620664 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c74a183d-37fd-4cc3-865d-54eb03c358f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:19.621534 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c74a183d-37fd-4cc3-865d-54eb03c358f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:19.638593 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-44802d89-cdb5-430f-9f8e-f786066aa6b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:19.655266 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-44802d89-cdb5-430f-9f8e-f786066aa6b5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1523 microversion: 2.1 time: 1.187852 Jul 12 11:56:19.666997 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 805/1722] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:18 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1523 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:19.698349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c74a183d-37fd-4cc3-865d-54eb03c358f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:19.703001 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c74a183d-37fd-4cc3-865d-54eb03c358f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:19.704296 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c74a183d-37fd-4cc3-865d-54eb03c358f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:19.704932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c74a183d-37fd-4cc3-865d-54eb03c358f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:19.805686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-433571b7-f4a1-4216-96f5-2ef3fb1abdb4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:19.811077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-433571b7-f4a1-4216-96f5-2ef3fb1abdb4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:19.824957 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-433571b7-f4a1-4216-96f5-2ef3fb1abdb4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:19.826026 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-433571b7-f4a1-4216-96f5-2ef3fb1abdb4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:19.827286 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-433571b7-f4a1-4216-96f5-2ef3fb1abdb4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:19.828566 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-433571b7-f4a1-4216-96f5-2ef3fb1abdb4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:20.363123 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c74a183d-37fd-4cc3-865d-54eb03c358f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:20.373043 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c74a183d-37fd-4cc3-865d-54eb03c358f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1520 microversion: 2.1 time: 0.761431 Jul 12 11:56:20.373915 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 918/1723] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:19 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1520 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:56:20.383288 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-56f53e4a-c42e-4f98-b2db-638a6e124fc6 req-daea5f2f-bc9c-4610-8d57-817726862070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e416e34a-0097-4379-aa3d-6193730a9304", "name": "network-vif-plugged", "status": "completed", "tag": "71279d83-e64a-4032-bd91-c8d30df42bf3"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:20.406272 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-56f53e4a-c42e-4f98-b2db-638a6e124fc6 req-daea5f2f-bc9c-4610-8d57-817726862070 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:20.406729 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-56f53e4a-c42e-4f98-b2db-638a6e124fc6 req-daea5f2f-bc9c-4610-8d57-817726862070 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:20.471636 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-56f53e4a-c42e-4f98-b2db-638a6e124fc6 req-daea5f2f-bc9c-4610-8d57-817726862070 service nova] Creating event network-vif-plugged:71279d83-e64a-4032-bd91-c8d30df42bf3 for instance e416e34a-0097-4379-aa3d-6193730a9304 on n-h1-849104-4 Jul 12 11:56:20.480830 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-56f53e4a-c42e-4f98-b2db-638a6e124fc6 req-daea5f2f-bc9c-4610-8d57-817726862070 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104221 Jul 12 11:56:20.484781 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 919/1724] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:20.501220 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a0bc633f-0f58-4f06-a308-cd5e55d07b4d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:20.502397 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a0bc633f-0f58-4f06-a308-cd5e55d07b4d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:20.516716 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0bc633f-0f58-4f06-a308-cd5e55d07b4d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:20.519290 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0bc633f-0f58-4f06-a308-cd5e55d07b4d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:20.520442 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0bc633f-0f58-4f06-a308-cd5e55d07b4d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:20.525119 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0bc633f-0f58-4f06-a308-cd5e55d07b4d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:20.824008 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-433571b7-f4a1-4216-96f5-2ef3fb1abdb4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:20.844114 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-433571b7-f4a1-4216-96f5-2ef3fb1abdb4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1211 microversion: 2.1 time: 1.043396 Jul 12 11:56:20.846300 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 806/1725] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:19 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1211 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:56:20.863520 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5f565bb9-e35f-4d37-8768-d8d172e658f7 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:20.866261 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5f565bb9-e35f-4d37-8768-d8d172e658f7 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:20.878446 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5f565bb9-e35f-4d37-8768-d8d172e658f7 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:20.878813 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5f565bb9-e35f-4d37-8768-d8d172e658f7 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:20.888393 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5f565bb9-e35f-4d37-8768-d8d172e658f7 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:20.890253 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5f565bb9-e35f-4d37-8768-d8d172e658f7 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:20.920457 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a0bc633f-0f58-4f06-a308-cd5e55d07b4d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:20.942493 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a0bc633f-0f58-4f06-a308-cd5e55d07b4d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:20.945001 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a0bc633f-0f58-4f06-a308-cd5e55d07b4d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:20.946395 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a0bc633f-0f58-4f06-a308-cd5e55d07b4d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1361 microversion: 2.25 time: 0.460268 Jul 12 11:56:20.947204 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 920/1726] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:20 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1361 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:20.962946 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0b75ce1b-a38f-4908-97e0-64304dccdafa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:20.965360 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0b75ce1b-a38f-4908-97e0-64304dccdafa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:21.003735 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b75ce1b-a38f-4908-97e0-64304dccdafa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:21.005566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b75ce1b-a38f-4908-97e0-64304dccdafa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:21.006659 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b75ce1b-a38f-4908-97e0-64304dccdafa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:21.009847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b75ce1b-a38f-4908-97e0-64304dccdafa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:21.880421 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0b75ce1b-a38f-4908-97e0-64304dccdafa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:21.888214 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0b75ce1b-a38f-4908-97e0-64304dccdafa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1523 microversion: 2.1 time: 0.936733 Jul 12 11:56:21.888790 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 921/1727] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:20 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1523 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:21.914858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-18707ee0-9619-4fbc-a615-da2bf5870790 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:21.918511 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-18707ee0-9619-4fbc-a615-da2bf5870790 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:21.941943 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-18707ee0-9619-4fbc-a615-da2bf5870790 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:21.942400 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-18707ee0-9619-4fbc-a615-da2bf5870790 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:21.943194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-18707ee0-9619-4fbc-a615-da2bf5870790 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:21.943633 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-18707ee0-9619-4fbc-a615-da2bf5870790 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:22.286972 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5f565bb9-e35f-4d37-8768-d8d172e658f7 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:22.298244 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5f565bb9-e35f-4d37-8768-d8d172e658f7 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1520 microversion: 2.1 time: 1.437831 Jul 12 11:56:22.299920 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 807/1728] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:20 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1520 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:22.324582 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-35f98d63-fb82-457b-a235-fdd1b5031e18 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:22.326883 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-35f98d63-fb82-457b-a235-fdd1b5031e18 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:22.358005 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35f98d63-fb82-457b-a235-fdd1b5031e18 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:22.370988 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35f98d63-fb82-457b-a235-fdd1b5031e18 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:22.379188 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35f98d63-fb82-457b-a235-fdd1b5031e18 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:22.380781 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35f98d63-fb82-457b-a235-fdd1b5031e18 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:22.521687 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-18707ee0-9619-4fbc-a615-da2bf5870790 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:22.534461 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-18707ee0-9619-4fbc-a615-da2bf5870790 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1211 microversion: 2.1 time: 0.644584 Jul 12 11:56:22.541500 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 922/1729] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:21 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1211 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:22.550555 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-108fe9e4-b36e-45bf-9405-a37d7569f5f1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-108fe9e4-b36e-45bf-9405-a37d7569f5f1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Request method failure captured: Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed/action HTTP/1.1 Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 285 Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWFAKIsN470Eihf_ppnEMm8ScuYYi-RlEoEhYKrKGQKnWRVVx8CL1_cx_wavxZ5Yb1nB9a1dc8SNphqIFzgLzRw54v5bQ1jw4-zQ4tTxc1iksIQtwaDQzo2UoXyxxwU1KRjPyEgUzHrMWJINvtRxEjh7-x3pnpa9F8J8cCj9xcSqENw Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8030002dc7940b0a1bdf4f252fd5a8c", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0123721160c94b6785ed308618a2efc8 Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '00c4b145-fdb3-4993-9354-f18a94e807ed', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise error Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:22.567665 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:22.573152 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-108fe9e4-b36e-45bf-9405-a37d7569f5f1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:56:22.580766 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-108fe9e4-b36e-45bf-9405-a37d7569f5f1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "POST /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed/action" status: 400 len: 619 microversion: 2.1 time: 0.037782 Jul 12 11:56:22.587870 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 923/1730] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Jul 12 11:56:22 2022] POST /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed/action => generated 619 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:56:22.611950 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-02b9b723-1de1-4ba5-820c-bad051eeba8d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:22.614237 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-02b9b723-1de1-4ba5-820c-bad051eeba8d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:22.648990 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-02b9b723-1de1-4ba5-820c-bad051eeba8d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:22.650367 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-02b9b723-1de1-4ba5-820c-bad051eeba8d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:22.651638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-02b9b723-1de1-4ba5-820c-bad051eeba8d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:22.655198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-02b9b723-1de1-4ba5-820c-bad051eeba8d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:23.060300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:23.149732 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=8 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:23.271028 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-02b9b723-1de1-4ba5-820c-bad051eeba8d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:23.301050 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-02b9b723-1de1-4ba5-820c-bad051eeba8d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1520 microversion: 2.1 time: 0.707790 Jul 12 11:56:23.308719 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 924/1731] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:22 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1520 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:56:23.319281 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-33534ecf-92b9-43c9-8430-175526ad8440 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:23.323159 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-33534ecf-92b9-43c9-8430-175526ad8440 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:23.338845 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-33534ecf-92b9-43c9-8430-175526ad8440 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:23.344209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-33534ecf-92b9-43c9-8430-175526ad8440 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:23.375926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-33534ecf-92b9-43c9-8430-175526ad8440 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:23.382738 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-33534ecf-92b9-43c9-8430-175526ad8440 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:23.393374 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-35f98d63-fb82-457b-a235-fdd1b5031e18 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:23.412741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-35f98d63-fb82-457b-a235-fdd1b5031e18 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:23.414233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-35f98d63-fb82-457b-a235-fdd1b5031e18 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:23.415375 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-35f98d63-fb82-457b-a235-fdd1b5031e18 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1361 microversion: 2.25 time: 1.101956 Jul 12 11:56:23.433928 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 808/1732] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:22 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1361 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:23.467611 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0dbdd358-a2fe-4d40-a7da-59f6efb7d1bb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:23.471510 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0dbdd358-a2fe-4d40-a7da-59f6efb7d1bb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:23.501446 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0dbdd358-a2fe-4d40-a7da-59f6efb7d1bb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:23.501929 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0dbdd358-a2fe-4d40-a7da-59f6efb7d1bb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:23.508538 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0dbdd358-a2fe-4d40-a7da-59f6efb7d1bb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:23.512089 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0dbdd358-a2fe-4d40-a7da-59f6efb7d1bb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:24.672882 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-33534ecf-92b9-43c9-8430-175526ad8440 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:24.684305 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-33534ecf-92b9-43c9-8430-175526ad8440 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1523 microversion: 2.1 time: 1.374020 Jul 12 11:56:24.698445 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 925/1733] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:23 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1523 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:24.711434 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fd205f51-09ea-4a81-b630-54c759ebcc5a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:24.712072 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fd205f51-09ea-4a81-b630-54c759ebcc5a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:24.744151 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fd205f51-09ea-4a81-b630-54c759ebcc5a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:24.744586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fd205f51-09ea-4a81-b630-54c759ebcc5a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:24.749727 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fd205f51-09ea-4a81-b630-54c759ebcc5a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:24.751760 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fd205f51-09ea-4a81-b630-54c759ebcc5a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:25.027306 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0dbdd358-a2fe-4d40-a7da-59f6efb7d1bb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:25.047864 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0dbdd358-a2fe-4d40-a7da-59f6efb7d1bb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1520 microversion: 2.1 time: 1.604407 Jul 12 11:56:25.063954 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 809/1734] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:23 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1520 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:25.088641 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1d4a5eff-17ca-4ad8-babd-323f6141bd69 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:25.092778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1d4a5eff-17ca-4ad8-babd-323f6141bd69 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:25.114588 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d4a5eff-17ca-4ad8-babd-323f6141bd69 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:25.119800 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d4a5eff-17ca-4ad8-babd-323f6141bd69 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:25.121149 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d4a5eff-17ca-4ad8-babd-323f6141bd69 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:25.122008 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d4a5eff-17ca-4ad8-babd-323f6141bd69 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:25.601021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fd205f51-09ea-4a81-b630-54c759ebcc5a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:25.631938 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fd205f51-09ea-4a81-b630-54c759ebcc5a tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1199 microversion: 2.1 time: 0.916840 Jul 12 11:56:25.632991 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 926/1735] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:24 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1199 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:25.645210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-d7c465de-1a73-4bf9-bf3a-51257785389a req-1da10f59-06be-4907-aae7-057392aa196b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fce2eb-25af-411c-ab0a-761bac343671", "tag": "cf0349c7-341e-4a91-9f8c-4f3ac688bd8c"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:25.685130 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d7c465de-1a73-4bf9-bf3a-51257785389a req-1da10f59-06be-4907-aae7-057392aa196b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:25.685742 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d7c465de-1a73-4bf9-bf3a-51257785389a req-1da10f59-06be-4907-aae7-057392aa196b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:25.732768 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-d7c465de-1a73-4bf9-bf3a-51257785389a req-1da10f59-06be-4907-aae7-057392aa196b service nova] Creating event network-changed:cf0349c7-341e-4a91-9f8c-4f3ac688bd8c for instance e9fce2eb-25af-411c-ab0a-761bac343671 on n-h2-849104-4 Jul 12 11:56:25.749313 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-d7c465de-1a73-4bf9-bf3a-51257785389a req-1da10f59-06be-4907-aae7-057392aa196b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112826 Jul 12 11:56:25.753641 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 927/1736] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:25.767499 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3eb252d7-4ab7-4701-8b6f-16485865bf8f tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-975726763"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:25.772210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3eb252d7-4ab7-4701-8b6f-16485865bf8f tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:25.791998 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3eb252d7-4ab7-4701-8b6f-16485865bf8f tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:25.794076 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3eb252d7-4ab7-4701-8b6f-16485865bf8f tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:25.796594 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3eb252d7-4ab7-4701-8b6f-16485865bf8f tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:25.797639 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3eb252d7-4ab7-4701-8b6f-16485865bf8f tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:26.417601 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3eb252d7-4ab7-4701-8b6f-16485865bf8f tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "POST /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed/action" status: 202 len: 0 microversion: 2.1 time: 0.661626 Jul 12 11:56:26.420714 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 928/1737] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:56:25 2022] POST /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 12 11:56:26.439190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-994b1059-dfd6-436e-b6f1-c8dd243bca71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:26.441652 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-994b1059-dfd6-436e-b6f1-c8dd243bca71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:26.468620 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-994b1059-dfd6-436e-b6f1-c8dd243bca71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:26.471733 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-994b1059-dfd6-436e-b6f1-c8dd243bca71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:26.474602 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1d4a5eff-17ca-4ad8-babd-323f6141bd69 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:26.479540 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-994b1059-dfd6-436e-b6f1-c8dd243bca71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:26.480801 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-994b1059-dfd6-436e-b6f1-c8dd243bca71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:26.498893 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1d4a5eff-17ca-4ad8-babd-323f6141bd69 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:26.510428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1d4a5eff-17ca-4ad8-babd-323f6141bd69 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:26.515076 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1d4a5eff-17ca-4ad8-babd-323f6141bd69 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1361 microversion: 2.25 time: 1.449006 Jul 12 11:56:26.515979 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 810/1738] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:25 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1361 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:26.538790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1026735752", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e59686b4-228f-494c-ad71-ec6f07b7989c"}], "security_groups": [{"name": "tempest-securitygroup--1661001916"}], "key_name": "tempest-keypair-10054068", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:26.829044 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] validate_networks() for [('e59686b4-228f-494c-ad71-ec6f07b7989c', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:56:27.043187 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-994b1059-dfd6-436e-b6f1-c8dd243bca71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:27.055002 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-994b1059-dfd6-436e-b6f1-c8dd243bca71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1523 microversion: 2.1 time: 0.630017 Jul 12 11:56:27.055612 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 929/1739] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:26 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1523 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:27.350324 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fe448695-ac22-49bb-ae66-ad121ed859f2 tempest-QuotaClassesAdmin257Test-860136622 tempest-QuotaClassesAdmin257Test-860136622-project-admin] Calling method '.version_select at 0x7f5e09ad6790>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:27.363747 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:56:27.363747 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:56:27.420201 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fe448695-ac22-49bb-ae66-ad121ed859f2 tempest-QuotaClassesAdmin257Test-860136622 tempest-QuotaClassesAdmin257Test-860136622-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.354955 Jul 12 11:56:27.422889 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 930/1740] 10.222.0.50 () {60 vars in 1225 bytes} [Tue Jul 12 11:56:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:56:27.438601 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-538b711a-d8e2-455d-829b-368609c5a435 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1729787901"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:27.444505 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-538b711a-d8e2-455d-829b-368609c5a435 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:27.463459 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-538b711a-d8e2-455d-829b-368609c5a435 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:27.463934 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-538b711a-d8e2-455d-829b-368609c5a435 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:27.470004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-538b711a-d8e2-455d-829b-368609c5a435 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:27.470518 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-538b711a-d8e2-455d-829b-368609c5a435 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:27.486099 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:27.557706 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-538b711a-d8e2-455d-829b-368609c5a435 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] HTTP exception thrown: Cannot 'createImage' instance 00c4b145-fdb3-4993-9354-f18a94e807ed while it is in task_state image_snapshot Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-538b711a-d8e2-455d-829b-368609c5a435 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Request method failure captured: Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed/action HTTP/1.1 Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 85 Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWFAKIsN470Eihf_ppnEMm8ScuYYi-RlEoEhYKrKGQKnWRVVx8CL1_cx_wavxZ5Yb1nB9a1dc8SNphqIFzgLzRw54v5bQ1jw4-zQ4tTxc1iksIQtwaDQzo2UoXyxxwU1KRjPyEgUzHrMWJINvtRxEjh7-x3pnpa9F8J8cCj9xcSqENw Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8030002dc7940b0a1bdf4f252fd5a8c", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0123721160c94b6785ed308618a2efc8 Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1729787901"}} Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: exception: Cannot 'createImage' instance 00c4b145-fdb3-4993-9354-f18a94e807ed while it is in task_state image_snapshot Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '00c4b145-fdb3-4993-9354-f18a94e807ed', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1729787901'}}} Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed in task_state image_snapshot. Cannot snapshot while the instance is in this state. Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 11:56:27.559545 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 00c4b145-fdb3-4993-9354-f18a94e807ed while it is in task_state image_snapshot Jul 12 11:56:27.564895 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:27.564895 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:27.564895 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:27.564895 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:27.564895 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:27.564895 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:27.564895 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:56:27.564895 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:56:27.564895 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 00c4b145-fdb3-4993-9354-f18a94e807ed while it is in task_state image_snapshot Jul 12 11:56:27.564895 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:56:27.564895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-538b711a-d8e2-455d-829b-368609c5a435 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Returning 409 to user: Cannot 'createImage' instance 00c4b145-fdb3-4993-9354-f18a94e807ed while it is in task_state image_snapshot {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:56:27.564895 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-538b711a-d8e2-455d-829b-368609c5a435 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "POST /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed/action" status: 409 len: 159 microversion: 2.1 time: 0.137178 Jul 12 11:56:27.566535 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 931/1741] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:56:27 2022] POST /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed/action => generated 159 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:56:27.573583 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0fbc6329-9841-4bfe-b0a3-54ddf7fd9684 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:27.574207 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0fbc6329-9841-4bfe-b0a3-54ddf7fd9684 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:27.596487 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0fbc6329-9841-4bfe-b0a3-54ddf7fd9684 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:27.597496 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0fbc6329-9841-4bfe-b0a3-54ddf7fd9684 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:27.598307 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0fbc6329-9841-4bfe-b0a3-54ddf7fd9684 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:27.598753 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0fbc6329-9841-4bfe-b0a3-54ddf7fd9684 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:27.775061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0fbc6329-9841-4bfe-b0a3-54ddf7fd9684 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:27.784386 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0fbc6329-9841-4bfe-b0a3-54ddf7fd9684 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1199 microversion: 2.1 time: 0.216858 Jul 12 11:56:27.785873 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 932/1742] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:27 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1199 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:27.792658 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f45650bf-7de5-43d6-93c1-9d2ccf8d9052 tempest-QuotaClassesAdmin257Test-860136622 tempest-QuotaClassesAdmin257Test-860136622-project-admin] Action: 'update', calling method: .version_select at 0x7f5e099f3f70>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:27.794467 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:56:27.794467 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:56:27.992591 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f45650bf-7de5-43d6-93c1-9d2ccf8d9052 tempest-QuotaClassesAdmin257Test-860136622 tempest-QuotaClassesAdmin257Test-860136622-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.204991 Jul 12 11:56:27.993086 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 933/1743] 10.222.0.50 () {62 vars in 1246 bytes} [Tue Jul 12 11:56:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:56:28.002796 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f2487e32-495d-43e5-87f7-46d71ab00279 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:28.004092 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f2487e32-495d-43e5-87f7-46d71ab00279 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:28.011881 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=8,nova_api:INSERT=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:28.014273 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f2487e32-495d-43e5-87f7-46d71ab00279 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:28.015351 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f2487e32-495d-43e5-87f7-46d71ab00279 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:28.015655 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f2487e32-495d-43e5-87f7-46d71ab00279 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:28.016132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f2487e32-495d-43e5-87f7-46d71ab00279 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:28.204121 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f2487e32-495d-43e5-87f7-46d71ab00279 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:28.213422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f2487e32-495d-43e5-87f7-46d71ab00279 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:28.214899 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f2487e32-495d-43e5-87f7-46d71ab00279 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:28.216112 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f2487e32-495d-43e5-87f7-46d71ab00279 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1361 microversion: 2.25 time: 0.217265 Jul 12 11:56:28.228076 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 934/1744] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:27 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:28.236575 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a5312c90-0c80-4e65-b355-fb6c6398a1a0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '.version_select at 0x7f5e099c9c10>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:28.422900 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a5312c90-0c80-4e65-b355-fb6c6398a1a0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "DELETE /compute/v2.1/images/669e67fa-6b39-42e8-b6f2-f11711fb248f" status: 204 len: 0 microversion: 2.1 time: 0.204177 Jul 12 11:56:28.423521 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 935/1745] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:28 2022] DELETE /compute/v2.1/images/669e67fa-6b39-42e8-b6f2-f11711fb248f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:56:28.429493 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bac6aa27-7d6f-45d8-93ea-54d59dddf85f tempest-QuotaClassesAdmin257Test-860136622 tempest-QuotaClassesAdmin257Test-860136622-project-admin] Calling method '.version_select at 0x7f5e09a35b80>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:28.430274 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:56:28.430274 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:56:28.443688 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bac6aa27-7d6f-45d8-93ea-54d59dddf85f tempest-QuotaClassesAdmin257Test-860136622 tempest-QuotaClassesAdmin257Test-860136622-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.018960 Jul 12 11:56:28.444623 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 936/1746] 10.222.0.50 () {60 vars in 1225 bytes} [Tue Jul 12 11:56:28 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:56:28.449764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-eb5ac778-bf8e-49ee-a3b6-a348bfed2e53 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:28.450626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-eb5ac778-bf8e-49ee-a3b6-a348bfed2e53 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:28.458596 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eb5ac778-bf8e-49ee-a3b6-a348bfed2e53 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:28.459497 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eb5ac778-bf8e-49ee-a3b6-a348bfed2e53 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:28.460500 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eb5ac778-bf8e-49ee-a3b6-a348bfed2e53 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:28.461143 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eb5ac778-bf8e-49ee-a3b6-a348bfed2e53 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:28.499940 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Getting quotas for project bf0302b07f834b4ea63ce4acf974e7f8. Resources: dict_keys(['metadata_items']) {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:56:28.515129 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Getting quotas for user 964cbaadd80b4f5a9b9fb5e93ffb823b and project bf0302b07f834b4ea63ce4acf974e7f8. Resources: dict_keys(['metadata_items']) {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:56:28.550844 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:56:28.551273 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:56:28.551752 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:56:28.555000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:56:28.555515 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:56:28.573070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:28.573538 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:28.574367 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:28.585693 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:28.631709 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Getting quotas for project bf0302b07f834b4ea63ce4acf974e7f8. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:56:28.637924 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Getting quotas for user 964cbaadd80b4f5a9b9fb5e93ffb823b and project bf0302b07f834b4ea63ce4acf974e7f8. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:56:28.682157 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:56:28.689146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:56:28.693157 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-eb5ac778-bf8e-49ee-a3b6-a348bfed2e53 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:28.706847 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-eb5ac778-bf8e-49ee-a3b6-a348bfed2e53 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1523 microversion: 2.1 time: 0.260401 Jul 12 11:56:28.708700 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 937/1747] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:28 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:28.727987 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-88028382-17f7-45c2-a955-bbc0e203fa89 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:28.728757 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-88028382-17f7-45c2-a955-bbc0e203fa89 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:28.743869 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-88028382-17f7-45c2-a955-bbc0e203fa89 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:28.744387 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-88028382-17f7-45c2-a955-bbc0e203fa89 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:28.746441 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-88028382-17f7-45c2-a955-bbc0e203fa89 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:28.747216 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-88028382-17f7-45c2-a955-bbc0e203fa89 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:28.806948 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a0316bfb-3108-4894-bfe2-61b02269e144 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.286911 Jul 12 11:56:28.812747 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 811/1748] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:56:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 2294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:56:28.827918 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8ac3faac-e7a1-4667-9dd1-fbb0a454b5d3 tempest-QuotaClassesAdmin257Test-860136622 tempest-QuotaClassesAdmin257Test-860136622-project-admin] Action: 'update', calling method: .version_select at 0x7f5e13b96310>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:28.831419 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:56:28.831419 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:56:28.962999 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8ac3faac-e7a1-4667-9dd1-fbb0a454b5d3 tempest-QuotaClassesAdmin257Test-860136622 tempest-QuotaClassesAdmin257Test-860136622-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.145942 Jul 12 11:56:28.965410 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 812/1749] 10.222.0.50 () {62 vars in 1246 bytes} [Tue Jul 12 11:56:28 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:56:28.979066 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2ef16d1b-75e1-4f07-9189-fb5c2198a42b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:28.991074 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2ef16d1b-75e1-4f07-9189-fb5c2198a42b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:29.021080 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2ef16d1b-75e1-4f07-9189-fb5c2198a42b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:29.022100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2ef16d1b-75e1-4f07-9189-fb5c2198a42b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:29.032420 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2ef16d1b-75e1-4f07-9189-fb5c2198a42b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:29.032893 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2ef16d1b-75e1-4f07-9189-fb5c2198a42b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:29.131222 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-88028382-17f7-45c2-a955-bbc0e203fa89 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:29.147932 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-88028382-17f7-45c2-a955-bbc0e203fa89 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1538 microversion: 2.1 time: 0.424182 Jul 12 11:56:29.151305 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 938/1750] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:28 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1538 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:29.164399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3104c3f4-2197-46fa-9a86-f78fb0528e39 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:29.165009 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3104c3f4-2197-46fa-9a86-f78fb0528e39 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:29.242464 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3104c3f4-2197-46fa-9a86-f78fb0528e39 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:29.260150 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3104c3f4-2197-46fa-9a86-f78fb0528e39 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 200 len: 1276 microversion: 2.1 time: 0.104459 Jul 12 11:56:29.272730 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 939/1751] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:29 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:29.284622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7ff62951-db0c-4313-bdf0-bd0ae32d374b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:29.303141 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7ff62951-db0c-4313-bdf0-bd0ae32d374b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:29.326411 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ff62951-db0c-4313-bdf0-bd0ae32d374b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:29.329650 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ff62951-db0c-4313-bdf0-bd0ae32d374b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:29.332749 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ff62951-db0c-4313-bdf0-bd0ae32d374b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:29.333216 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7ff62951-db0c-4313-bdf0-bd0ae32d374b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:29.902712 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2ef16d1b-75e1-4f07-9189-fb5c2198a42b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:29.920975 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2ef16d1b-75e1-4f07-9189-fb5c2198a42b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1199 microversion: 2.1 time: 0.952437 Jul 12 11:56:29.924940 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 813/1752] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:28 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1199 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:29.936083 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6019b268-398d-44e0-88b3-6f5a9c68036e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:29.937104 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6019b268-398d-44e0-88b3-6f5a9c68036e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:29.943207 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7ff62951-db0c-4313-bdf0-bd0ae32d374b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:29.960656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6019b268-398d-44e0-88b3-6f5a9c68036e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:29.960656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6019b268-398d-44e0-88b3-6f5a9c68036e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:29.961824 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6019b268-398d-44e0-88b3-6f5a9c68036e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:29.962299 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6019b268-398d-44e0-88b3-6f5a9c68036e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:29.972393 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7ff62951-db0c-4313-bdf0-bd0ae32d374b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:29.976383 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7ff62951-db0c-4313-bdf0-bd0ae32d374b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:29.979546 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7ff62951-db0c-4313-bdf0-bd0ae32d374b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1361 microversion: 2.25 time: 0.702849 Jul 12 11:56:29.982416 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 940/1753] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:29 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1361 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:30.170583 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-715a40c5-ca5a-401c-8cc9-bf98e193087c tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:30.171388 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-715a40c5-ca5a-401c-8cc9-bf98e193087c tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:30.198751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-715a40c5-ca5a-401c-8cc9-bf98e193087c tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:30.201362 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-715a40c5-ca5a-401c-8cc9-bf98e193087c tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:30.204552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-715a40c5-ca5a-401c-8cc9-bf98e193087c tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:30.206165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-715a40c5-ca5a-401c-8cc9-bf98e193087c tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:30.608978 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-715a40c5-ca5a-401c-8cc9-bf98e193087c tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:30.621545 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-715a40c5-ca5a-401c-8cc9-bf98e193087c tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1520 microversion: 2.1 time: 0.455524 Jul 12 11:56:30.637224 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 941/1754] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:30 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1520 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:30.649751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4c3fd868-5706-4a2a-843c-fb9b72b1da37 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:30.651050 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4c3fd868-5706-4a2a-843c-fb9b72b1da37 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:30.669066 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c3fd868-5706-4a2a-843c-fb9b72b1da37 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:30.671068 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c3fd868-5706-4a2a-843c-fb9b72b1da37 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:30.672011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c3fd868-5706-4a2a-843c-fb9b72b1da37 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:30.673651 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c3fd868-5706-4a2a-843c-fb9b72b1da37 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:30.812727 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4c3fd868-5706-4a2a-843c-fb9b72b1da37 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:30.827453 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4c3fd868-5706-4a2a-843c-fb9b72b1da37 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 200 len: 1328 microversion: 2.1 time: 0.188792 Jul 12 11:56:30.829011 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 942/1755] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:30 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 1328 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:30.842448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4c8627f8-6e0a-4c11-b71d-fafa10f8a2be tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:30.842958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4c8627f8-6e0a-4c11-b71d-fafa10f8a2be tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:30.854341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c8627f8-6e0a-4c11-b71d-fafa10f8a2be tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:30.859928 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c8627f8-6e0a-4c11-b71d-fafa10f8a2be tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:30.861022 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c8627f8-6e0a-4c11-b71d-fafa10f8a2be tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:30.861487 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c8627f8-6e0a-4c11-b71d-fafa10f8a2be tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:30.927898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4c8627f8-6e0a-4c11-b71d-fafa10f8a2be tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:56:31.119302 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4c8627f8-6e0a-4c11-b71d-fafa10f8a2be tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "DELETE /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 204 len: 0 microversion: 2.1 time: 0.288629 Jul 12 11:56:31.123408 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 943/1756] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:56:30 2022] DELETE /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:56:31.131832 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f3779bb6-0605-4c4e-a6d8-028332671585 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:31.134508 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f3779bb6-0605-4c4e-a6d8-028332671585 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:31.150599 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f3779bb6-0605-4c4e-a6d8-028332671585 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:31.150840 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f3779bb6-0605-4c4e-a6d8-028332671585 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:31.154883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f3779bb6-0605-4c4e-a6d8-028332671585 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:31.154883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f3779bb6-0605-4c4e-a6d8-028332671585 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:31.390242 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6019b268-398d-44e0-88b3-6f5a9c68036e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:31.399151 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6019b268-398d-44e0-88b3-6f5a9c68036e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1523 microversion: 2.1 time: 1.473079 Jul 12 11:56:31.406547 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 814/1757] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:29 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1523 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:31.414212 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-92f03da2-cfbb-4fe4-a758-cf06e417b54f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:31.417364 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-92f03da2-cfbb-4fe4-a758-cf06e417b54f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:31.433637 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-92f03da2-cfbb-4fe4-a758-cf06e417b54f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:31.434306 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-92f03da2-cfbb-4fe4-a758-cf06e417b54f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:31.435298 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-92f03da2-cfbb-4fe4-a758-cf06e417b54f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:31.436169 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-92f03da2-cfbb-4fe4-a758-cf06e417b54f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:31.451178 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f3779bb6-0605-4c4e-a6d8-028332671585 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:31.467411 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f3779bb6-0605-4c4e-a6d8-028332671585 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1199 microversion: 2.1 time: 0.342513 Jul 12 11:56:31.477208 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 944/1758] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:31 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1199 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:31.482495 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4c34b9bb-f6a7-4f49-a61c-1f5e84e7f86d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:31.483169 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4c34b9bb-f6a7-4f49-a61c-1f5e84e7f86d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:31.506303 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c34b9bb-f6a7-4f49-a61c-1f5e84e7f86d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:31.506767 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c34b9bb-f6a7-4f49-a61c-1f5e84e7f86d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:31.507558 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c34b9bb-f6a7-4f49-a61c-1f5e84e7f86d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:31.508001 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c34b9bb-f6a7-4f49-a61c-1f5e84e7f86d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:31.872443 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4c34b9bb-f6a7-4f49-a61c-1f5e84e7f86d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:31.887818 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4c34b9bb-f6a7-4f49-a61c-1f5e84e7f86d tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1526 microversion: 2.1 time: 0.408736 Jul 12 11:56:31.888862 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 945/1759] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:31 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1526 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:31.895428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c248b83e-0caa-4350-b7db-068a0971aaaa tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:31.896075 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c248b83e-0caa-4350-b7db-068a0971aaaa tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:31.906223 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c248b83e-0caa-4350-b7db-068a0971aaaa tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:31.906679 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c248b83e-0caa-4350-b7db-068a0971aaaa tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:31.907512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c248b83e-0caa-4350-b7db-068a0971aaaa tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:31.908228 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c248b83e-0caa-4350-b7db-068a0971aaaa tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:32.056169 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c248b83e-0caa-4350-b7db-068a0971aaaa tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:32.083179 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c248b83e-0caa-4350-b7db-068a0971aaaa tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 200 len: 1334 microversion: 2.1 time: 0.192796 Jul 12 11:56:32.094969 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 946/1760] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:31 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 1334 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:32.218031 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-92f03da2-cfbb-4fe4-a758-cf06e417b54f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:32.228339 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-92f03da2-cfbb-4fe4-a758-cf06e417b54f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:32.239284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-92f03da2-cfbb-4fe4-a758-cf06e417b54f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:32.244617 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-92f03da2-cfbb-4fe4-a758-cf06e417b54f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1361 microversion: 2.25 time: 0.834697 Jul 12 11:56:32.246786 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 815/1761] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:31 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1361 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:32.416954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fae79734-1089-4ecc-95fa-14567181c4af tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:32.420175 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fae79734-1089-4ecc-95fa-14567181c4af tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:32.441902 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fae79734-1089-4ecc-95fa-14567181c4af tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:32.443507 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fae79734-1089-4ecc-95fa-14567181c4af tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:32.445939 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fae79734-1089-4ecc-95fa-14567181c4af tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:32.446531 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fae79734-1089-4ecc-95fa-14567181c4af tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:32.496604 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-935bda73-d3e3-42d5-b175-b865b464ac64 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:32.498338 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-935bda73-d3e3-42d5-b175-b865b464ac64 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:32.525340 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-935bda73-d3e3-42d5-b175-b865b464ac64 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:32.530707 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-935bda73-d3e3-42d5-b175-b865b464ac64 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:32.538254 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-935bda73-d3e3-42d5-b175-b865b464ac64 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:32.544315 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-935bda73-d3e3-42d5-b175-b865b464ac64 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:33.006935 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fae79734-1089-4ecc-95fa-14567181c4af tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:33.020755 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fae79734-1089-4ecc-95fa-14567181c4af tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1523 microversion: 2.1 time: 0.607917 Jul 12 11:56:33.024762 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 947/1762] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:32 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1523 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:33.038012 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bfd40e2b-e124-42eb-8daa-2b239c06fbf2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:33.039585 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bfd40e2b-e124-42eb-8daa-2b239c06fbf2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:33.051340 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bfd40e2b-e124-42eb-8daa-2b239c06fbf2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:33.052279 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bfd40e2b-e124-42eb-8daa-2b239c06fbf2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:33.053322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bfd40e2b-e124-42eb-8daa-2b239c06fbf2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:33.053977 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bfd40e2b-e124-42eb-8daa-2b239c06fbf2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:33.091239 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-935bda73-d3e3-42d5-b175-b865b464ac64 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:33.103857 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-935bda73-d3e3-42d5-b175-b865b464ac64 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1199 microversion: 2.1 time: 0.615329 Jul 12 11:56:33.110849 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 816/1763] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:32 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1199 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:56:33.133691 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-db209d46-f5b4-4dc0-9691-9d6f091928bb tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:33.134387 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-db209d46-f5b4-4dc0-9691-9d6f091928bb tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:33.154986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db209d46-f5b4-4dc0-9691-9d6f091928bb tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:33.155446 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db209d46-f5b4-4dc0-9691-9d6f091928bb tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:33.156277 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db209d46-f5b4-4dc0-9691-9d6f091928bb tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:33.164149 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db209d46-f5b4-4dc0-9691-9d6f091928bb tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:33.552070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-db209d46-f5b4-4dc0-9691-9d6f091928bb tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:33.571205 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-db209d46-f5b4-4dc0-9691-9d6f091928bb tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 200 len: 1334 microversion: 2.1 time: 0.454318 Jul 12 11:56:33.571962 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 817/1764] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:33 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 1334 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:33.583985 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-672092dc-96b3-4f66-a487-0526ebbbfeca tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:33.586043 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-672092dc-96b3-4f66-a487-0526ebbbfeca tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:33.600760 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-672092dc-96b3-4f66-a487-0526ebbbfeca tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:33.605415 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-672092dc-96b3-4f66-a487-0526ebbbfeca tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:33.607382 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-672092dc-96b3-4f66-a487-0526ebbbfeca tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:33.611578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-672092dc-96b3-4f66-a487-0526ebbbfeca tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:33.707484 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bfd40e2b-e124-42eb-8daa-2b239c06fbf2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:33.718957 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bfd40e2b-e124-42eb-8daa-2b239c06fbf2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1526 microversion: 2.1 time: 0.692940 Jul 12 11:56:33.726488 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 948/1765] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:33 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1526 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:33.966762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-00ac25e9-a59d-4752-b2ac-a001089d4c9f req-d551443c-f3e6-415f-91cc-0a3466ff7b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fce2eb-25af-411c-ab0a-761bac343671", "name": "network-vif-plugged", "status": "completed", "tag": "cf0349c7-341e-4a91-9f8c-4f3ac688bd8c"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:33.984589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-00ac25e9-a59d-4752-b2ac-a001089d4c9f req-d551443c-f3e6-415f-91cc-0a3466ff7b8e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:33.986488 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-00ac25e9-a59d-4752-b2ac-a001089d4c9f req-d551443c-f3e6-415f-91cc-0a3466ff7b8e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:34.017502 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-00ac25e9-a59d-4752-b2ac-a001089d4c9f req-d551443c-f3e6-415f-91cc-0a3466ff7b8e service nova] Creating event network-vif-plugged:cf0349c7-341e-4a91-9f8c-4f3ac688bd8c for instance e9fce2eb-25af-411c-ab0a-761bac343671 on n-h2-849104-4 Jul 12 11:56:34.039844 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-00ac25e9-a59d-4752-b2ac-a001089d4c9f req-d551443c-f3e6-415f-91cc-0a3466ff7b8e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079856 Jul 12 11:56:34.042431 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 949/1766] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:56:34.060084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5014c5a9-d04e-4ac7-b9f8-43bd41b1dd75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:34.076740 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5014c5a9-d04e-4ac7-b9f8-43bd41b1dd75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:34.106362 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5014c5a9-d04e-4ac7-b9f8-43bd41b1dd75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:34.107256 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5014c5a9-d04e-4ac7-b9f8-43bd41b1dd75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:34.111103 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5014c5a9-d04e-4ac7-b9f8-43bd41b1dd75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:34.112495 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5014c5a9-d04e-4ac7-b9f8-43bd41b1dd75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:34.550323 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-672092dc-96b3-4f66-a487-0526ebbbfeca tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:34.560195 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5014c5a9-d04e-4ac7-b9f8-43bd41b1dd75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:34.567006 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:34.572687 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5014c5a9-d04e-4ac7-b9f8-43bd41b1dd75 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1523 microversion: 2.1 time: 0.525852 Jul 12 11:56:34.574000 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 950/1767] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:34 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1523 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:34.577480 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-672092dc-96b3-4f66-a487-0526ebbbfeca tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:34.589748 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-672092dc-96b3-4f66-a487-0526ebbbfeca tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:34.594122 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0b457960-f767-4b61-b84a-6e64fe1c3468 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:34.595026 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-672092dc-96b3-4f66-a487-0526ebbbfeca tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1361 microversion: 2.25 time: 1.020005 Jul 12 11:56:34.597831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0b457960-f767-4b61-b84a-6e64fe1c3468 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:34.598572 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 818/1768] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:33 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1361 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:34.622886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b457960-f767-4b61-b84a-6e64fe1c3468 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:34.624961 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b457960-f767-4b61-b84a-6e64fe1c3468 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:34.625598 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b457960-f767-4b61-b84a-6e64fe1c3468 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:34.626052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b457960-f767-4b61-b84a-6e64fe1c3468 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:34.628375 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7f280718-f97f-40fe-8701-a6ba5436f0a7 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:34.629196 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7f280718-f97f-40fe-8701-a6ba5436f0a7 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:34.653381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7f280718-f97f-40fe-8701-a6ba5436f0a7 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:34.656701 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7f280718-f97f-40fe-8701-a6ba5436f0a7 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:34.662223 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7f280718-f97f-40fe-8701-a6ba5436f0a7 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:34.663308 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7f280718-f97f-40fe-8701-a6ba5436f0a7 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:34.944329 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0b457960-f767-4b61-b84a-6e64fe1c3468 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:34.958201 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0b457960-f767-4b61-b84a-6e64fe1c3468 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1199 microversion: 2.1 time: 0.382557 Jul 12 11:56:34.974061 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 951/1769] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:34 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1199 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:34.997190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2820051d-6c31-42a1-ade3-5434235b4d4b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:35.001941 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2820051d-6c31-42a1-ade3-5434235b4d4b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:35.034674 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2820051d-6c31-42a1-ade3-5434235b4d4b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:35.036448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2820051d-6c31-42a1-ade3-5434235b4d4b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:35.039474 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2820051d-6c31-42a1-ade3-5434235b4d4b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:35.043135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2820051d-6c31-42a1-ade3-5434235b4d4b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:35.297693 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7f280718-f97f-40fe-8701-a6ba5436f0a7 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:35.313199 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7f280718-f97f-40fe-8701-a6ba5436f0a7 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 200 len: 1402 microversion: 2.1 time: 0.698322 Jul 12 11:56:35.317297 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 819/1770] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:34 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 1402 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:35.591440 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-47ddb692-d701-4dc0-b112-81e1ee777881 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:35.592792 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-47ddb692-d701-4dc0-b112-81e1ee777881 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:35.633047 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47ddb692-d701-4dc0-b112-81e1ee777881 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:35.637116 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47ddb692-d701-4dc0-b112-81e1ee777881 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:35.645579 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47ddb692-d701-4dc0-b112-81e1ee777881 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:35.647508 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47ddb692-d701-4dc0-b112-81e1ee777881 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:36.358012 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2820051d-6c31-42a1-ade3-5434235b4d4b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:36.402032 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2820051d-6c31-42a1-ade3-5434235b4d4b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 200 len: 1526 microversion: 2.1 time: 1.415516 Jul 12 11:56:36.404119 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 952/1771] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:34 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 1526 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:36.422531 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a0932b2e-39e2-486f-8ce0-d5b9d0c0b0ea tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:36.428539 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a0932b2e-39e2-486f-8ce0-d5b9d0c0b0ea tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:36.458200 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0932b2e-39e2-486f-8ce0-d5b9d0c0b0ea tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:36.463858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0932b2e-39e2-486f-8ce0-d5b9d0c0b0ea tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:36.468442 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0932b2e-39e2-486f-8ce0-d5b9d0c0b0ea tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:36.471868 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0932b2e-39e2-486f-8ce0-d5b9d0c0b0ea tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:36.932370 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a0932b2e-39e2-486f-8ce0-d5b9d0c0b0ea tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:36.951359 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a0932b2e-39e2-486f-8ce0-d5b9d0c0b0ea tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:36.960117 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a0932b2e-39e2-486f-8ce0-d5b9d0c0b0ea tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:36.962165 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a0932b2e-39e2-486f-8ce0-d5b9d0c0b0ea tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1558 microversion: 2.25 time: 0.556489 Jul 12 11:56:36.962936 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 953/1772] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:36 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1558 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:36.978339 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ddf74146-7c62-4ca1-a75b-a481fbedddae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:36.981827 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ddf74146-7c62-4ca1-a75b-a481fbedddae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:36.992893 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ddf74146-7c62-4ca1-a75b-a481fbedddae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:36.998337 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ddf74146-7c62-4ca1-a75b-a481fbedddae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:37.000237 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ddf74146-7c62-4ca1-a75b-a481fbedddae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:37.001709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ddf74146-7c62-4ca1-a75b-a481fbedddae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:37.494135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ddf74146-7c62-4ca1-a75b-a481fbedddae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:37.506790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-47ddb692-d701-4dc0-b112-81e1ee777881 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:37.519814 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-47ddb692-d701-4dc0-b112-81e1ee777881 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1523 microversion: 2.1 time: 1.932842 Jul 12 11:56:37.520434 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 820/1773] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:35 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1523 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:56:37.525347 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ddf74146-7c62-4ca1-a75b-a481fbedddae tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1199 microversion: 2.1 time: 0.561163 Jul 12 11:56:37.526041 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 954/1774] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:36 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1199 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:37.532744 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-d37d4bff-0242-4afc-b206-c75311587c51 req-1e27b23c-65e8-4ea0-b65b-59f91793ca90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c4b145-fdb3-4993-9354-f18a94e807ed", "name": "network-vif-plugged", "status": "completed", "tag": "8eee7d5e-b4aa-4c8c-b2f5-7184c099dee2"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:37.535564 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-db1e05bc-29d8-473f-b7f2-088dc400eb73 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:37.539771 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-db1e05bc-29d8-473f-b7f2-088dc400eb73 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:37.554514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db1e05bc-29d8-473f-b7f2-088dc400eb73 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:37.555252 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db1e05bc-29d8-473f-b7f2-088dc400eb73 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:37.557205 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d37d4bff-0242-4afc-b206-c75311587c51 req-1e27b23c-65e8-4ea0-b65b-59f91793ca90 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:37.562007 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db1e05bc-29d8-473f-b7f2-088dc400eb73 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:37.563824 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d37d4bff-0242-4afc-b206-c75311587c51 req-1e27b23c-65e8-4ea0-b65b-59f91793ca90 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:37.564388 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-db1e05bc-29d8-473f-b7f2-088dc400eb73 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:37.624235 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-d37d4bff-0242-4afc-b206-c75311587c51 req-1e27b23c-65e8-4ea0-b65b-59f91793ca90 service nova] Creating event network-vif-plugged:8eee7d5e-b4aa-4c8c-b2f5-7184c099dee2 for instance 00c4b145-fdb3-4993-9354-f18a94e807ed on n-h1-849104-4 Jul 12 11:56:37.652803 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-d37d4bff-0242-4afc-b206-c75311587c51 req-1e27b23c-65e8-4ea0-b65b-59f91793ca90 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125468 Jul 12 11:56:37.664412 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 955/1775] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:37.671719 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-e5f02f91-d421-4d00-88c2-e655f1d8c5c3 req-f3ad5a4f-9bce-4e6e-b253-f0744e2d18cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc3618a9-c706-4a66-8b04-e989cdeff839", "tag": "6927b294-4d68-4167-97e4-0188fa5d26fc"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:37.711294 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-e5f02f91-d421-4d00-88c2-e655f1d8c5c3 req-f3ad5a4f-9bce-4e6e-b253-f0744e2d18cc service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:37.711870 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-e5f02f91-d421-4d00-88c2-e655f1d8c5c3 req-f3ad5a4f-9bce-4e6e-b253-f0744e2d18cc service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:37.744586 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-e5f02f91-d421-4d00-88c2-e655f1d8c5c3 req-f3ad5a4f-9bce-4e6e-b253-f0744e2d18cc service nova] Creating event network-changed:6927b294-4d68-4167-97e4-0188fa5d26fc for instance cc3618a9-c706-4a66-8b04-e989cdeff839 on n-h1-849104-4 Jul 12 11:56:37.800383 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-e5f02f91-d421-4d00-88c2-e655f1d8c5c3 req-f3ad5a4f-9bce-4e6e-b253-f0744e2d18cc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132901 Jul 12 11:56:37.801557 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 956/1776] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:38.202307 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-db1e05bc-29d8-473f-b7f2-088dc400eb73 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:38.219628 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-db1e05bc-29d8-473f-b7f2-088dc400eb73 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 200 len: 1402 microversion: 2.1 time: 0.691499 Jul 12 11:56:38.222268 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 821/1777] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:37 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 1402 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:38.241642 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fca8b2ba-62fe-426c-bf16-284d251b50dc tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:38.242684 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fca8b2ba-62fe-426c-bf16-284d251b50dc tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:38.251747 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fca8b2ba-62fe-426c-bf16-284d251b50dc tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:38.257879 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fca8b2ba-62fe-426c-bf16-284d251b50dc tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:38.261620 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fca8b2ba-62fe-426c-bf16-284d251b50dc tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:38.262090 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fca8b2ba-62fe-426c-bf16-284d251b50dc tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:38.456511 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b20eb612-77f2-4c7b-8de3-898331286e3c tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Calling method '.version_select at 0x7f5e0a734d30>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:38.598637 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:38.616934 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b20eb612-77f2-4c7b-8de3-898331286e3c tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/6d21f6bc7d3744dc9652bce0c35573c5" status: 200 len: 371 microversion: 2.1 time: 0.390882 Jul 12 11:56:38.618947 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 822/1778] 10.222.0.50 () {58 vars in 1241 bytes} [Tue Jul 12 11:56:38 2022] GET /compute/v2.1/os-quota-sets/6d21f6bc7d3744dc9652bce0c35573c5 => generated 371 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:38.626035 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f177a667-6391-4182-b7d7-8896838cba43 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:38.627209 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f177a667-6391-4182-b7d7-8896838cba43 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:38.636674 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f177a667-6391-4182-b7d7-8896838cba43 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:38.637718 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f177a667-6391-4182-b7d7-8896838cba43 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:38.639291 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f177a667-6391-4182-b7d7-8896838cba43 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:38.640221 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f177a667-6391-4182-b7d7-8896838cba43 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:38.668454 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-fca8b2ba-62fe-426c-bf16-284d251b50dc tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'services' on Instance uuid e9fce2eb-25af-411c-ab0a-761bac343671 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:56:38.688518 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-f177a667-6391-4182-b7d7-8896838cba43 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] HTTP exception thrown: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f177a667-6391-4182-b7d7-8896838cba43 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Request method failure captured: Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed HTTP/1.1 Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWFAKIsN470Eihf_ppnEMm8ScuYYi-RlEoEhYKrKGQKnWRVVx8CL1_cx_wavxZ5Yb1nB9a1dc8SNphqIFzgLzRw54v5bQ1jw4-zQ4tTxc1iksIQtwaDQzo2UoXyxxwU1KRjPyEgUzHrMWJINvtRxEjh7-x3pnpa9F8J8cCj9xcSqENw Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8030002dc7940b0a1bdf4f252fd5a8c", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 0123721160c94b6785ed308618a2efc8 Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '00c4b145-fdb3-4993-9354-f18a94e807ed'} Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:38.698275 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:56:38.703608 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:38.703608 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:56:38.703608 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:56:38.703608 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:56:38.703608 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:56:38.703608 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:56:38.703608 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:56:38.703608 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:56:38.707520 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f177a667-6391-4182-b7d7-8896838cba43 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Returning 404 to user: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:56:38.708711 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f177a667-6391-4182-b7d7-8896838cba43 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 404 len: 111 microversion: 2.1 time: 0.088311 Jul 12 11:56:38.710078 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 823/1779] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:38 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:56:38.714936 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-963ff56d-0565-4d6b-8828-e5635fb647bd req-4f2d9c80-b071-4d63-93c8-a997ac350b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c4b145-fdb3-4993-9354-f18a94e807ed", "name": "network-vif-deleted", "tag": "8eee7d5e-b4aa-4c8c-b2f5-7184c099dee2"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:38.728450 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-963ff56d-0565-4d6b-8828-e5635fb647bd req-4f2d9c80-b071-4d63-93c8-a997ac350b10 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:38.729710 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fca8b2ba-62fe-426c-bf16-284d251b50dc tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 2050 microversion: 2.25 time: 0.926597 Jul 12 11:56:38.730279 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-963ff56d-0565-4d6b-8828-e5635fb647bd req-4f2d9c80-b071-4d63-93c8-a997ac350b10 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:38.730494 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 957/1780] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:37 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 2050 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:38.735127 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0770922b-2f85-4dff-88c7-d428d5f30238 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:38.735743 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0770922b-2f85-4dff-88c7-d428d5f30238 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:38.758152 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0770922b-2f85-4dff-88c7-d428d5f30238 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:38.758638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0770922b-2f85-4dff-88c7-d428d5f30238 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:38.759422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0770922b-2f85-4dff-88c7-d428d5f30238 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:38.760271 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0770922b-2f85-4dff-88c7-d428d5f30238 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:38.774063 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-963ff56d-0565-4d6b-8828-e5635fb647bd req-4f2d9c80-b071-4d63-93c8-a997ac350b10 service nova] Creating event network-vif-deleted:8eee7d5e-b4aa-4c8c-b2f5-7184c099dee2 for instance 00c4b145-fdb3-4993-9354-f18a94e807ed on n-h1-849104-4 Jul 12 11:56:38.784851 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-963ff56d-0565-4d6b-8828-e5635fb647bd req-4f2d9c80-b071-4d63-93c8-a997ac350b10 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073230 Jul 12 11:56:38.786135 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 824/1781] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:38.793931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e0c400f5-e1e3-4e84-a618-e313c03081af tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:38.794717 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e0c400f5-e1e3-4e84-a618-e313c03081af tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:38.804319 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0c400f5-e1e3-4e84-a618-e313c03081af tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:38.805624 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0c400f5-e1e3-4e84-a618-e313c03081af tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:38.807055 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0c400f5-e1e3-4e84-a618-e313c03081af tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:38.807729 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0c400f5-e1e3-4e84-a618-e313c03081af tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:38.818780 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:39.061003 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0770922b-2f85-4dff-88c7-d428d5f30238 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:39.071454 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0770922b-2f85-4dff-88c7-d428d5f30238 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1523 microversion: 2.1 time: 0.339783 Jul 12 11:56:39.075430 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 958/1782] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:38 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1523 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:39.089745 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dc1e6a8f-0e78-4e44-8a1a-7b907d9851ff tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Action: 'update', calling method: .version_select at 0x7f5e0999f5e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:39.263722 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:39.265393 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc1e6a8f-0e78-4e44-8a1a-7b907d9851ff tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:39.265862 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc1e6a8f-0e78-4e44-8a1a-7b907d9851ff tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:39.266692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc1e6a8f-0e78-4e44-8a1a-7b907d9851ff tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:39.267136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc1e6a8f-0e78-4e44-8a1a-7b907d9851ff tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:39.318123 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e0c400f5-e1e3-4e84-a618-e313c03081af tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:39.329568 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e0c400f5-e1e3-4e84-a618-e313c03081af tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1199 microversion: 2.1 time: 0.541196 Jul 12 11:56:39.335153 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 825/1783] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:38 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1199 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:39.344096 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fb42b462-ac23-4f17-a962-3f3b57d169c1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Action: 'create', calling method: .version_select at 0x7f5e13b9d670>, body: {"keypair": {"name": "tempest-keypair-2050432502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3edJl6Lot0K7aDXTclmoDHSOWjPIFGUKDyUJTfQVP4pVnGa7HHpWP1l5lzFXMyYw8bfypj3DzCqGB6z9nusWlZrq1xbNHpP1CITmuCyVGVHE33e01hQVuQmwL1Xx/QDw=="}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:39.389303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fb42b462-ac23-4f17-a962-3f3b57d169c1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Getting quotas for project d8030002dc7940b0a1bdf4f252fd5a8c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:56:39.407714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fb42b462-ac23-4f17-a962-3f3b57d169c1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Getting quotas for user 0123721160c94b6785ed308618a2efc8 and project d8030002dc7940b0a1bdf4f252fd5a8c. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:56:39.421633 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dc1e6a8f-0e78-4e44-8a1a-7b907d9851ff tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/6d21f6bc7d3744dc9652bce0c35573c5" status: 200 len: 328 microversion: 2.1 time: 0.344627 Jul 12 11:56:39.426410 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 959/1784] 10.222.0.50 () {60 vars in 1261 bytes} [Tue Jul 12 11:56:39 2022] PUT /compute/v2.1/os-quota-sets/6d21f6bc7d3744dc9652bce0c35573c5 => generated 328 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:39.439194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-360ffcc5-0c6d-4b7d-9fba-014daf09963a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:39.439829 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-360ffcc5-0c6d-4b7d-9fba-014daf09963a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:39.452981 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-360ffcc5-0c6d-4b7d-9fba-014daf09963a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:39.453676 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-360ffcc5-0c6d-4b7d-9fba-014daf09963a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:39.454486 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-360ffcc5-0c6d-4b7d-9fba-014daf09963a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:39.454835 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fb42b462-ac23-4f17-a962-3f3b57d169c1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114246 Jul 12 11:56:39.454966 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-360ffcc5-0c6d-4b7d-9fba-014daf09963a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:39.456427 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 826/1785] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 11:56:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:39.462912 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0c0d2861-5d5a-46eb-9e1e-f7979ac40690 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:39.463841 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0c0d2861-5d5a-46eb-9e1e-f7979ac40690 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:39.472479 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c0d2861-5d5a-46eb-9e1e-f7979ac40690 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:39.473299 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c0d2861-5d5a-46eb-9e1e-f7979ac40690 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:39.475646 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c0d2861-5d5a-46eb-9e1e-f7979ac40690 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:39.476465 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c0d2861-5d5a-46eb-9e1e-f7979ac40690 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:40.015113 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-360ffcc5-0c6d-4b7d-9fba-014daf09963a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'services' on Instance uuid e9fce2eb-25af-411c-ab0a-761bac343671 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:56:40.064500 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-360ffcc5-0c6d-4b7d-9fba-014daf09963a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 2050 microversion: 2.25 time: 0.635377 Jul 12 11:56:40.071081 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 960/1786] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:39 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 2050 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:40.086128 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a90bc9c1-707b-44a6-bade-381a06513951 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:40.113660 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a90bc9c1-707b-44a6-bade-381a06513951 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-quota-sets/6d21f6bc7d3744dc9652bce0c35573c5" status: 202 len: 0 microversion: 2.1 time: 0.040229 Jul 12 11:56:40.114319 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 961/1787] 10.222.0.50 () {58 vars in 1244 bytes} [Tue Jul 12 11:56:40 2022] DELETE /compute/v2.1/os-quota-sets/6d21f6bc7d3744dc9652bce0c35573c5 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:56:40.121519 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-1863508d-a8e0-47d3-a547-ee5adb6d5b32 req-fba0863f-fa91-4ff6-9b5a-4d7c8b8c8f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2fb044-0422-4634-bd32-08f216c8f6ab", "name": "network-vif-plugged", "status": "completed", "tag": "76d05327-fea5-4bb0-aa1a-55e0103cdbcf"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:40.142259 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-1863508d-a8e0-47d3-a547-ee5adb6d5b32 req-fba0863f-fa91-4ff6-9b5a-4d7c8b8c8f65 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:40.143312 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-1863508d-a8e0-47d3-a547-ee5adb6d5b32 req-fba0863f-fa91-4ff6-9b5a-4d7c8b8c8f65 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:40.172525 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-1863508d-a8e0-47d3-a547-ee5adb6d5b32 req-fba0863f-fa91-4ff6-9b5a-4d7c8b8c8f65 service nova] Creating event network-vif-plugged:76d05327-fea5-4bb0-aa1a-55e0103cdbcf for instance 1a2fb044-0422-4634-bd32-08f216c8f6ab on n-h2-849104-4 Jul 12 11:56:40.186624 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-1863508d-a8e0-47d3-a547-ee5adb6d5b32 req-fba0863f-fa91-4ff6-9b5a-4d7c8b8c8f65 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070720 Jul 12 11:56:40.187815 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 962/1788] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:40.206611 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3e31019e-7311-4cfc-b566-f100e74cd0f0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:40.214255 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:56:40.214255 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 11:56:40.229700 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3e31019e-7311-4cfc-b566-f100e74cd0f0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:40.232641 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3e31019e-7311-4cfc-b566-f100e74cd0f0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:40.235588 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3e31019e-7311-4cfc-b566-f100e74cd0f0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:40.236428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3e31019e-7311-4cfc-b566-f100e74cd0f0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:40.333783 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3e31019e-7311-4cfc-b566-f100e74cd0f0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.143132 Jul 12 11:56:40.340737 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 963/1789] 10.222.0.50 () {60 vars in 1216 bytes} [Tue Jul 12 11:56:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:56:40.365619 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cd65e01c-9f0f-49c7-992a-4bd944b7565f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:40.366373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cd65e01c-9f0f-49c7-992a-4bd944b7565f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:40.374494 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd65e01c-9f0f-49c7-992a-4bd944b7565f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:40.374955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd65e01c-9f0f-49c7-992a-4bd944b7565f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:40.375755 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd65e01c-9f0f-49c7-992a-4bd944b7565f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:40.376230 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd65e01c-9f0f-49c7-992a-4bd944b7565f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:40.832609 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0c0d2861-5d5a-46eb-9e1e-f7979ac40690 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:40.842026 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0c0d2861-5d5a-46eb-9e1e-f7979ac40690 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 200 len: 1402 microversion: 2.1 time: 1.384267 Jul 12 11:56:40.846859 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 827/1790] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:39 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 1402 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:40.865807 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-47eda336-e62a-4b95-96f6-29e7a8924145 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Calling method '.version_select at 0x7f5e0a8bc3a0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:40.959436 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cd65e01c-9f0f-49c7-992a-4bd944b7565f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:40.977713 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cd65e01c-9f0f-49c7-992a-4bd944b7565f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1523 microversion: 2.1 time: 0.635728 Jul 12 11:56:40.978543 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 964/1791] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:40 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1523 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:41.004247 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-709ee352-5e47-44a0-9eb1-9ee8b5ce7b3a tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Action: 'create', calling method: .version_select at 0x7f5e09949b80>, body: {"keypair": {"name": "tempest-keypair-180241138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8sMqCPcH5ufWrse6FuXkAK1mFzuem6aWtTH0aUl0avAGb/WMu2l8QiZbFTWTBFZeTut6L2lu2MVWz8KENAghYZbezZZQurb8tz6O2ojz0Nqk3EIeAQb6svpsDtbUkD/w=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:41.055453 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-709ee352-5e47-44a0-9eb1-9ee8b5ce7b3a tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Getting quotas for project f93f657cdcbc43d7bbb578d424322e05. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:56:41.102186 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=7 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:41.105046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-709ee352-5e47-44a0-9eb1-9ee8b5ce7b3a tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Getting quotas for user 9dbdfd4821d54068b9d88d02b7e4665f and project f93f657cdcbc43d7bbb578d424322e05. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:56:41.155245 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-47eda336-e62a-4b95-96f6-29e7a8924145 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/6d21f6bc7d3744dc9652bce0c35573c5" status: 200 len: 371 microversion: 2.1 time: 0.306007 Jul 12 11:56:41.156175 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 828/1792] 10.222.0.50 () {58 vars in 1241 bytes} [Tue Jul 12 11:56:40 2022] GET /compute/v2.1/os-quota-sets/6d21f6bc7d3744dc9652bce0c35573c5 => generated 371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:41.173664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-be94550b-61ef-4e0a-8890-3a75946862a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-849104-4", "block_migration": "auto"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:41.175585 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-be94550b-61ef-4e0a-8890-3a75946862a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:41.190034 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-709ee352-5e47-44a0-9eb1-9ee8b5ce7b3a tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.208667 Jul 12 11:56:41.192520 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 965/1793] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Jul 12 11:56:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 212 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 11:56:41.203259 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-be94550b-61ef-4e0a-8890-3a75946862a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:41.203488 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-be94550b-61ef-4e0a-8890-3a75946862a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:41.211363 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d5011f4f-b8c3-444e-81ff-120fb23aeb65 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:41.213152 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-be94550b-61ef-4e0a-8890-3a75946862a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:41.213313 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d5011f4f-b8c3-444e-81ff-120fb23aeb65 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:41.215987 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-be94550b-61ef-4e0a-8890-3a75946862a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:41.234933 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d5011f4f-b8c3-444e-81ff-120fb23aeb65 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:41.240596 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d5011f4f-b8c3-444e-81ff-120fb23aeb65 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:41.245735 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d5011f4f-b8c3-444e-81ff-120fb23aeb65 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:41.249386 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d5011f4f-b8c3-444e-81ff-120fb23aeb65 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:41.305848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-be94550b-61ef-4e0a-8890-3a75946862a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'flavor' on Instance uuid e9fce2eb-25af-411c-ab0a-761bac343671 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:56:41.391139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-be94550b-61ef-4e0a-8890-3a75946862a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Going to try to live migrate instance to n-h1-849104-4 {{(pid=125983) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 12 11:56:43.090873 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d5011f4f-b8c3-444e-81ff-120fb23aeb65 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:43.104662 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d5011f4f-b8c3-444e-81ff-120fb23aeb65 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1199 microversion: 2.1 time: 1.908453 Jul 12 11:56:43.107308 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 966/1794] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:41 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1199 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:43.123777 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-eba2b009-995a-4aa2-80fc-f06633c8676e tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Calling method '.version_select at 0x7f5e09a45af0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:44.012442 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-eba2b009-995a-4aa2-80fc-f06633c8676e tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/3d61a74904924ad1addecadf96c17f67/defaults" status: 200 len: 371 microversion: 2.1 time: 0.902786 Jul 12 11:56:44.014008 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 967/1795] 10.222.0.50 () {58 vars in 1268 bytes} [Tue Jul 12 11:56:43 2022] GET /compute/v2.1/os-quota-sets/3d61a74904924ad1addecadf96c17f67/defaults => generated 371 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:44.059338 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e3926607-cbdf-461e-ba8f-02505e881aee tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:44.066897 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e3926607-cbdf-461e-ba8f-02505e881aee tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:44.078557 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:44.122615 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e3926607-cbdf-461e-ba8f-02505e881aee tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:44.124288 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e3926607-cbdf-461e-ba8f-02505e881aee tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:44.126320 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e3926607-cbdf-461e-ba8f-02505e881aee tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:44.130280 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e3926607-cbdf-461e-ba8f-02505e881aee tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:44.590133 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e3926607-cbdf-461e-ba8f-02505e881aee tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:44.606686 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e3926607-cbdf-461e-ba8f-02505e881aee tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 200 len: 1402 microversion: 2.1 time: 0.591156 Jul 12 11:56:44.618501 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 968/1796] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:44 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 1402 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:44.630638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-504afd3c-b2f4-42be-b792-4f0c052de4ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:44.631267 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-504afd3c-b2f4-42be-b792-4f0c052de4ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:44.652867 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-504afd3c-b2f4-42be-b792-4f0c052de4ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:44.653469 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-504afd3c-b2f4-42be-b792-4f0c052de4ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:44.655711 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-504afd3c-b2f4-42be-b792-4f0c052de4ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:44.660621 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-504afd3c-b2f4-42be-b792-4f0c052de4ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:44.860480 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-504afd3c-b2f4-42be-b792-4f0c052de4ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:44.871645 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-504afd3c-b2f4-42be-b792-4f0c052de4ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1523 microversion: 2.1 time: 0.251430 Jul 12 11:56:44.873862 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 969/1797] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:44 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:44.882810 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-eda72f5f-99da-4816-bf9e-516b7155ccb3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:44.883840 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-eda72f5f-99da-4816-bf9e-516b7155ccb3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:44.897908 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eda72f5f-99da-4816-bf9e-516b7155ccb3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:44.898963 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eda72f5f-99da-4816-bf9e-516b7155ccb3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:44.899928 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eda72f5f-99da-4816-bf9e-516b7155ccb3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:44.900471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-eda72f5f-99da-4816-bf9e-516b7155ccb3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:45.219774 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-eda72f5f-99da-4816-bf9e-516b7155ccb3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:45.245510 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-eda72f5f-99da-4816-bf9e-516b7155ccb3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1381 microversion: 2.1 time: 0.370142 Jul 12 11:56:45.246478 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 970/1798] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:44 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1381 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:45.253603 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d4849150-587a-48f9-a757-9e75f85e6c69 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Action: 'update', calling method: .version_select at 0x7f5e09b29f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:45.637573 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d4849150-587a-48f9-a757-9e75f85e6c69 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:45.638769 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d4849150-587a-48f9-a757-9e75f85e6c69 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:45.644120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d4849150-587a-48f9-a757-9e75f85e6c69 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:45.644120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d4849150-587a-48f9-a757-9e75f85e6c69 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:45.755247 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d4849150-587a-48f9-a757-9e75f85e6c69 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/54c6268a66444f2b9212a2bab4aaf76c" status: 200 len: 328 microversion: 2.1 time: 0.507276 Jul 12 11:56:45.763058 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 971/1799] 10.222.0.50 () {60 vars in 1261 bytes} [Tue Jul 12 11:56:45 2022] PUT /compute/v2.1/os-quota-sets/54c6268a66444f2b9212a2bab4aaf76c => generated 328 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:45.776624 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-76acbbc3-10d6-4f45-ac1d-e93abdee185f req-2d380ce3-291f-4d8c-9dfc-7eb6f46d708c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc3618a9-c706-4a66-8b04-e989cdeff839", "name": "network-vif-plugged", "status": "completed", "tag": "6927b294-4d68-4167-97e4-0188fa5d26fc"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:45.805315 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-76acbbc3-10d6-4f45-ac1d-e93abdee185f req-2d380ce3-291f-4d8c-9dfc-7eb6f46d708c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:45.806228 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-76acbbc3-10d6-4f45-ac1d-e93abdee185f req-2d380ce3-291f-4d8c-9dfc-7eb6f46d708c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:45.834854 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-76acbbc3-10d6-4f45-ac1d-e93abdee185f req-2d380ce3-291f-4d8c-9dfc-7eb6f46d708c service nova] Creating event network-vif-plugged:6927b294-4d68-4167-97e4-0188fa5d26fc for instance cc3618a9-c706-4a66-8b04-e989cdeff839 on n-h1-849104-4 Jul 12 11:56:45.850847 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-76acbbc3-10d6-4f45-ac1d-e93abdee185f req-2d380ce3-291f-4d8c-9dfc-7eb6f46d708c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086292 Jul 12 11:56:45.852356 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 972/1800] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:46.315214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ee905e39-cb8c-4b27-a04b-5650437593d2 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:46.317656 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ee905e39-cb8c-4b27-a04b-5650437593d2 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:46.356932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ee905e39-cb8c-4b27-a04b-5650437593d2 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:46.364375 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ee905e39-cb8c-4b27-a04b-5650437593d2 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:46.366382 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ee905e39-cb8c-4b27-a04b-5650437593d2 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:46.375732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ee905e39-cb8c-4b27-a04b-5650437593d2 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:46.640527 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-be94550b-61ef-4e0a-8890-3a75946862a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671/action" status: 202 len: 0 microversion: 2.25 time: 5.482902 Jul 12 11:56:46.644181 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 829/1801] 10.222.0.50 () {62 vars in 1318 bytes} [Tue Jul 12 11:56:41 2022] POST /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671/action => generated 0 bytes in 5484 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:56:46.647660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-39d3ec63-4a5f-46bb-9434-56d443fc894b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:46.652297 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-39d3ec63-4a5f-46bb-9434-56d443fc894b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:46.702159 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-39d3ec63-4a5f-46bb-9434-56d443fc894b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:46.702864 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-39d3ec63-4a5f-46bb-9434-56d443fc894b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:46.707191 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-39d3ec63-4a5f-46bb-9434-56d443fc894b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:46.708658 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-39d3ec63-4a5f-46bb-9434-56d443fc894b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:46.869454 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ee905e39-cb8c-4b27-a04b-5650437593d2 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1532 microversion: 2.1 time: 1.012692 Jul 12 11:56:46.873228 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 973/1802] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:45 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1532 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:46.888102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-682ee452-c879-48b4-8347-a68c763d55f6 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Calling method '.version_select at 0x7f5e09a45670>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:47.026448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-682ee452-c879-48b4-8347-a68c763d55f6 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:47.026968 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-682ee452-c879-48b4-8347-a68c763d55f6 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:47.028140 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-682ee452-c879-48b4-8347-a68c763d55f6 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:47.029001 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-682ee452-c879-48b4-8347-a68c763d55f6 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:47.071247 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-682ee452-c879-48b4-8347-a68c763d55f6 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/54c6268a66444f2b9212a2bab4aaf76c/detail" status: 200 len: 916 microversion: 2.1 time: 0.193652 Jul 12 11:56:47.088763 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 974/1803] 10.222.0.50 () {58 vars in 1262 bytes} [Tue Jul 12 11:56:46 2022] GET /compute/v2.1/os-quota-sets/54c6268a66444f2b9212a2bab4aaf76c/detail => generated 916 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:47.101638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-97c56641-09b4-44e7-b058-bb28b49ab04e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:47.102824 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-97c56641-09b4-44e7-b058-bb28b49ab04e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:47.140408 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-97c56641-09b4-44e7-b058-bb28b49ab04e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:47.148251 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-97c56641-09b4-44e7-b058-bb28b49ab04e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:47.152923 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-97c56641-09b4-44e7-b058-bb28b49ab04e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:47.154084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-97c56641-09b4-44e7-b058-bb28b49ab04e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:47.162230 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:47.457992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-97c56641-09b4-44e7-b058-bb28b49ab04e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:47.467978 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-97c56641-09b4-44e7-b058-bb28b49ab04e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1523 microversion: 2.1 time: 0.377069 Jul 12 11:56:47.470033 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 975/1804] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:47 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1523 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:47.500253 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1309894329", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:47.590134 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] validate_networks() for [('f8b910a9-6171-418a-9231-00298dc40684', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:56:47.729934 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-39d3ec63-4a5f-46bb-9434-56d443fc894b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:47.763216 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-39d3ec63-4a5f-46bb-9434-56d443fc894b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 200 len: 1402 microversion: 2.1 time: 1.119742 Jul 12 11:56:47.775033 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 830/1805] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:46 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 1402 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:47.798827 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-810107ba-961b-4677-af21-dcb87f120752 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:47.807036 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-810107ba-961b-4677-af21-dcb87f120752 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:47.836760 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-810107ba-961b-4677-af21-dcb87f120752 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:47.840253 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-810107ba-961b-4677-af21-dcb87f120752 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:47.848225 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-810107ba-961b-4677-af21-dcb87f120752 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:47.850605 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-810107ba-961b-4677-af21-dcb87f120752 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:48.493649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-810107ba-961b-4677-af21-dcb87f120752 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:48.502703 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-810107ba-961b-4677-af21-dcb87f120752 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:48.504050 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-810107ba-961b-4677-af21-dcb87f120752 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:48.505351 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-810107ba-961b-4677-af21-dcb87f120752 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1568 microversion: 2.25 time: 0.728597 Jul 12 11:56:48.506019 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 831/1806] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:47 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1568 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:48.528889 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-171d5422-eeea-4168-99c9-a145e1cd5409 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:48.531934 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-171d5422-eeea-4168-99c9-a145e1cd5409 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:48.542078 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-171d5422-eeea-4168-99c9-a145e1cd5409 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:48.542287 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-171d5422-eeea-4168-99c9-a145e1cd5409 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:48.548194 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-171d5422-eeea-4168-99c9-a145e1cd5409 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:48.549657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-171d5422-eeea-4168-99c9-a145e1cd5409 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:48.680547 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:56:48.681078 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:56:48.681750 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:56:48.682258 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:56:48.682904 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:56:48.726338 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:48.730455 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:48.735502 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:48.744337 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:48.796894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Getting quotas for project d8030002dc7940b0a1bdf4f252fd5a8c. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:56:48.804732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Getting quotas for user 0123721160c94b6785ed308618a2efc8 and project d8030002dc7940b0a1bdf4f252fd5a8c. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:56:48.831180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:56:48.833942 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:56:48.912658 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-523bc8e2-5d58-466e-9d94-5ae960ef270e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.429109 Jul 12 11:56:48.915285 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 976/1807] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:56:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:56:48.923683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4c12cb83-2a82-4122-9a91-f341bee19e03 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Action: 'update', calling method: .version_select at 0x7f5e099491f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:49.039248 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c12cb83-2a82-4122-9a91-f341bee19e03 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:49.040132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c12cb83-2a82-4122-9a91-f341bee19e03 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:49.041174 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c12cb83-2a82-4122-9a91-f341bee19e03 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:49.041865 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c12cb83-2a82-4122-9a91-f341bee19e03 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:49.103901 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c12cb83-2a82-4122-9a91-f341bee19e03 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:49.104764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c12cb83-2a82-4122-9a91-f341bee19e03 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:49.105836 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c12cb83-2a82-4122-9a91-f341bee19e03 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:49.106512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c12cb83-2a82-4122-9a91-f341bee19e03 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:49.170392 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-171d5422-eeea-4168-99c9-a145e1cd5409 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1532 microversion: 2.1 time: 0.649035 Jul 12 11:56:49.176245 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 832/1808] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:48 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1532 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:49.200862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-042b569f-59a7-4b75-95b8-b9da768b4bf6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:49.203962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-042b569f-59a7-4b75-95b8-b9da768b4bf6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:49.239895 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-042b569f-59a7-4b75-95b8-b9da768b4bf6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:49.240400 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-042b569f-59a7-4b75-95b8-b9da768b4bf6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:49.242750 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-042b569f-59a7-4b75-95b8-b9da768b4bf6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:49.243190 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-042b569f-59a7-4b75-95b8-b9da768b4bf6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:49.246973 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4c12cb83-2a82-4122-9a91-f341bee19e03 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/54c6268a66444f2b9212a2bab4aaf76c?user_id=759fdf4ea4764c2fa963dd01a0f3e4ba" status: 200 len: 328 microversion: 2.1 time: 0.330250 Jul 12 11:56:49.248259 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 977/1809] 10.222.0.50 () {60 vars in 1342 bytes} [Tue Jul 12 11:56:48 2022] PUT /compute/v2.1/os-quota-sets/54c6268a66444f2b9212a2bab4aaf76c?user_id=759fdf4ea4764c2fa963dd01a0f3e4ba => generated 328 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:49.273262 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e08ac20c-2e14-434a-8188-af359e48313b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:49.274077 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e08ac20c-2e14-434a-8188-af359e48313b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:49.288943 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e08ac20c-2e14-434a-8188-af359e48313b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:49.289409 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e08ac20c-2e14-434a-8188-af359e48313b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:49.294732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e08ac20c-2e14-434a-8188-af359e48313b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:49.296899 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e08ac20c-2e14-434a-8188-af359e48313b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:49.970132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e08ac20c-2e14-434a-8188-af359e48313b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:49.989419 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e08ac20c-2e14-434a-8188-af359e48313b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 200 len: 1587 microversion: 2.1 time: 0.739900 Jul 12 11:56:49.990639 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 978/1810] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:49 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 1587 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:49.995704 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a2dd37b5-19d5-4851-87e0-8823ea389239 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:49.996601 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a2dd37b5-19d5-4851-87e0-8823ea389239 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:50.010430 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a2dd37b5-19d5-4851-87e0-8823ea389239 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:50.011911 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a2dd37b5-19d5-4851-87e0-8823ea389239 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:50.013051 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a2dd37b5-19d5-4851-87e0-8823ea389239 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:50.013746 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a2dd37b5-19d5-4851-87e0-8823ea389239 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:50.089119 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-042b569f-59a7-4b75-95b8-b9da768b4bf6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:50.101037 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-042b569f-59a7-4b75-95b8-b9da768b4bf6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1505 microversion: 2.1 time: 0.921766 Jul 12 11:56:50.109039 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 833/1811] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:49 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1505 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:50.114935 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-11f203ef-b411-4c01-87d5-18d97c59bc35 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:50.116671 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:56:50.116671 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:56:50.121318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11f203ef-b411-4c01-87d5-18d97c59bc35 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:50.122862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11f203ef-b411-4c01-87d5-18d97c59bc35 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:50.130237 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11f203ef-b411-4c01-87d5-18d97c59bc35 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:50.131104 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11f203ef-b411-4c01-87d5-18d97c59bc35 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:50.188349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a2dd37b5-19d5-4851-87e0-8823ea389239 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:50.194180 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-11f203ef-b411-4c01-87d5-18d97c59bc35 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.083245 Jul 12 11:56:50.199915 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a2dd37b5-19d5-4851-87e0-8823ea389239 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 200 len: 1221 microversion: 2.1 time: 0.207989 Jul 12 11:56:50.203226 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 979/1812] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:49 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 1221 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:50.213755 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e7803a83-05e1-4b35-8712-af90bcab4234 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Calling method '.version_select at 0x7f5e09a353a0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:50.214867 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 834/1813] 10.222.0.50 () {58 vars in 1175 bytes} [Tue Jul 12 11:56:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:50.232662 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1540331572", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6c136eb3-ff69-46d8-a4bd-8ffa84bd9bb8"}, {"port": "d2014975-7c3d-4b64-a57a-e0776062c564", "tag": "port-1"}, {"port": "adac38f7-95b5-450a-bafb-4f4a814fa426", "tag": "port-2"}, {"uuid": "2c63de11-ad5a-451e-ae60-faeef3854207", "tag": "net-1"}, {"uuid": "2c63de11-ad5a-451e-ae60-faeef3854207"}, {"uuid": "7fac9563-decd-45bc-be93-777c647f8f6b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7fac9563-decd-45bc-be93-777c647f8f6b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2d48535f-8adf-42ea-be68-ecf6acda3b16", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1d865a11-0bf2-481d-8071-e9d2c6f796c9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7c6b2648-9149-4689-bc50-a0402d1888ba", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1864137267"}], "key_name": "tempest-keypair-180241138", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:50.433220 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e7803a83-05e1-4b35-8712-af90bcab4234 tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/54c6268a66444f2b9212a2bab4aaf76c?user_id=759fdf4ea4764c2fa963dd01a0f3e4ba" status: 200 len: 370 microversion: 2.1 time: 0.224987 Jul 12 11:56:50.434185 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 980/1814] 10.222.0.50 () {58 vars in 1322 bytes} [Tue Jul 12 11:56:50 2022] GET /compute/v2.1/os-quota-sets/54c6268a66444f2b9212a2bab4aaf76c?user_id=759fdf4ea4764c2fa963dd01a0f3e4ba => generated 370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:50.448449 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6497b83b-ed84-425f-82b5-8dcbe55b821c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:50.450252 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6497b83b-ed84-425f-82b5-8dcbe55b821c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:50.461171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6497b83b-ed84-425f-82b5-8dcbe55b821c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:50.461850 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6497b83b-ed84-425f-82b5-8dcbe55b821c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:50.462839 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6497b83b-ed84-425f-82b5-8dcbe55b821c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:50.463964 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6497b83b-ed84-425f-82b5-8dcbe55b821c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:50.812433 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6497b83b-ed84-425f-82b5-8dcbe55b821c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:50.833780 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6497b83b-ed84-425f-82b5-8dcbe55b821c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:50.838838 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6497b83b-ed84-425f-82b5-8dcbe55b821c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:50.840340 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6497b83b-ed84-425f-82b5-8dcbe55b821c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1568 microversion: 2.25 time: 0.398673 Jul 12 11:56:50.841440 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 981/1815] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:50 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1568 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:50.847327 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-8fc99265-cb47-4a4d-908f-6cb171cfa4ea req-2b878939-3588-4a19-9561-6d2efc34b3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fce2eb-25af-411c-ab0a-761bac343671", "name": "network-vif-unplugged", "status": "completed", "tag": "cf0349c7-341e-4a91-9f8c-4f3ac688bd8c"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:50.857082 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-8fc99265-cb47-4a4d-908f-6cb171cfa4ea req-2b878939-3588-4a19-9561-6d2efc34b3a0 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:50.857832 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-8fc99265-cb47-4a4d-908f-6cb171cfa4ea req-2b878939-3588-4a19-9561-6d2efc34b3a0 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:50.874779 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-8fc99265-cb47-4a4d-908f-6cb171cfa4ea req-2b878939-3588-4a19-9561-6d2efc34b3a0 service nova] Creating event network-vif-unplugged:cf0349c7-341e-4a91-9f8c-4f3ac688bd8c for instance e9fce2eb-25af-411c-ab0a-761bac343671 on n-h2-849104-4 Jul 12 11:56:50.882095 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-8fc99265-cb47-4a4d-908f-6cb171cfa4ea req-2b878939-3588-4a19-9561-6d2efc34b3a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039149 Jul 12 11:56:50.888349 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 982/1816] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:50.897078 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a7260c5a-e5a9-46ee-b221-2cd29de55f0a tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:50.898004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a7260c5a-e5a9-46ee-b221-2cd29de55f0a tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:50.920412 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7260c5a-e5a9-46ee-b221-2cd29de55f0a tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:50.920894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7260c5a-e5a9-46ee-b221-2cd29de55f0a tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:50.926587 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7260c5a-e5a9-46ee-b221-2cd29de55f0a tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:50.927205 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7260c5a-e5a9-46ee-b221-2cd29de55f0a tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:51.070430 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a7260c5a-e5a9-46ee-b221-2cd29de55f0a tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179014 Jul 12 11:56:51.071409 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 983/1817] 10.222.0.50 () {58 vars in 1274 bytes} [Tue Jul 12 11:56:50 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:51.078844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dcad33d8-ed12-4f0c-96b3-ab900b0b27e0 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-849104-4", "block_migration": false, "disk_over_commit": false}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:51.083436 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dcad33d8-ed12-4f0c-96b3-ab900b0b27e0 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:51.108151 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=20 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:51.118482 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcad33d8-ed12-4f0c-96b3-ab900b0b27e0 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:51.125398 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcad33d8-ed12-4f0c-96b3-ab900b0b27e0 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:51.127277 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcad33d8-ed12-4f0c-96b3-ab900b0b27e0 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:51.129779 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcad33d8-ed12-4f0c-96b3-ab900b0b27e0 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:51.209433 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-dcad33d8-ed12-4f0c-96b3-ab900b0b27e0 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lazy-loading 'flavor' on Instance uuid 1a2fb044-0422-4634-bd32-08f216c8f6ab {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:56:51.251410 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dcad33d8-ed12-4f0c-96b3-ab900b0b27e0 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Going to try to live migrate instance to n-h1-849104-4 {{(pid=125984) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 12 11:56:51.858836 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] validate_networks() for [('6c136eb3-ff69-46d8-a4bd-8ffa84bd9bb8', None, None, None, None, None), (None, None, 'd2014975-7c3d-4b64-a57a-e0776062c564', None, None, None), (None, None, 'adac38f7-95b5-450a-bafb-4f4a814fa426', None, None, None), ('2c63de11-ad5a-451e-ae60-faeef3854207', None, None, None, None, None), ('2c63de11-ad5a-451e-ae60-faeef3854207', None, None, None, None, None), ('7fac9563-decd-45bc-be93-777c647f8f6b', '10.2.2.100', None, None, None, None), ('7fac9563-decd-45bc-be93-777c647f8f6b', '10.2.2.200', None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:56:56.228043 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dcad33d8-ed12-4f0c-96b3-ab900b0b27e0 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab/action" status: 202 len: 0 microversion: 2.1 time: 5.154534 Jul 12 11:56:56.229733 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 984/1818] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:56:51 2022] POST /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab/action => generated 0 bytes in 5158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:56:56.235494 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ea7bd74b-1fda-4533-912e-ca32dfbc779f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:56.242076 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ea7bd74b-1fda-4533-912e-ca32dfbc779f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:56.262135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ea7bd74b-1fda-4533-912e-ca32dfbc779f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:56.265644 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ea7bd74b-1fda-4533-912e-ca32dfbc779f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:56.269147 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ea7bd74b-1fda-4533-912e-ca32dfbc779f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:56.270065 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ea7bd74b-1fda-4533-912e-ca32dfbc779f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:56.645196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ea7bd74b-1fda-4533-912e-ca32dfbc779f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:56.665894 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ea7bd74b-1fda-4533-912e-ca32dfbc779f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 200 len: 1448 microversion: 2.1 time: 0.434919 Jul 12 11:56:56.666732 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 985/1819] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:56 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 1448 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:56.673096 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-346c9ea5-d850-4f6e-b6d1-25dbc14a3237 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:56.674761 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-346c9ea5-d850-4f6e-b6d1-25dbc14a3237 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:56.683789 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-346c9ea5-d850-4f6e-b6d1-25dbc14a3237 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:56.684805 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-346c9ea5-d850-4f6e-b6d1-25dbc14a3237 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:56.686117 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-346c9ea5-d850-4f6e-b6d1-25dbc14a3237 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:56.686746 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-346c9ea5-d850-4f6e-b6d1-25dbc14a3237 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:56.954291 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-346c9ea5-d850-4f6e-b6d1-25dbc14a3237 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:56.974994 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-346c9ea5-d850-4f6e-b6d1-25dbc14a3237 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 200 len: 1325 microversion: 2.1 time: 0.306342 Jul 12 11:56:56.976662 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 986/1820] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:56 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 1325 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:57.019351 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-afc34c7d-b7d7-42b1-bfa3-ff9c84ffabba tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Calling method '.version_select at 0x7f5e09a76ca0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:57.254972 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-afc34c7d-b7d7-42b1-bfa3-ff9c84ffabba tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/3d61a74904924ad1addecadf96c17f67/defaults" status: 200 len: 371 microversion: 2.1 time: 0.276467 Jul 12 11:56:57.256716 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 987/1821] 10.222.0.50 () {58 vars in 1268 bytes} [Tue Jul 12 11:56:56 2022] GET /compute/v2.1/os-quota-sets/3d61a74904924ad1addecadf96c17f67/defaults => generated 371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:57.262164 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7550d8a5-f8dd-45d8-8eb6-fc11dc6d37fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:57.263345 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7550d8a5-f8dd-45d8-8eb6-fc11dc6d37fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:57.272558 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7550d8a5-f8dd-45d8-8eb6-fc11dc6d37fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:57.273020 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7550d8a5-f8dd-45d8-8eb6-fc11dc6d37fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:57.274019 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7550d8a5-f8dd-45d8-8eb6-fc11dc6d37fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:57.274704 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7550d8a5-f8dd-45d8-8eb6-fc11dc6d37fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:57.434619 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7550d8a5-f8dd-45d8-8eb6-fc11dc6d37fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:57.448524 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7550d8a5-f8dd-45d8-8eb6-fc11dc6d37fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:57.450354 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7550d8a5-f8dd-45d8-8eb6-fc11dc6d37fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:57.451735 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7550d8a5-f8dd-45d8-8eb6-fc11dc6d37fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1568 microversion: 2.25 time: 0.193474 Jul 12 11:56:57.452326 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 988/1822] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:56:57 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:56:57.457318 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-5398a85b-d64a-45b5-9bd8-0150cbfe4151 req-23ea0321-6f9a-48e4-a5cc-2b6a8fd8d7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e416e34a-0097-4379-aa3d-6193730a9304", "name": "network-vif-unplugged", "status": "completed", "tag": "71279d83-e64a-4032-bd91-c8d30df42bf3"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:57.471159 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-5398a85b-d64a-45b5-9bd8-0150cbfe4151 req-23ea0321-6f9a-48e4-a5cc-2b6a8fd8d7c8 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:57.471695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-5398a85b-d64a-45b5-9bd8-0150cbfe4151 req-23ea0321-6f9a-48e4-a5cc-2b6a8fd8d7c8 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:57.484305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.compute.server_external_events [req-5398a85b-d64a-45b5-9bd8-0150cbfe4151 req-23ea0321-6f9a-48e4-a5cc-2b6a8fd8d7c8 service nova] Unable to find a host for instance e416e34a-0097-4379-aa3d-6193730a9304. Dropping event network-vif-unplugged {{(pid=125984) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 11:56:57.485381 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-5398a85b-d64a-45b5-9bd8-0150cbfe4151 req-23ea0321-6f9a-48e4-a5cc-2b6a8fd8d7c8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032110 Jul 12 11:56:57.486153 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 989/1823] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 11:56:57.493419 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-ee4df402-6604-41c3-86fd-a5a273630a21 req-6567b28a-8740-4fe4-9842-62b3bc160ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fce2eb-25af-411c-ab0a-761bac343671", "tag": "cf0349c7-341e-4a91-9f8c-4f3ac688bd8c"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:57.497214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:57.503740 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-ee4df402-6604-41c3-86fd-a5a273630a21 req-6567b28a-8740-4fe4-9842-62b3bc160ef3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:57.504224 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-ee4df402-6604-41c3-86fd-a5a273630a21 req-6567b28a-8740-4fe4-9842-62b3bc160ef3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:57.518021 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-ee4df402-6604-41c3-86fd-a5a273630a21 req-6567b28a-8740-4fe4-9842-62b3bc160ef3 service nova] Creating event network-changed:cf0349c7-341e-4a91-9f8c-4f3ac688bd8c for instance e9fce2eb-25af-411c-ab0a-761bac343671 on n-h2-849104-4 Jul 12 11:56:57.524318 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-ee4df402-6604-41c3-86fd-a5a273630a21 req-6567b28a-8740-4fe4-9842-62b3bc160ef3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035832 Jul 12 11:56:57.525328 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 990/1824] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:56:57.531210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c5e60694-2ab4-4fe3-9224-d96e6316ac57 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:57.531925 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c5e60694-2ab4-4fe3-9224-d96e6316ac57 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:57.539696 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c5e60694-2ab4-4fe3-9224-d96e6316ac57 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:57.540177 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c5e60694-2ab4-4fe3-9224-d96e6316ac57 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:57.540963 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c5e60694-2ab4-4fe3-9224-d96e6316ac57 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:57.541409 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c5e60694-2ab4-4fe3-9224-d96e6316ac57 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:57.834246 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c5e60694-2ab4-4fe3-9224-d96e6316ac57 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:57.857411 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c5e60694-2ab4-4fe3-9224-d96e6316ac57 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 200 len: 1587 microversion: 2.1 time: 0.327410 Jul 12 11:56:57.861493 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 991/1825] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:57 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 1587 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:57.877802 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-46922402-2705-43e3-8f0e-31b61d96f0de tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:57.878949 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-46922402-2705-43e3-8f0e-31b61d96f0de tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:57.886395 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46922402-2705-43e3-8f0e-31b61d96f0de tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:57.887709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46922402-2705-43e3-8f0e-31b61d96f0de tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:57.889021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46922402-2705-43e3-8f0e-31b61d96f0de tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:57.889021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46922402-2705-43e3-8f0e-31b61d96f0de tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:58.104503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-46922402-2705-43e3-8f0e-31b61d96f0de tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:56:58.133434 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-46922402-2705-43e3-8f0e-31b61d96f0de tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.264724 Jul 12 11:56:58.133434 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 992/1826] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:56:57 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:56:58.152378 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:56:58.153079 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:56:58.163699 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:58.168327 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:58.170459 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:58.173595 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:58.217471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:56:58.227542 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.compute.api [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Working on deleting snapshot 20a32f3f-0500-4f40-9146-16fd35cf84cc from shelved instance... Jul 12 11:56:58.500849 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:56:58.501447 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:56:58.503596 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:56:58.503596 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:56:58.503596 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:56:58.519678 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:58.520466 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:58.521600 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:58.522307 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:58.543480 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Getting quotas for project f93f657cdcbc43d7bbb578d424322e05. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:56:58.550240 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Getting quotas for user 9dbdfd4821d54068b9d88d02b7e4665f and project f93f657cdcbc43d7bbb578d424322e05. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:56:58.870915 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:56:58.873658 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2d48535f-8adf-42ea-be68-ecf6acda3b16',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1d865a11-0bf2-481d-8071-e9d2c6f796c9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c6b2648-9149-4689-bc50-a0402d1888ba',volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:56:59.126764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=15 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:56:59.253522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Doing local delete in cell dd950407-7fc7-406c-84b0-4304624ff8c8(cell1) {{(pid=125984) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 12 11:56:59.254607 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:59.255067 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:59.256687 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.compute.api [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 12 11:56:59.259446 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] deallocate_for_instance() {{(pid=125984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 12 11:56:59.454643 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fd8b8364-228e-42bf-b42e-6b82f4f10ecb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 9.237901 Jul 12 11:56:59.457407 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 835/1827] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Jul 12 11:56:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 9242 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 11:56:59.466717 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7d448be3-6080-4cd6-b34d-87ab931ca14a tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Action: 'update', calling method: .version_select at 0x7f5e13b5cca0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:56:59.578201 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7d448be3-6080-4cd6-b34d-87ab931ca14a tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:59.581398 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7d448be3-6080-4cd6-b34d-87ab931ca14a tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:56:59.582485 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7d448be3-6080-4cd6-b34d-87ab931ca14a tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:56:59.583165 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7d448be3-6080-4cd6-b34d-87ab931ca14a tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:00.029462 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7d448be3-6080-4cd6-b34d-87ab931ca14a tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/3d61a74904924ad1addecadf96c17f67" status: 200 len: 329 microversion: 2.1 time: 0.569586 Jul 12 11:57:00.033226 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 836/1828] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Jul 12 11:56:59 2022] PUT /compute/v2.1/os-quota-sets/3d61a74904924ad1addecadf96c17f67 => generated 329 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:00.038455 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-24f45ac0-c648-4f5d-85c0-0e5c33f7eb45 req-6efa7b47-8038-469a-9392-1d4069374dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fce2eb-25af-411c-ab0a-761bac343671", "name": "network-vif-unplugged", "status": "completed", "tag": "cf0349c7-341e-4a91-9f8c-4f3ac688bd8c"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:00.065196 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-24f45ac0-c648-4f5d-85c0-0e5c33f7eb45 req-6efa7b47-8038-469a-9392-1d4069374dd7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:00.069312 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-24f45ac0-c648-4f5d-85c0-0e5c33f7eb45 req-6efa7b47-8038-469a-9392-1d4069374dd7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:00.094540 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-24f45ac0-c648-4f5d-85c0-0e5c33f7eb45 req-6efa7b47-8038-469a-9392-1d4069374dd7 service nova] Creating event network-vif-unplugged:cf0349c7-341e-4a91-9f8c-4f3ac688bd8c for instance e9fce2eb-25af-411c-ab0a-761bac343671 on n-h1-849104-4 Jul 12 11:57:00.107213 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-24f45ac0-c648-4f5d-85c0-0e5c33f7eb45 req-6efa7b47-8038-469a-9392-1d4069374dd7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072468 Jul 12 11:57:00.107851 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 837/1829] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:00.123830 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c6b9ffe0-8eaa-4b8b-b81f-f9d88ca66a5a tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:00.124696 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c6b9ffe0-8eaa-4b8b-b81f-f9d88ca66a5a tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:00.137921 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c6b9ffe0-8eaa-4b8b-b81f-f9d88ca66a5a tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:00.138375 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c6b9ffe0-8eaa-4b8b-b81f-f9d88ca66a5a tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:00.139171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c6b9ffe0-8eaa-4b8b-b81f-f9d88ca66a5a tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:00.139618 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c6b9ffe0-8eaa-4b8b-b81f-f9d88ca66a5a tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:00.182837 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:00.195999 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Updating instance_info_cache with network_info: [] {{(pid=125984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 12 11:57:00.416694 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=43 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:00.545518 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-648b478e-e00f-40f7-a303-b6fe98a34851 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 204 len: 0 microversion: 2.1 time: 2.412394 Jul 12 11:57:00.546113 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 993/1830] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:56:58 2022] DELETE /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 0 bytes in 2414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:57:00.556401 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2803021a-7ac5-402d-a55c-e1d8ac1486e0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:00.556864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2803021a-7ac5-402d-a55c-e1d8ac1486e0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:00.569716 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2803021a-7ac5-402d-a55c-e1d8ac1486e0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:00.570241 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2803021a-7ac5-402d-a55c-e1d8ac1486e0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:00.571688 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2803021a-7ac5-402d-a55c-e1d8ac1486e0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:00.572274 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2803021a-7ac5-402d-a55c-e1d8ac1486e0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:00.584562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c6b9ffe0-8eaa-4b8b-b81f-f9d88ca66a5a tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:00.602448 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c6b9ffe0-8eaa-4b8b-b81f-f9d88ca66a5a tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 200 len: 1325 microversion: 2.1 time: 0.492615 Jul 12 11:57:00.605048 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 838/1831] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:00 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 1325 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:00.615423 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-019b1f10-4bb4-4cfc-8094-757ed0c74887 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:00.616097 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-019b1f10-4bb4-4cfc-8094-757ed0c74887 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:00.685968 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-019b1f10-4bb4-4cfc-8094-757ed0c74887 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:00.686295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-019b1f10-4bb4-4cfc-8094-757ed0c74887 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:00.689337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-019b1f10-4bb4-4cfc-8094-757ed0c74887 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:00.691635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-019b1f10-4bb4-4cfc-8094-757ed0c74887 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:00.901209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2803021a-7ac5-402d-a55c-e1d8ac1486e0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:00.926983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2803021a-7ac5-402d-a55c-e1d8ac1486e0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:00.938169 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2803021a-7ac5-402d-a55c-e1d8ac1486e0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:00.939479 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2803021a-7ac5-402d-a55c-e1d8ac1486e0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1558 microversion: 2.25 time: 0.387210 Jul 12 11:57:00.941065 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 994/1832] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:00 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1558 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:00.961834 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9a30039d-9943-4575-be31-a4cba4518b56 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:00.965065 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9a30039d-9943-4575-be31-a4cba4518b56 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:01.062460 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-019b1f10-4bb4-4cfc-8094-757ed0c74887 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:01.075058 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-019b1f10-4bb4-4cfc-8094-757ed0c74887 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.468897 Jul 12 11:57:01.089210 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 839/1833] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:00 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:01.105044 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-29fe7d1e-175c-415c-bc40-1bbcce08f8ba req-cf1d9ca1-a5a8-4e07-801c-1e64c55c2619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc3618a9-c706-4a66-8b04-e989cdeff839", "tag": "6927b294-4d68-4167-97e4-0188fa5d26fc"}, {"name": "network-changed", "server_uuid": "c0e18c84-bf65-4225-8a78-916f5fc8eb09", "tag": "57728dad-464c-42c6-8c57-46d595e636e6"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:01.110566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9a30039d-9943-4575-be31-a4cba4518b56 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:01.124072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-29fe7d1e-175c-415c-bc40-1bbcce08f8ba req-cf1d9ca1-a5a8-4e07-801c-1e64c55c2619 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:01.125239 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-29fe7d1e-175c-415c-bc40-1bbcce08f8ba req-cf1d9ca1-a5a8-4e07-801c-1e64c55c2619 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:01.131435 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9a30039d-9943-4575-be31-a4cba4518b56 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:01.133284 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9a30039d-9943-4575-be31-a4cba4518b56 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:01.134494 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9a30039d-9943-4575-be31-a4cba4518b56 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1285 microversion: 2.42 time: 0.192287 Jul 12 11:57:01.145385 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 995/1834] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:00 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:01.150611 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-29fe7d1e-175c-415c-bc40-1bbcce08f8ba req-cf1d9ca1-a5a8-4e07-801c-1e64c55c2619 service nova] Creating event network-changed:6927b294-4d68-4167-97e4-0188fa5d26fc for instance cc3618a9-c706-4a66-8b04-e989cdeff839 on n-h1-849104-4 Jul 12 11:57:01.151534 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-29fe7d1e-175c-415c-bc40-1bbcce08f8ba req-cf1d9ca1-a5a8-4e07-801c-1e64c55c2619 service nova] Creating event network-changed:57728dad-464c-42c6-8c57-46d595e636e6 for instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 on n-h1-849104-4 Jul 12 11:57:01.153519 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7fe887f8-ee1b-40d8-b96a-545b6008286c tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Action: 'update', calling method: .version_select at 0x7f5e09b71a60>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:01.167303 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-29fe7d1e-175c-415c-bc40-1bbcce08f8ba req-cf1d9ca1-a5a8-4e07-801c-1e64c55c2619 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072510 Jul 12 11:57:01.168810 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 840/1835] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:01.176193 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-167c5e17-75b3-49d7-8a45-5c63462722e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:01.193154 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-167c5e17-75b3-49d7-8a45-5c63462722e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:01.208392 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-167c5e17-75b3-49d7-8a45-5c63462722e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:01.208899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-167c5e17-75b3-49d7-8a45-5c63462722e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:01.210514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-167c5e17-75b3-49d7-8a45-5c63462722e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:01.214419 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-167c5e17-75b3-49d7-8a45-5c63462722e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:01.281479 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-167c5e17-75b3-49d7-8a45-5c63462722e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-167c5e17-75b3-49d7-8a45-5c63462722e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 HTTP/1.1 Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'e416e34a-0097-4379-aa3d-6193730a9304'} Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:01.285324 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:01.299894 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:01.299894 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:01.299894 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:01.299894 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:57:01.299894 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:57:01.299894 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:57:01.299894 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:01.299894 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-167c5e17-75b3-49d7-8a45-5c63462722e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:57:01.299894 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-167c5e17-75b3-49d7-8a45-5c63462722e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 404 len: 111 microversion: 2.1 time: 0.116682 Jul 12 11:57:01.299894 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 841/1836] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:01 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:57:01.323328 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-81f4edfe-abca-41d0-aafe-8687494f46ba tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '.version_select at 0x7f5e13b7cc10>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:01.330034 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-81f4edfe-abca-41d0-aafe-8687494f46ba tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:01.330633 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-81f4edfe-abca-41d0-aafe-8687494f46ba tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:01.396215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7fe887f8-ee1b-40d8-b96a-545b6008286c tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:01.396737 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7fe887f8-ee1b-40d8-b96a-545b6008286c tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:01.397383 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7fe887f8-ee1b-40d8-b96a-545b6008286c tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:01.397831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7fe887f8-ee1b-40d8-b96a-545b6008286c tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:01.404957 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-81f4edfe-abca-41d0-aafe-8687494f46ba tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 2359 microversion: 2.25 time: 0.064722 Jul 12 11:57:01.405669 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 842/1837] 10.222.0.50 () {60 vars in 1183 bytes} [Tue Jul 12 11:57:01 2022] GET /compute/v2.1/os-migrations => generated 2359 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:01.427360 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f4f9e285-b5e4-45bf-bc07-83cd99904517 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:01.439913 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f4f9e285-b5e4-45bf-bc07-83cd99904517 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:01.486571 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f4f9e285-b5e4-45bf-bc07-83cd99904517 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:01.490005 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f4f9e285-b5e4-45bf-bc07-83cd99904517 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:01.491630 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f4f9e285-b5e4-45bf-bc07-83cd99904517 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:01.501007 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f4f9e285-b5e4-45bf-bc07-83cd99904517 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:01.897465 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-f4f9e285-b5e4-45bf-bc07-83cd99904517 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'services' on Instance uuid e9fce2eb-25af-411c-ab0a-761bac343671 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:57:01.919904 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f4f9e285-b5e4-45bf-bc07-83cd99904517 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 2050 microversion: 2.25 time: 0.504152 Jul 12 11:57:01.920536 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 843/1838] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:01 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 2050 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:01.959471 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-622301853", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "24a2b846-48a0-496a-b982-522753a2dd1f"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:02.082799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] validate_networks() for [('24a2b846-48a0-496a-b982-522753a2dd1f', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:57:02.237241 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7fe887f8-ee1b-40d8-b96a-545b6008286c tempest-QuotasAdminTestJSON-1565917958 tempest-QuotasAdminTestJSON-1565917958-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/3d61a74904924ad1addecadf96c17f67" status: 200 len: 329 microversion: 2.1 time: 1.090223 Jul 12 11:57:02.238451 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 996/1839] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Jul 12 11:57:01 2022] PUT /compute/v2.1/os-quota-sets/3d61a74904924ad1addecadf96c17f67 => generated 329 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:02.245073 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d6fdd6b3-34ca-4eb9-8957-89d645869fcd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:02.262464 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d6fdd6b3-34ca-4eb9-8957-89d645869fcd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:02.289811 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6fdd6b3-34ca-4eb9-8957-89d645869fcd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:02.296984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6fdd6b3-34ca-4eb9-8957-89d645869fcd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:02.301199 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6fdd6b3-34ca-4eb9-8957-89d645869fcd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:02.302475 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6fdd6b3-34ca-4eb9-8957-89d645869fcd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:02.946972 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d6fdd6b3-34ca-4eb9-8957-89d645869fcd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:02.960788 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d6fdd6b3-34ca-4eb9-8957-89d645869fcd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 200 len: 1325 microversion: 2.1 time: 0.720852 Jul 12 11:57:02.962055 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 997/1840] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:02 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 1325 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:02.967810 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cb31ad3d-765e-4fea-a76e-261ea965c3db tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:02.969370 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cb31ad3d-765e-4fea-a76e-261ea965c3db tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:02.983880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb31ad3d-765e-4fea-a76e-261ea965c3db tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:02.992925 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb31ad3d-765e-4fea-a76e-261ea965c3db tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:02.993788 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb31ad3d-765e-4fea-a76e-261ea965c3db tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:02.994244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb31ad3d-765e-4fea-a76e-261ea965c3db tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:03.462098 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cb31ad3d-765e-4fea-a76e-261ea965c3db tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:03.470784 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cb31ad3d-765e-4fea-a76e-261ea965c3db tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.507349 Jul 12 11:57:03.478076 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 998/1841] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:02 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:03.483192 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6ff67951-05fc-4972-98c8-9cfaad88ec18 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:03.485697 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6ff67951-05fc-4972-98c8-9cfaad88ec18 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:03.508090 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ff67951-05fc-4972-98c8-9cfaad88ec18 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:03.508762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ff67951-05fc-4972-98c8-9cfaad88ec18 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:03.509610 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ff67951-05fc-4972-98c8-9cfaad88ec18 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:03.510137 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ff67951-05fc-4972-98c8-9cfaad88ec18 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:03.829465 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6ff67951-05fc-4972-98c8-9cfaad88ec18 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:03.852584 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6ff67951-05fc-4972-98c8-9cfaad88ec18 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:03.859453 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6ff67951-05fc-4972-98c8-9cfaad88ec18 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:03.866184 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6ff67951-05fc-4972-98c8-9cfaad88ec18 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1593 microversion: 2.42 time: 0.386696 Jul 12 11:57:03.866847 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 999/1842] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:03 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1593 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:03.883050 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1212275433", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "c11f1e67-c837-46a3-8b49-fe30b3169d9e"}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:03.999218 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] validate_networks() for [('c11f1e67-c837-46a3-8b49-fe30b3169d9e', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:57:04.029279 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:57:04.030636 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:57:04.032570 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:57:04.033933 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:57:04.034529 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:57:04.056493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:04.056951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:04.057797 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:04.058246 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:04.123820 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Getting quotas for project 6acea80b1e154ffcb3e657056d6e8dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:57:04.144493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Getting quotas for user 4c93078ac6044bf6b62ca073b3850016 and project 6acea80b1e154ffcb3e657056d6e8dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:57:04.169116 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=17 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:04.188762 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:57:04.197263 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:57:04.336837 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-85f46786-aae6-48dd-8f14-8f9c178bcc67 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.414012 Jul 12 11:57:04.337535 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 844/1843] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:57:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:57:04.373862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-88d4b37a-4f10-4371-a8e3-3bff99534dbf req-d96ba289-cfce-45f2-9c68-fe9c4423cec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e416e34a-0097-4379-aa3d-6193730a9304", "name": "network-vif-deleted", "tag": "71279d83-e64a-4032-bd91-c8d30df42bf3"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:04.407023 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-88d4b37a-4f10-4371-a8e3-3bff99534dbf req-d96ba289-cfce-45f2-9c68-fe9c4423cec2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:04.408869 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-88d4b37a-4f10-4371-a8e3-3bff99534dbf req-d96ba289-cfce-45f2-9c68-fe9c4423cec2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:04.431924 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.compute.server_external_events [req-88d4b37a-4f10-4371-a8e3-3bff99534dbf req-d96ba289-cfce-45f2-9c68-fe9c4423cec2 service nova] Unable to find a host for instance e416e34a-0097-4379-aa3d-6193730a9304. Dropping event network-vif-deleted {{(pid=125983) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 11:57:04.433231 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-88d4b37a-4f10-4371-a8e3-3bff99534dbf req-d96ba289-cfce-45f2-9c68-fe9c4423cec2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.085838 Jul 12 11:57:04.436234 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 845/1844] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 97 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 11:57:04.445428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c00f6af2-3ad3-4ce0-b988-2ad8d5fb7477 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:04.450970 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c00f6af2-3ad3-4ce0-b988-2ad8d5fb7477 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:04.464682 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c00f6af2-3ad3-4ce0-b988-2ad8d5fb7477 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:04.465341 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c00f6af2-3ad3-4ce0-b988-2ad8d5fb7477 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:04.466308 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c00f6af2-3ad3-4ce0-b988-2ad8d5fb7477 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:04.477660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c00f6af2-3ad3-4ce0-b988-2ad8d5fb7477 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:04.898458 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c00f6af2-3ad3-4ce0-b988-2ad8d5fb7477 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:04.906618 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c00f6af2-3ad3-4ce0-b988-2ad8d5fb7477 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 200 len: 1325 microversion: 2.1 time: 0.467650 Jul 12 11:57:04.912323 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 846/1845] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:04 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 1325 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:04.938322 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-82c5636b-a2f7-4b84-bdff-19f45b351622 req-a9fd7968-8108-456f-a84a-b0b6ae6a804e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e18c84-bf65-4225-8a78-916f5fc8eb09", "name": "network-vif-plugged", "status": "completed", "tag": "57728dad-464c-42c6-8c57-46d595e636e6"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:04.959041 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-82c5636b-a2f7-4b84-bdff-19f45b351622 req-a9fd7968-8108-456f-a84a-b0b6ae6a804e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:04.960051 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-82c5636b-a2f7-4b84-bdff-19f45b351622 req-a9fd7968-8108-456f-a84a-b0b6ae6a804e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:04.989665 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-82c5636b-a2f7-4b84-bdff-19f45b351622 req-a9fd7968-8108-456f-a84a-b0b6ae6a804e service nova] Creating event network-vif-plugged:57728dad-464c-42c6-8c57-46d595e636e6 for instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 on n-h1-849104-4 Jul 12 11:57:05.000059 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-82c5636b-a2f7-4b84-bdff-19f45b351622 req-a9fd7968-8108-456f-a84a-b0b6ae6a804e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086373 Jul 12 11:57:05.006949 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 847/1846] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:05.033114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e3dc28b2-001c-4487-91d8-181806ff94de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:05.033971 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e3dc28b2-001c-4487-91d8-181806ff94de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:05.289340 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e3dc28b2-001c-4487-91d8-181806ff94de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:05.306547 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e3dc28b2-001c-4487-91d8-181806ff94de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1214 microversion: 2.1 time: 0.295100 Jul 12 11:57:05.307143 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 848/1847] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:05 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1214 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:05.340725 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6f277f87-41e0-45b0-85ef-38a2d07c29b3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:05.341360 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6f277f87-41e0-45b0-85ef-38a2d07c29b3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:05.368269 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f277f87-41e0-45b0-85ef-38a2d07c29b3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:05.368818 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f277f87-41e0-45b0-85ef-38a2d07c29b3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:05.369663 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f277f87-41e0-45b0-85ef-38a2d07c29b3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:05.370863 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f277f87-41e0-45b0-85ef-38a2d07c29b3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:05.389113 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:05.774513 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6f277f87-41e0-45b0-85ef-38a2d07c29b3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:05.784703 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6f277f87-41e0-45b0-85ef-38a2d07c29b3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.461734 Jul 12 11:57:05.785292 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 849/1848] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:05 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:05.796203 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a0a33417-4c0f-43c9-a089-da6eed283d22 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:05.796819 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a0a33417-4c0f-43c9-a089-da6eed283d22 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:05.823906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a0a33417-4c0f-43c9-a089-da6eed283d22 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:05.825247 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a0a33417-4c0f-43c9-a089-da6eed283d22 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:05.826222 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a0a33417-4c0f-43c9-a089-da6eed283d22 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:05.826668 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a0a33417-4c0f-43c9-a089-da6eed283d22 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:06.143233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a0a33417-4c0f-43c9-a089-da6eed283d22 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:06.158567 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a0a33417-4c0f-43c9-a089-da6eed283d22 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:06.177080 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a0a33417-4c0f-43c9-a089-da6eed283d22 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:06.179739 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a0a33417-4c0f-43c9-a089-da6eed283d22 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1593 microversion: 2.42 time: 0.393330 Jul 12 11:57:06.184757 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 850/1849] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:05 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1593 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:06.210265 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0f208037-aaf6-4e54-baba-bb18960b3565 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:06.211002 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0f208037-aaf6-4e54-baba-bb18960b3565 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:06.238330 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0f208037-aaf6-4e54-baba-bb18960b3565 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:06.239980 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0f208037-aaf6-4e54-baba-bb18960b3565 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:06.240917 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0f208037-aaf6-4e54-baba-bb18960b3565 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:06.241467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0f208037-aaf6-4e54-baba-bb18960b3565 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:06.718311 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:57:06.718912 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:57:06.719213 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:57:06.719630 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:57:06.720093 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:57:06.730337 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:06.730792 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:06.731603 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:06.732285 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:06.763426 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=15,nova_api:INSERT=14 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:06.792330 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Getting quotas for project 29fd5f6c853549a794c75ebff736ccf4. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:57:06.807901 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Getting quotas for user ae0b32f84b7146d49338e7a2c06bc579 and project 29fd5f6c853549a794c75ebff736ccf4. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:57:06.845523 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0f208037-aaf6-4e54-baba-bb18960b3565 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:06.857522 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0f208037-aaf6-4e54-baba-bb18960b3565 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 200 len: 1325 microversion: 2.1 time: 0.670148 Jul 12 11:57:06.860329 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 851/1850] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:06 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 1325 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:06.867472 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-512ec1ce-73ba-4e20-898a-b23979cbe6de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:06.875040 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:57:06.889724 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:57:06.891086 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-512ec1ce-73ba-4e20-898a-b23979cbe6de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:06.924495 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-512ec1ce-73ba-4e20-898a-b23979cbe6de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:06.924956 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-512ec1ce-73ba-4e20-898a-b23979cbe6de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:06.925951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-512ec1ce-73ba-4e20-898a-b23979cbe6de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:06.926837 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-512ec1ce-73ba-4e20-898a-b23979cbe6de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:07.054708 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-17186791-39fa-49f2-966a-e005d1838911 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.186015 Jul 12 11:57:07.056408 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1000/1851] 10.222.0.50 () {62 vars in 1187 bytes} [Tue Jul 12 11:57:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3188 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 11:57:07.062199 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ed5df180-a0c7-4c09-a659-2fd320cea30c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:07.063163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ed5df180-a0c7-4c09-a659-2fd320cea30c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:07.075773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ed5df180-a0c7-4c09-a659-2fd320cea30c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:07.077018 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ed5df180-a0c7-4c09-a659-2fd320cea30c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:07.078603 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ed5df180-a0c7-4c09-a659-2fd320cea30c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:07.079318 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ed5df180-a0c7-4c09-a659-2fd320cea30c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:07.340769 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-512ec1ce-73ba-4e20-898a-b23979cbe6de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:07.354956 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-512ec1ce-73ba-4e20-898a-b23979cbe6de tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1272 microversion: 2.1 time: 0.491638 Jul 12 11:57:07.362978 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 852/1852] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:06 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1272 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:07.384994 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-930c59d5-e9c5-4f07-b130-30bc6af7d7f1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:07.392646 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-930c59d5-e9c5-4f07-b130-30bc6af7d7f1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:07.557067 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-930c59d5-e9c5-4f07-b130-30bc6af7d7f1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:07.568333 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-930c59d5-e9c5-4f07-b130-30bc6af7d7f1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:07.585603 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-930c59d5-e9c5-4f07-b130-30bc6af7d7f1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:07.590051 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-930c59d5-e9c5-4f07-b130-30bc6af7d7f1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1262 microversion: 2.25 time: 0.220783 Jul 12 11:57:07.591008 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 853/1853] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:07 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1262 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:07.597678 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d9e5d76c-3fe2-412f-a18e-e0207f1efe5c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:07.598702 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d9e5d76c-3fe2-412f-a18e-e0207f1efe5c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:07.606540 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d9e5d76c-3fe2-412f-a18e-e0207f1efe5c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:07.607281 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d9e5d76c-3fe2-412f-a18e-e0207f1efe5c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:07.608273 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d9e5d76c-3fe2-412f-a18e-e0207f1efe5c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:07.608986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d9e5d76c-3fe2-412f-a18e-e0207f1efe5c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:07.681261 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ed5df180-a0c7-4c09-a659-2fd320cea30c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:07.698480 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ed5df180-a0c7-4c09-a659-2fd320cea30c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.638855 Jul 12 11:57:07.700832 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1001/1854] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:07 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:07.879744 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c8adf8db-76e8-4e2f-a365-049e1a403427 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:07.880787 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c8adf8db-76e8-4e2f-a365-049e1a403427 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:07.897927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c8adf8db-76e8-4e2f-a365-049e1a403427 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:07.898549 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c8adf8db-76e8-4e2f-a365-049e1a403427 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:07.901596 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c8adf8db-76e8-4e2f-a365-049e1a403427 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:07.902551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c8adf8db-76e8-4e2f-a365-049e1a403427 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:07.960002 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d9e5d76c-3fe2-412f-a18e-e0207f1efe5c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:07.994665 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d9e5d76c-3fe2-412f-a18e-e0207f1efe5c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:07.999764 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d9e5d76c-3fe2-412f-a18e-e0207f1efe5c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:08.004881 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d9e5d76c-3fe2-412f-a18e-e0207f1efe5c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1661 microversion: 2.42 time: 0.408353 Jul 12 11:57:08.019563 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 854/1855] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:07 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1661 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:08.386453 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3ee20070-4bbb-4cb0-b1ed-896522ab6ec9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:08.388073 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3ee20070-4bbb-4cb0-b1ed-896522ab6ec9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:08.411225 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3ee20070-4bbb-4cb0-b1ed-896522ab6ec9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:08.411691 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3ee20070-4bbb-4cb0-b1ed-896522ab6ec9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:08.412521 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3ee20070-4bbb-4cb0-b1ed-896522ab6ec9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:08.412960 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3ee20070-4bbb-4cb0-b1ed-896522ab6ec9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:08.558082 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c8adf8db-76e8-4e2f-a365-049e1a403427 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:08.600286 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c8adf8db-76e8-4e2f-a365-049e1a403427 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 200 len: 1522 microversion: 2.1 time: 0.700398 Jul 12 11:57:08.601189 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1002/1856] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:07 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 1522 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:57:08.622070 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4c511dd3-8654-4b70-aefa-6439ef703d32 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:08.626114 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4c511dd3-8654-4b70-aefa-6439ef703d32 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:08.645837 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c511dd3-8654-4b70-aefa-6439ef703d32 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:08.648013 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c511dd3-8654-4b70-aefa-6439ef703d32 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:08.649717 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c511dd3-8654-4b70-aefa-6439ef703d32 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:08.650178 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c511dd3-8654-4b70-aefa-6439ef703d32 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:08.832120 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3ee20070-4bbb-4cb0-b1ed-896522ab6ec9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:08.843945 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3ee20070-4bbb-4cb0-b1ed-896522ab6ec9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1314 microversion: 2.1 time: 0.462701 Jul 12 11:57:08.854225 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 855/1857] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:08 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:08.863856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a4c62221-2899-45fe-8ccb-ed1a3102117b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:08.865994 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a4c62221-2899-45fe-8ccb-ed1a3102117b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:08.878297 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4c62221-2899-45fe-8ccb-ed1a3102117b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:08.883662 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4c62221-2899-45fe-8ccb-ed1a3102117b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:08.884962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4c62221-2899-45fe-8ccb-ed1a3102117b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:08.885729 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4c62221-2899-45fe-8ccb-ed1a3102117b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:08.933796 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4c511dd3-8654-4b70-aefa-6439ef703d32 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:08.947069 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4c511dd3-8654-4b70-aefa-6439ef703d32 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:08.949914 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4c511dd3-8654-4b70-aefa-6439ef703d32 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:08.986634 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4c511dd3-8654-4b70-aefa-6439ef703d32 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1314 microversion: 2.25 time: 0.374820 Jul 12 11:57:09.004415 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1003/1858] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:08 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:09.029111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a0d0e64b-a7cb-41f2-a028-51caaea3154b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:09.030097 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a0d0e64b-a7cb-41f2-a028-51caaea3154b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:09.045312 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0d0e64b-a7cb-41f2-a028-51caaea3154b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:09.047363 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0d0e64b-a7cb-41f2-a028-51caaea3154b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:09.049003 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0d0e64b-a7cb-41f2-a028-51caaea3154b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:09.052838 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a0d0e64b-a7cb-41f2-a028-51caaea3154b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:09.387773 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a4c62221-2899-45fe-8ccb-ed1a3102117b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:09.400175 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a4c62221-2899-45fe-8ccb-ed1a3102117b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 200 len: 1522 microversion: 2.1 time: 0.543602 Jul 12 11:57:09.402756 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 856/1859] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:08 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 1522 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:09.417381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e5389e75-db35-4cd1-a118-93a251e6a6ae tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:09.418326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e5389e75-db35-4cd1-a118-93a251e6a6ae tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:09.439313 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e5389e75-db35-4cd1-a118-93a251e6a6ae tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:09.442253 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e5389e75-db35-4cd1-a118-93a251e6a6ae tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:09.443419 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e5389e75-db35-4cd1-a118-93a251e6a6ae tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:09.445146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e5389e75-db35-4cd1-a118-93a251e6a6ae tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:09.601988 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a0d0e64b-a7cb-41f2-a028-51caaea3154b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:09.615196 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a0d0e64b-a7cb-41f2-a028-51caaea3154b tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.608904 Jul 12 11:57:09.616193 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1004/1860] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:09 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:09.623137 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c3f3cea3-1555-4b48-a441-e63daefd6bf1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-804067059"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:09.624276 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c3f3cea3-1555-4b48-a441-e63daefd6bf1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:09.633089 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c3f3cea3-1555-4b48-a441-e63daefd6bf1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:09.633578 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c3f3cea3-1555-4b48-a441-e63daefd6bf1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:09.637932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c3f3cea3-1555-4b48-a441-e63daefd6bf1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:09.646093 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c3f3cea3-1555-4b48-a441-e63daefd6bf1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:09.831864 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e5389e75-db35-4cd1-a118-93a251e6a6ae tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:09.850912 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e5389e75-db35-4cd1-a118-93a251e6a6ae tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:09.853462 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e5389e75-db35-4cd1-a118-93a251e6a6ae tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:09.855264 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e5389e75-db35-4cd1-a118-93a251e6a6ae tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1708 microversion: 2.42 time: 0.450942 Jul 12 11:57:09.869595 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 857/1861] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:09 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1708 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:09.875704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3a2fc51a-a791-4f61-943a-55b66a793c5d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:09.877650 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3a2fc51a-a791-4f61-943a-55b66a793c5d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:09.890442 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a2fc51a-a791-4f61-943a-55b66a793c5d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:09.891426 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a2fc51a-a791-4f61-943a-55b66a793c5d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:09.892900 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a2fc51a-a791-4f61-943a-55b66a793c5d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:09.893644 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a2fc51a-a791-4f61-943a-55b66a793c5d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:10.351211 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c3f3cea3-1555-4b48-a441-e63daefd6bf1 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "POST /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09/action" status: 202 len: 0 microversion: 2.1 time: 0.733644 Jul 12 11:57:10.358038 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1005/1862] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:57:09 2022] POST /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09/action => generated 0 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 12 11:57:10.394484 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dbd68e48-3d74-430d-803a-20baca14a545 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:10.404804 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dbd68e48-3d74-430d-803a-20baca14a545 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:10.419762 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3a2fc51a-a791-4f61-943a-55b66a793c5d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:10.426514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbd68e48-3d74-430d-803a-20baca14a545 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:10.427042 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbd68e48-3d74-430d-803a-20baca14a545 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:10.427734 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbd68e48-3d74-430d-803a-20baca14a545 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:10.428210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbd68e48-3d74-430d-803a-20baca14a545 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:10.431720 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3a2fc51a-a791-4f61-943a-55b66a793c5d tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1314 microversion: 2.1 time: 0.560585 Jul 12 11:57:10.435517 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 858/1863] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:09 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:10.459756 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bad5ccc7-9e36-4a4f-bc19-c4abc76fa53f tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '.version_select at 0x7f5e13b58f70>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:10.467628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:UPDATE=16,nova_cell1:SELECT=79,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:10.684668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dbd68e48-3d74-430d-803a-20baca14a545 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:10.694943 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dbd68e48-3d74-430d-803a-20baca14a545 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:10.702859 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dbd68e48-3d74-430d-803a-20baca14a545 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:10.708144 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dbd68e48-3d74-430d-803a-20baca14a545 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1320 microversion: 2.25 time: 0.325066 Jul 12 11:57:10.728107 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1006/1864] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:10 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1320 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:10.863912 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bad5ccc7-9e36-4a4f-bc19-c4abc76fa53f tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "DELETE /compute/v2.1/images/34f7a8c2-f921-4c1a-8d33-1a088393b8ce" status: 204 len: 0 microversion: 2.1 time: 0.425227 Jul 12 11:57:10.864986 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 859/1865] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:10 2022] DELETE /compute/v2.1/images/34f7a8c2-f921-4c1a-8d33-1a088393b8ce => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:57:10.876235 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cda84ba8-b8d1-40ce-8dd5-be52283c7884 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:10.878456 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cda84ba8-b8d1-40ce-8dd5-be52283c7884 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:10.899809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cda84ba8-b8d1-40ce-8dd5-be52283c7884 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:10.900340 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cda84ba8-b8d1-40ce-8dd5-be52283c7884 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:10.904708 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cda84ba8-b8d1-40ce-8dd5-be52283c7884 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:10.907552 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cda84ba8-b8d1-40ce-8dd5-be52283c7884 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:11.020794 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9287a84c-a38c-4aa7-85c0-f2dbc265e5bf tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Action: 'update', calling method: .version_select at 0x7f5e09ca1700>, body: {"quota_set": {"ram": "5120"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:11.162144 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9287a84c-a38c-4aa7-85c0-f2dbc265e5bf tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:11.162604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9287a84c-a38c-4aa7-85c0-f2dbc265e5bf tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:11.163427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9287a84c-a38c-4aa7-85c0-f2dbc265e5bf tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:11.163872 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9287a84c-a38c-4aa7-85c0-f2dbc265e5bf tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:11.260079 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-cda84ba8-b8d1-40ce-8dd5-be52283c7884 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:11.266425 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9287a84c-a38c-4aa7-85c0-f2dbc265e5bf tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/618f36143a0e45629a643b9f3c07d95f" status: 200 len: 240 microversion: 2.36 time: 0.536276 Jul 12 11:57:11.274163 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1007/1866] 10.222.0.50 () {62 vars in 1302 bytes} [Tue Jul 12 11:57:10 2022] PUT /compute/v2.1/os-quota-sets/618f36143a0e45629a643b9f3c07d95f => generated 240 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:57:11.280304 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-86229c52-6a0d-46f2-8976-02348f8fbde3 req-5a491932-48c6-4fc2-ac86-b69d3819a2bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6a507e-64a6-490c-8dbd-bf23feec571c", "tag": "ec142fac-be48-431f-8191-564d18afd7ca"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:11.282121 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cda84ba8-b8d1-40ce-8dd5-be52283c7884 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.415226 Jul 12 11:57:11.284891 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 860/1867] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:10 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:11.298887 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-412b7823-a31b-4a94-be48-af5c730e1e02 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '.version_select at 0x7f5e13ae9280>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:11.305530 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-86229c52-6a0d-46f2-8976-02348f8fbde3 req-5a491932-48c6-4fc2-ac86-b69d3819a2bd service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:11.306418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-86229c52-6a0d-46f2-8976-02348f8fbde3 req-5a491932-48c6-4fc2-ac86-b69d3819a2bd service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:11.336658 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-86229c52-6a0d-46f2-8976-02348f8fbde3 req-5a491932-48c6-4fc2-ac86-b69d3819a2bd service nova] Creating event network-changed:ec142fac-be48-431f-8191-564d18afd7ca for instance cd6a507e-64a6-490c-8dbd-bf23feec571c on n-h2-849104-4 Jul 12 11:57:11.353445 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-86229c52-6a0d-46f2-8976-02348f8fbde3 req-5a491932-48c6-4fc2-ac86-b69d3819a2bd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077672 Jul 12 11:57:11.354826 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1008/1868] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:11.355863 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-412b7823-a31b-4a94-be48-af5c730e1e02 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] HTTP exception thrown: Image not found. Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-412b7823-a31b-4a94-be48-af5c730e1e02 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Request method failure captured: Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/images/34f7a8c2-f921-4c1a-8d33-1a088393b8ce HTTP/1.1 Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWFAKIsN470Eihf_ppnEMm8ScuYYi-RlEoEhYKrKGQKnWRVVx8CL1_cx_wavxZ5Yb1nB9a1dc8SNphqIFzgLzRw54v5bQ1jw4-zQ4tTxc1iksIQtwaDQzo2UoXyxxwU1KRjPyEgUzHrMWJINvtRxEjh7-x3pnpa9F8J8cCj9xcSqENw Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8030002dc7940b0a1bdf4f252fd5a8c", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 0123721160c94b6785ed308618a2efc8 Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: exception: Image not found. Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '34f7a8c2-f921-4c1a-8d33-1a088393b8ce'} Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 34f7a8c2-f921-4c1a-8d33-1a088393b8ce Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 12 11:57:11.360325 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 34f7a8c2-f921-4c1a-8d33-1a088393b8ce could not be found. Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-412b7823-a31b-4a94-be48-af5c730e1e02 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Returning 404 to user: Image not found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-412b7823-a31b-4a94-be48-af5c730e1e02 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/images/34f7a8c2-f921-4c1a-8d33-1a088393b8ce" status: 404 len: 62 microversion: 2.1 time: 0.074519 Jul 12 11:57:11.367826 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 861/1869] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 11:57:11 2022] GET /compute/v2.1/images/34f7a8c2-f921-4c1a-8d33-1a088393b8ce => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:57:11.378821 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bfb7ee30-fa22-451c-a450-80bde3785989 tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Calling method '.version_select at 0x7f5e0a88f940>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:11.379130 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6ee97bdd-4053-432f-8577-1969a6670fb5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:11.381420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6ee97bdd-4053-432f-8577-1969a6670fb5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:11.390675 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ee97bdd-4053-432f-8577-1969a6670fb5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:11.391642 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ee97bdd-4053-432f-8577-1969a6670fb5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:11.393360 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ee97bdd-4053-432f-8577-1969a6670fb5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:11.394032 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ee97bdd-4053-432f-8577-1969a6670fb5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:11.522438 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bfb7ee30-fa22-451c-a450-80bde3785989 tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:11.524277 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bfb7ee30-fa22-451c-a450-80bde3785989 tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:11.525718 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bfb7ee30-fa22-451c-a450-80bde3785989 tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:11.528447 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bfb7ee30-fa22-451c-a450-80bde3785989 tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:11.616449 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bfb7ee30-fa22-451c-a450-80bde3785989 tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/618f36143a0e45629a643b9f3c07d95f/detail" status: 200 len: 672 microversion: 2.36 time: 0.249946 Jul 12 11:57:11.618383 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 862/1870] 10.222.0.50 () {60 vars in 1303 bytes} [Tue Jul 12 11:57:11 2022] GET /compute/v2.1/os-quota-sets/618f36143a0e45629a643b9f3c07d95f/detail => generated 672 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:57:11.652157 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c47755bd-7cce-4751-a4a5-818644f93557 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:11.660663 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c47755bd-7cce-4751-a4a5-818644f93557 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:11.694649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c47755bd-7cce-4751-a4a5-818644f93557 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:11.699127 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c47755bd-7cce-4751-a4a5-818644f93557 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:11.704797 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c47755bd-7cce-4751-a4a5-818644f93557 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:11.706397 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c47755bd-7cce-4751-a4a5-818644f93557 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:12.006787 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6ee97bdd-4053-432f-8577-1969a6670fb5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:12.023511 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6ee97bdd-4053-432f-8577-1969a6670fb5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:12.026859 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6ee97bdd-4053-432f-8577-1969a6670fb5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:12.033041 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6ee97bdd-4053-432f-8577-1969a6670fb5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1755 microversion: 2.42 time: 0.674157 Jul 12 11:57:12.036403 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1009/1871] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:11 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1755 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:12.046350 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4e9cdca8-e758-4afc-a899-69e187ec2c71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:12.049714 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4e9cdca8-e758-4afc-a899-69e187ec2c71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:12.065229 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4e9cdca8-e758-4afc-a899-69e187ec2c71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:12.065785 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4e9cdca8-e758-4afc-a899-69e187ec2c71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:12.068638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4e9cdca8-e758-4afc-a899-69e187ec2c71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:12.069087 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4e9cdca8-e758-4afc-a899-69e187ec2c71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:12.271260 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c47755bd-7cce-4751-a4a5-818644f93557 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:12.281106 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c47755bd-7cce-4751-a4a5-818644f93557 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 200 len: 1540 microversion: 2.1 time: 0.661387 Jul 12 11:57:12.282290 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 863/1872] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:11 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 1540 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:12.287790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-34a43cf3-0d67-4afc-bec5-4c72a644d754 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:12.288760 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-34a43cf3-0d67-4afc-bec5-4c72a644d754 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:12.297240 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-34a43cf3-0d67-4afc-bec5-4c72a644d754 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:12.298743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-34a43cf3-0d67-4afc-bec5-4c72a644d754 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:12.299860 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-34a43cf3-0d67-4afc-bec5-4c72a644d754 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:12.300572 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-34a43cf3-0d67-4afc-bec5-4c72a644d754 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:12.480981 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-34a43cf3-0d67-4afc-bec5-4c72a644d754 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:12.498314 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-34a43cf3-0d67-4afc-bec5-4c72a644d754 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:12.500698 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-34a43cf3-0d67-4afc-bec5-4c72a644d754 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:12.502566 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-34a43cf3-0d67-4afc-bec5-4c72a644d754 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1362 microversion: 2.25 time: 0.218925 Jul 12 11:57:12.503822 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 864/1873] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:12 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:12.509195 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-159b5a3a-822e-42b6-9c88-ea366c82092b tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Action: 'update', calling method: .version_select at 0x7f5e13b06430>, body: {"quota_set": {"ram": "2048"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:12.593226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-159b5a3a-822e-42b6-9c88-ea366c82092b tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:12.593877 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-159b5a3a-822e-42b6-9c88-ea366c82092b tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:12.594990 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-159b5a3a-822e-42b6-9c88-ea366c82092b tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:12.596125 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-159b5a3a-822e-42b6-9c88-ea366c82092b tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:12.649671 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-159b5a3a-822e-42b6-9c88-ea366c82092b tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:12.650220 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-159b5a3a-822e-42b6-9c88-ea366c82092b tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:12.651219 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-159b5a3a-822e-42b6-9c88-ea366c82092b tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:12.651757 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-159b5a3a-822e-42b6-9c88-ea366c82092b tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:12.742936 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-159b5a3a-822e-42b6-9c88-ea366c82092b tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/618f36143a0e45629a643b9f3c07d95f?user_id=4b5e56f0cb4b451eb3eff0c6edb5e6de" status: 200 len: 240 microversion: 2.36 time: 0.237415 Jul 12 11:57:12.744905 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 865/1874] 10.222.0.50 () {62 vars in 1383 bytes} [Tue Jul 12 11:57:12 2022] PUT /compute/v2.1/os-quota-sets/618f36143a0e45629a643b9f3c07d95f?user_id=4b5e56f0cb4b451eb3eff0c6edb5e6de => generated 240 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:57:12.757858 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-10284381-e552-4e3a-a584-0ce6cfc54e52 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:12.758873 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-10284381-e552-4e3a-a584-0ce6cfc54e52 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:12.770165 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-10284381-e552-4e3a-a584-0ce6cfc54e52 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:12.770928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-10284381-e552-4e3a-a584-0ce6cfc54e52 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:12.771934 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-10284381-e552-4e3a-a584-0ce6cfc54e52 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:12.772840 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-10284381-e552-4e3a-a584-0ce6cfc54e52 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:12.942640 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-10284381-e552-4e3a-a584-0ce6cfc54e52 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:12.956093 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-10284381-e552-4e3a-a584-0ce6cfc54e52 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.209661 Jul 12 11:57:12.957501 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 866/1875] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:12 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:12.962610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-39721a89-02d4-47db-bbf8-16fbbde8f634 tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] Calling method '.version_select at 0x7f5e13b88ee0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:13.114611 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-39721a89-02d4-47db-bbf8-16fbbde8f634 tempest-QuotasAdminTestV236-310967689 tempest-QuotasAdminTestV236-310967689-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/618f36143a0e45629a643b9f3c07d95f?user_id=4b5e56f0cb4b451eb3eff0c6edb5e6de" status: 200 len: 282 microversion: 2.36 time: 0.155624 Jul 12 11:57:13.126787 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 867/1876] 10.222.0.50 () {60 vars in 1363 bytes} [Tue Jul 12 11:57:12 2022] GET /compute/v2.1/os-quota-sets/618f36143a0e45629a643b9f3c07d95f?user_id=4b5e56f0cb4b451eb3eff0c6edb5e6de => generated 282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:57:13.132287 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9ad9dd0e-c7a5-4fcd-8860-dc2d2e27428e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:13.136840 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9ad9dd0e-c7a5-4fcd-8860-dc2d2e27428e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:13.145488 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ad9dd0e-c7a5-4fcd-8860-dc2d2e27428e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:13.145947 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ad9dd0e-c7a5-4fcd-8860-dc2d2e27428e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:13.146739 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ad9dd0e-c7a5-4fcd-8860-dc2d2e27428e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:13.147184 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ad9dd0e-c7a5-4fcd-8860-dc2d2e27428e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:13.229695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4e9cdca8-e758-4afc-a899-69e187ec2c71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:13.239059 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4e9cdca8-e758-4afc-a899-69e187ec2c71 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1314 microversion: 2.1 time: 1.201043 Jul 12 11:57:13.245242 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1010/1877] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:12 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1314 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:13.304300 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4116d0cb-1719-4a1a-80a1-d739cd47e0f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:13.305627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4116d0cb-1719-4a1a-80a1-d739cd47e0f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:13.320067 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4116d0cb-1719-4a1a-80a1-d739cd47e0f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:13.322278 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4116d0cb-1719-4a1a-80a1-d739cd47e0f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:13.324892 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4116d0cb-1719-4a1a-80a1-d739cd47e0f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:13.326426 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4116d0cb-1719-4a1a-80a1-d739cd47e0f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:13.604000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9ad9dd0e-c7a5-4fcd-8860-dc2d2e27428e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:13.621926 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9ad9dd0e-c7a5-4fcd-8860-dc2d2e27428e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:13.623507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9ad9dd0e-c7a5-4fcd-8860-dc2d2e27428e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:13.627677 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9ad9dd0e-c7a5-4fcd-8860-dc2d2e27428e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1755 microversion: 2.42 time: 0.499290 Jul 12 11:57:13.628811 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 868/1878] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:13 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1755 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:13.635916 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-55a85f97-424d-4c9f-a3e1-4424f44ce10f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:13.635916 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-55a85f97-424d-4c9f-a3e1-4424f44ce10f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:13.658775 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55a85f97-424d-4c9f-a3e1-4424f44ce10f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:13.659412 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55a85f97-424d-4c9f-a3e1-4424f44ce10f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:13.677137 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55a85f97-424d-4c9f-a3e1-4424f44ce10f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:13.682960 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55a85f97-424d-4c9f-a3e1-4424f44ce10f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:13.934885 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4116d0cb-1719-4a1a-80a1-d739cd47e0f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:13.956096 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4116d0cb-1719-4a1a-80a1-d739cd47e0f6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 200 len: 1540 microversion: 2.1 time: 0.655887 Jul 12 11:57:13.972722 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1011/1879] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:13 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 1540 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:57:13.982518 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1128af4f-a2a6-4c88-8e2a-ab9931186ae9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:13.983561 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1128af4f-a2a6-4c88-8e2a-ab9931186ae9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:14.002282 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1128af4f-a2a6-4c88-8e2a-ab9931186ae9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:14.007671 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1128af4f-a2a6-4c88-8e2a-ab9931186ae9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:14.009380 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1128af4f-a2a6-4c88-8e2a-ab9931186ae9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:14.012911 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1128af4f-a2a6-4c88-8e2a-ab9931186ae9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:14.064081 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-55a85f97-424d-4c9f-a3e1-4424f44ce10f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:14.077693 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-55a85f97-424d-4c9f-a3e1-4424f44ce10f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:14.081777 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-55a85f97-424d-4c9f-a3e1-4424f44ce10f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:14.085339 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-55a85f97-424d-4c9f-a3e1-4424f44ce10f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1362 microversion: 2.25 time: 0.455506 Jul 12 11:57:14.089103 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 869/1880] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:13 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:14.264792 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b93652fb-28b5-4441-83ff-92a11770580f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:14.266092 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b93652fb-28b5-4441-83ff-92a11770580f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:14.289309 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b93652fb-28b5-4441-83ff-92a11770580f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:14.289782 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b93652fb-28b5-4441-83ff-92a11770580f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:14.293470 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b93652fb-28b5-4441-83ff-92a11770580f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:14.297279 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b93652fb-28b5-4441-83ff-92a11770580f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:14.349964 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:14.626617 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b93652fb-28b5-4441-83ff-92a11770580f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:14.636397 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b93652fb-28b5-4441-83ff-92a11770580f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1314 microversion: 2.1 time: 0.377910 Jul 12 11:57:14.642463 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 870/1881] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:14 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:14.659616 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bb51bf94-cded-4900-ac8b-7bb886209f6f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:14.660514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-bb51bf94-cded-4900-ac8b-7bb886209f6f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:14.667001 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb51bf94-cded-4900-ac8b-7bb886209f6f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:14.667463 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb51bf94-cded-4900-ac8b-7bb886209f6f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:14.669667 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb51bf94-cded-4900-ac8b-7bb886209f6f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:14.670152 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb51bf94-cded-4900-ac8b-7bb886209f6f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:14.842293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1128af4f-a2a6-4c88-8e2a-ab9931186ae9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:14.850660 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1128af4f-a2a6-4c88-8e2a-ab9931186ae9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.876269 Jul 12 11:57:14.851255 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1012/1882] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:13 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:14.963603 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bb51bf94-cded-4900-ac8b-7bb886209f6f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:14.974974 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0cef03e8-850c-4f0c-a02e-d55df7601ee0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:14.975651 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0cef03e8-850c-4f0c-a02e-d55df7601ee0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:14.983862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bb51bf94-cded-4900-ac8b-7bb886209f6f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:14.987381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0cef03e8-850c-4f0c-a02e-d55df7601ee0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:14.987838 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0cef03e8-850c-4f0c-a02e-d55df7601ee0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:14.988177 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bb51bf94-cded-4900-ac8b-7bb886209f6f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:14.988668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0cef03e8-850c-4f0c-a02e-d55df7601ee0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:14.989111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0cef03e8-850c-4f0c-a02e-d55df7601ee0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:14.991383 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bb51bf94-cded-4900-ac8b-7bb886209f6f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1755 microversion: 2.42 time: 0.347854 Jul 12 11:57:14.994037 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 871/1883] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:14 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1755 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:15.113905 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a6d99e9c-2fd5-457a-9bf2-b83a547cf0d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:15.115357 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a6d99e9c-2fd5-457a-9bf2-b83a547cf0d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:15.157622 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a6d99e9c-2fd5-457a-9bf2-b83a547cf0d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:15.159216 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a6d99e9c-2fd5-457a-9bf2-b83a547cf0d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:15.163104 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a6d99e9c-2fd5-457a-9bf2-b83a547cf0d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:15.163808 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a6d99e9c-2fd5-457a-9bf2-b83a547cf0d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:15.631501 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a6d99e9c-2fd5-457a-9bf2-b83a547cf0d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:15.645774 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a6d99e9c-2fd5-457a-9bf2-b83a547cf0d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:15.649870 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a6d99e9c-2fd5-457a-9bf2-b83a547cf0d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:15.658216 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a6d99e9c-2fd5-457a-9bf2-b83a547cf0d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1362 microversion: 2.25 time: 0.553627 Jul 12 11:57:15.663503 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 872/1884] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:15 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1362 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:15.666083 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0cef03e8-850c-4f0c-a02e-d55df7601ee0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:15.670197 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-9f3658a3-0183-452a-9576-64162737cc5c req-8b1fcbb5-79a2-4fab-9378-429495322d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5836cf59-e6e4-4504-953a-733dead8acde", "tag": "9d1c95ba-995c-41c8-92ae-3e0b94344536"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:15.675143 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0cef03e8-850c-4f0c-a02e-d55df7601ee0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 200 len: 1522 microversion: 2.1 time: 0.705315 Jul 12 11:57:15.692077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-9f3658a3-0183-452a-9576-64162737cc5c req-8b1fcbb5-79a2-4fab-9378-429495322d3e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:15.692077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-9f3658a3-0183-452a-9576-64162737cc5c req-8b1fcbb5-79a2-4fab-9378-429495322d3e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:15.692948 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1013/1885] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:14 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 1522 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:15.708630 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-63e0a526-b6f4-4bea-942a-9aa9a282c200 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:15.709535 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-63e0a526-b6f4-4bea-942a-9aa9a282c200 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:15.716316 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-9f3658a3-0183-452a-9576-64162737cc5c req-8b1fcbb5-79a2-4fab-9378-429495322d3e service nova] Creating event network-changed:9d1c95ba-995c-41c8-92ae-3e0b94344536 for instance 5836cf59-e6e4-4504-953a-733dead8acde on n-h1-849104-4 Jul 12 11:57:15.717932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-63e0a526-b6f4-4bea-942a-9aa9a282c200 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:15.728849 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-63e0a526-b6f4-4bea-942a-9aa9a282c200 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:15.730064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-63e0a526-b6f4-4bea-942a-9aa9a282c200 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:15.730685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-63e0a526-b6f4-4bea-942a-9aa9a282c200 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:15.732432 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-9f3658a3-0183-452a-9576-64162737cc5c req-8b1fcbb5-79a2-4fab-9378-429495322d3e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059277 Jul 12 11:57:15.733509 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 873/1886] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:15.754762 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-527141cd-5aa3-4c01-9e3a-9808fcda32c2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:15.755433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-527141cd-5aa3-4c01-9e3a-9808fcda32c2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:15.763098 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-527141cd-5aa3-4c01-9e3a-9808fcda32c2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:15.771865 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-527141cd-5aa3-4c01-9e3a-9808fcda32c2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:15.772971 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-527141cd-5aa3-4c01-9e3a-9808fcda32c2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:15.773438 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-527141cd-5aa3-4c01-9e3a-9808fcda32c2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:15.844302 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-527141cd-5aa3-4c01-9e3a-9808fcda32c2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:57:15.997581 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:16.010337 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-527141cd-5aa3-4c01-9e3a-9808fcda32c2 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 204 len: 0 microversion: 2.1 time: 0.275261 Jul 12 11:57:16.012174 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 874/1887] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:57:15 2022] DELETE /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:57:16.026036 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0669b514-4801-4508-896d-cdb6d19c4309 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:16.029774 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0669b514-4801-4508-896d-cdb6d19c4309 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:16.052319 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0669b514-4801-4508-896d-cdb6d19c4309 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:16.054368 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0669b514-4801-4508-896d-cdb6d19c4309 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:16.056960 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0669b514-4801-4508-896d-cdb6d19c4309 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:16.059568 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0669b514-4801-4508-896d-cdb6d19c4309 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:16.284700 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-63e0a526-b6f4-4bea-942a-9aa9a282c200 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:16.309251 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-63e0a526-b6f4-4bea-942a-9aa9a282c200 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1314 microversion: 2.1 time: 0.614795 Jul 12 11:57:16.325642 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1014/1888] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:15 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:16.337529 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8ea82dd9-414f-4565-babc-676699509015 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:16.339552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8ea82dd9-414f-4565-babc-676699509015 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:16.368740 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8ea82dd9-414f-4565-babc-676699509015 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:16.369597 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8ea82dd9-414f-4565-babc-676699509015 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:16.370761 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8ea82dd9-414f-4565-babc-676699509015 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:16.371489 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8ea82dd9-414f-4565-babc-676699509015 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:16.440778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0669b514-4801-4508-896d-cdb6d19c4309 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:16.456022 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0669b514-4801-4508-896d-cdb6d19c4309 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.440543 Jul 12 11:57:16.457465 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 875/1889] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:16 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:16.464618 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a366f3db-5799-4f6d-9ce4-d1f3536cbee6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:16.465975 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a366f3db-5799-4f6d-9ce4-d1f3536cbee6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:16.486850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a366f3db-5799-4f6d-9ce4-d1f3536cbee6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:16.488621 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a366f3db-5799-4f6d-9ce4-d1f3536cbee6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:16.490214 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a366f3db-5799-4f6d-9ce4-d1f3536cbee6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:16.490924 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a366f3db-5799-4f6d-9ce4-d1f3536cbee6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:16.751836 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8ea82dd9-414f-4565-babc-676699509015 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:16.764313 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8ea82dd9-414f-4565-babc-676699509015 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:16.764555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a366f3db-5799-4f6d-9ce4-d1f3536cbee6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:16.767132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8ea82dd9-414f-4565-babc-676699509015 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:16.771154 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8ea82dd9-414f-4565-babc-676699509015 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1802 microversion: 2.42 time: 0.438920 Jul 12 11:57:16.775395 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a366f3db-5799-4f6d-9ce4-d1f3536cbee6 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 200 len: 1528 microversion: 2.1 time: 0.314049 Jul 12 11:57:16.785697 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1015/1890] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:16 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1802 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:16.788694 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 876/1891] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:16 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 1528 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:16.796424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-b55e2ea7-ecd5-4cdb-961f-721671f27294 req-142511df-a00d-42e7-9dc1-23151fb159a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e18c84-bf65-4225-8a78-916f5fc8eb09", "name": "network-vif-plugged", "status": "completed", "tag": "57728dad-464c-42c6-8c57-46d595e636e6"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:16.801521 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-72296e5d-6f12-4efb-80cb-dfa06fdd63b9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:16.801822 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-72296e5d-6f12-4efb-80cb-dfa06fdd63b9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:16.816516 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-72296e5d-6f12-4efb-80cb-dfa06fdd63b9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:16.816516 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-72296e5d-6f12-4efb-80cb-dfa06fdd63b9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:16.818611 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-72296e5d-6f12-4efb-80cb-dfa06fdd63b9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:16.818775 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b55e2ea7-ecd5-4cdb-961f-721671f27294 req-142511df-a00d-42e7-9dc1-23151fb159a2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:16.819296 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b55e2ea7-ecd5-4cdb-961f-721671f27294 req-142511df-a00d-42e7-9dc1-23151fb159a2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:16.819546 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-72296e5d-6f12-4efb-80cb-dfa06fdd63b9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:16.847550 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-b55e2ea7-ecd5-4cdb-961f-721671f27294 req-142511df-a00d-42e7-9dc1-23151fb159a2 service nova] Creating event network-vif-plugged:57728dad-464c-42c6-8c57-46d595e636e6 for instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 on n-h1-849104-4 Jul 12 11:57:16.857976 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-b55e2ea7-ecd5-4cdb-961f-721671f27294 req-142511df-a00d-42e7-9dc1-23151fb159a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070783 Jul 12 11:57:16.859433 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1016/1892] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:17.130145 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-72296e5d-6f12-4efb-80cb-dfa06fdd63b9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:17.145067 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-72296e5d-6f12-4efb-80cb-dfa06fdd63b9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:17.153259 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-72296e5d-6f12-4efb-80cb-dfa06fdd63b9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:17.154861 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-72296e5d-6f12-4efb-80cb-dfa06fdd63b9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1362 microversion: 2.25 time: 0.365007 Jul 12 11:57:17.160905 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 877/1893] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:16 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:17.330542 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f5bc8e94-f910-40d0-b28f-c4d1d2c91fb1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:17.331983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f5bc8e94-f910-40d0-b28f-c4d1d2c91fb1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:17.341187 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5bc8e94-f910-40d0-b28f-c4d1d2c91fb1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:17.343176 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5bc8e94-f910-40d0-b28f-c4d1d2c91fb1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:17.346040 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5bc8e94-f910-40d0-b28f-c4d1d2c91fb1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:17.347246 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5bc8e94-f910-40d0-b28f-c4d1d2c91fb1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:17.475555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8ee577c4-b97b-42f3-a2fb-afc3e03f7c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:17.475843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8ee577c4-b97b-42f3-a2fb-afc3e03f7c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:17.492618 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ee577c4-b97b-42f3-a2fb-afc3e03f7c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:17.493250 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ee577c4-b97b-42f3-a2fb-afc3e03f7c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:17.493886 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ee577c4-b97b-42f3-a2fb-afc3e03f7c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:17.494327 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ee577c4-b97b-42f3-a2fb-afc3e03f7c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:17.800928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8ee577c4-b97b-42f3-a2fb-afc3e03f7c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:17.812966 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8ee577c4-b97b-42f3-a2fb-afc3e03f7c3f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.341640 Jul 12 11:57:17.829639 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 878/1894] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:17 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:17.839257 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-149a87ec-7bf0-4188-9d10-2db8a437fbf6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:17.839887 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-149a87ec-7bf0-4188-9d10-2db8a437fbf6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:17.859746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-149a87ec-7bf0-4188-9d10-2db8a437fbf6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:17.863704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-149a87ec-7bf0-4188-9d10-2db8a437fbf6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:17.864638 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-149a87ec-7bf0-4188-9d10-2db8a437fbf6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:17.868089 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-149a87ec-7bf0-4188-9d10-2db8a437fbf6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:18.273457 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f5bc8e94-f910-40d0-b28f-c4d1d2c91fb1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:18.285442 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f5bc8e94-f910-40d0-b28f-c4d1d2c91fb1 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1314 microversion: 2.1 time: 0.960717 Jul 12 11:57:18.288820 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1017/1895] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:17 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1314 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:18.294803 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-960fca12-085d-49c7-ae2f-7cd259c7837e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:18.295424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-960fca12-085d-49c7-ae2f-7cd259c7837e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:18.312737 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-960fca12-085d-49c7-ae2f-7cd259c7837e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:18.313224 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-960fca12-085d-49c7-ae2f-7cd259c7837e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:18.314295 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-960fca12-085d-49c7-ae2f-7cd259c7837e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:18.314733 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-960fca12-085d-49c7-ae2f-7cd259c7837e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:18.456406 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-149a87ec-7bf0-4188-9d10-2db8a437fbf6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:18.478411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-149a87ec-7bf0-4188-9d10-2db8a437fbf6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:18.479942 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-149a87ec-7bf0-4188-9d10-2db8a437fbf6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:18.496407 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-149a87ec-7bf0-4188-9d10-2db8a437fbf6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1849 microversion: 2.42 time: 0.665506 Jul 12 11:57:18.497716 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 879/1896] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:17 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1849 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:18.503655 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d57c6122-58db-4eef-8029-7a95af812dde tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:18.504578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d57c6122-58db-4eef-8029-7a95af812dde tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:18.513158 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d57c6122-58db-4eef-8029-7a95af812dde tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:18.514295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d57c6122-58db-4eef-8029-7a95af812dde tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:18.515462 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d57c6122-58db-4eef-8029-7a95af812dde tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:18.516173 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d57c6122-58db-4eef-8029-7a95af812dde tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:18.759901 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-960fca12-085d-49c7-ae2f-7cd259c7837e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:18.771497 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-960fca12-085d-49c7-ae2f-7cd259c7837e tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 200 len: 1528 microversion: 2.1 time: 0.481548 Jul 12 11:57:18.772728 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1018/1897] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:18 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 1528 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:18.836297 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9d9a53a0-b1c2-4ce8-a24c-01c230a06057 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:18.837883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9d9a53a0-b1c2-4ce8-a24c-01c230a06057 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:18.850000 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9d9a53a0-b1c2-4ce8-a24c-01c230a06057 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:18.850752 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9d9a53a0-b1c2-4ce8-a24c-01c230a06057 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:18.851788 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9d9a53a0-b1c2-4ce8-a24c-01c230a06057 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:18.852512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9d9a53a0-b1c2-4ce8-a24c-01c230a06057 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:19.045809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d57c6122-58db-4eef-8029-7a95af812dde tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:19.057855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d57c6122-58db-4eef-8029-7a95af812dde tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:19.061000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d57c6122-58db-4eef-8029-7a95af812dde tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:19.063055 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d57c6122-58db-4eef-8029-7a95af812dde tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1362 microversion: 2.25 time: 0.564022 Jul 12 11:57:19.065767 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 880/1898] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:18 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1362 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:19.077688 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-5ed893b2-3a0f-4764-9d60-a52fe315d44b req-d2819ce6-abbc-4942-9784-6cceebf9b927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6a507e-64a6-490c-8dbd-bf23feec571c", "name": "network-vif-plugged", "status": "completed", "tag": "ec142fac-be48-431f-8191-564d18afd7ca"}, {"server_uuid": "c0e18c84-bf65-4225-8a78-916f5fc8eb09", "name": "network-vif-unplugged", "status": "completed", "tag": "57728dad-464c-42c6-8c57-46d595e636e6"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:19.107381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-5ed893b2-3a0f-4764-9d60-a52fe315d44b req-d2819ce6-abbc-4942-9784-6cceebf9b927 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:19.107891 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-5ed893b2-3a0f-4764-9d60-a52fe315d44b req-d2819ce6-abbc-4942-9784-6cceebf9b927 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:19.145367 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-5ed893b2-3a0f-4764-9d60-a52fe315d44b req-d2819ce6-abbc-4942-9784-6cceebf9b927 service nova] Creating event network-vif-plugged:ec142fac-be48-431f-8191-564d18afd7ca for instance cd6a507e-64a6-490c-8dbd-bf23feec571c on n-h2-849104-4 Jul 12 11:57:19.146552 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-5ed893b2-3a0f-4764-9d60-a52fe315d44b req-d2819ce6-abbc-4942-9784-6cceebf9b927 service nova] Creating event network-vif-unplugged:57728dad-464c-42c6-8c57-46d595e636e6 for instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 on n-h1-849104-4 Jul 12 11:57:19.181029 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-5ed893b2-3a0f-4764-9d60-a52fe315d44b req-d2819ce6-abbc-4942-9784-6cceebf9b927 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.112427 Jul 12 11:57:19.182302 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 881/1899] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:19.283084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9d9a53a0-b1c2-4ce8-a24c-01c230a06057 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:19.303961 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7f1a2545-e56e-4abd-913a-3403b61c7a9a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:19.305399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7f1a2545-e56e-4abd-913a-3403b61c7a9a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:19.307094 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9d9a53a0-b1c2-4ce8-a24c-01c230a06057 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.471617 Jul 12 11:57:19.315441 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1019/1900] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:18 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:57:19.333489 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7f1a2545-e56e-4abd-913a-3403b61c7a9a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:19.336110 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7f1a2545-e56e-4abd-913a-3403b61c7a9a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:19.338794 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7f1a2545-e56e-4abd-913a-3403b61c7a9a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:19.340537 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7f1a2545-e56e-4abd-913a-3403b61c7a9a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:19.517937 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-858489fa-5636-4275-ade8-0f0333eb2a7e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:19.518612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-858489fa-5636-4275-ade8-0f0333eb2a7e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:19.533503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-858489fa-5636-4275-ade8-0f0333eb2a7e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:19.534802 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-858489fa-5636-4275-ade8-0f0333eb2a7e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:19.536409 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-858489fa-5636-4275-ade8-0f0333eb2a7e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:19.537096 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-858489fa-5636-4275-ade8-0f0333eb2a7e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:19.996071 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-858489fa-5636-4275-ade8-0f0333eb2a7e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:20.013692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-858489fa-5636-4275-ade8-0f0333eb2a7e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:20.015705 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-858489fa-5636-4275-ade8-0f0333eb2a7e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:20.027888 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-858489fa-5636-4275-ade8-0f0333eb2a7e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1849 microversion: 2.42 time: 0.512159 Jul 12 11:57:20.031138 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1020/1901] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:19 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1849 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:57:20.052991 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e9fb6706-6c06-47bb-9ed9-e0cd32863e90 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:20.056427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e9fb6706-6c06-47bb-9ed9-e0cd32863e90 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:20.087493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7f1a2545-e56e-4abd-913a-3403b61c7a9a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:20.107964 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7f1a2545-e56e-4abd-913a-3403b61c7a9a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1314 microversion: 2.1 time: 0.806876 Jul 12 11:57:20.112414 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 882/1902] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:19 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1314 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:20.118108 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9fb6706-6c06-47bb-9ed9-e0cd32863e90 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:20.118573 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9fb6706-6c06-47bb-9ed9-e0cd32863e90 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:20.119376 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9fb6706-6c06-47bb-9ed9-e0cd32863e90 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:20.119828 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9fb6706-6c06-47bb-9ed9-e0cd32863e90 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:20.138007 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-b020f7a3-7b27-43e2-9f62-726eb0e5b9d2 req-9db4d110-9e2d-44e0-90be-55c3588a9094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e18c84-bf65-4225-8a78-916f5fc8eb09", "name": "network-vif-deleted", "tag": "57728dad-464c-42c6-8c57-46d595e636e6"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:20.164687 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-b020f7a3-7b27-43e2-9f62-726eb0e5b9d2 req-9db4d110-9e2d-44e0-90be-55c3588a9094 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:20.171220 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-b020f7a3-7b27-43e2-9f62-726eb0e5b9d2 req-9db4d110-9e2d-44e0-90be-55c3588a9094 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:20.229653 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-b020f7a3-7b27-43e2-9f62-726eb0e5b9d2 req-9db4d110-9e2d-44e0-90be-55c3588a9094 service nova] Creating event network-vif-deleted:57728dad-464c-42c6-8c57-46d595e636e6 for instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 on n-h1-849104-4 Jul 12 11:57:20.244958 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-b020f7a3-7b27-43e2-9f62-726eb0e5b9d2 req-9db4d110-9e2d-44e0-90be-55c3588a9094 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130689 Jul 12 11:57:20.247547 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 883/1903] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:20.277388 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a03ebfe2-397c-445e-8fa1-ef1098c18c38 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:20.278452 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a03ebfe2-397c-445e-8fa1-ef1098c18c38 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:20.305583 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a03ebfe2-397c-445e-8fa1-ef1098c18c38 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:20.308768 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a03ebfe2-397c-445e-8fa1-ef1098c18c38 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:20.310400 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a03ebfe2-397c-445e-8fa1-ef1098c18c38 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:20.312943 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a03ebfe2-397c-445e-8fa1-ef1098c18c38 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:20.561322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e9fb6706-6c06-47bb-9ed9-e0cd32863e90 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:20.581668 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e9fb6706-6c06-47bb-9ed9-e0cd32863e90 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 200 len: 1310 microversion: 2.1 time: 0.543669 Jul 12 11:57:20.581668 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1021/1904] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:20 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 1310 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:20.611638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2f17137a-370d-4dbc-8f86-c4b156386972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:20.612461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2f17137a-370d-4dbc-8f86-c4b156386972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:20.632639 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2f17137a-370d-4dbc-8f86-c4b156386972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:20.633290 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2f17137a-370d-4dbc-8f86-c4b156386972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:20.634156 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2f17137a-370d-4dbc-8f86-c4b156386972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:20.634609 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2f17137a-370d-4dbc-8f86-c4b156386972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:20.728436 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a03ebfe2-397c-445e-8fa1-ef1098c18c38 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:20.741371 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a03ebfe2-397c-445e-8fa1-ef1098c18c38 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:20.744856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a03ebfe2-397c-445e-8fa1-ef1098c18c38 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:20.747125 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a03ebfe2-397c-445e-8fa1-ef1098c18c38 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1362 microversion: 2.25 time: 0.487808 Jul 12 11:57:20.748537 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 884/1905] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:20 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1362 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:21.200442 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:21.255847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=50 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:21.300085 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2f17137a-370d-4dbc-8f86-c4b156386972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:21.314420 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2f17137a-370d-4dbc-8f86-c4b156386972 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.711674 Jul 12 11:57:21.315163 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1022/1906] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:20 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:21.329200 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d18692c6-8542-4212-8393-204c5e17ffc4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:21.333039 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d18692c6-8542-4212-8393-204c5e17ffc4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:21.343843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d18692c6-8542-4212-8393-204c5e17ffc4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:21.345660 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d18692c6-8542-4212-8393-204c5e17ffc4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:21.346729 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d18692c6-8542-4212-8393-204c5e17ffc4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:21.347386 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d18692c6-8542-4212-8393-204c5e17ffc4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:21.419620 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-014eb92d-94d6-4cd3-a93d-4286cf8e4cd9 tempest-SecurityGroupsTestAdminJSON-2049990688 tempest-SecurityGroupsTestAdminJSON-2049990688-project] Action: 'create', calling method: .version_select at 0x7f5e13b9e3a0>, body: {"security_group": {"name": "tempest-securitygroup-1013813329", "description": "tempest-description-1092357155"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:21.995567 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-014eb92d-94d6-4cd3-a93d-4286cf8e4cd9 tempest-SecurityGroupsTestAdminJSON-2049990688 tempest-SecurityGroupsTestAdminJSON-2049990688-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.979550 Jul 12 11:57:21.997090 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 885/1907] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:57:21 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:57:22.010167 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0f965596-f815-4f3c-ab8f-033695b119e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:22.013635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0f965596-f815-4f3c-ab8f-033695b119e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:22.032446 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0f965596-f815-4f3c-ab8f-033695b119e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:22.036086 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0f965596-f815-4f3c-ab8f-033695b119e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:22.037947 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0f965596-f815-4f3c-ab8f-033695b119e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:22.039494 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0f965596-f815-4f3c-ab8f-033695b119e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:22.261667 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d18692c6-8542-4212-8393-204c5e17ffc4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:22.272923 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d18692c6-8542-4212-8393-204c5e17ffc4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:22.285557 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d18692c6-8542-4212-8393-204c5e17ffc4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:22.287350 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d18692c6-8542-4212-8393-204c5e17ffc4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1849 microversion: 2.42 time: 0.969953 Jul 12 11:57:22.288307 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1023/1908] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:21 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1849 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:22.305648 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-86f96458-5e5c-4b8b-a106-35370f2f68aa tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:22.306586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-86f96458-5e5c-4b8b-a106-35370f2f68aa tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:22.314821 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-86f96458-5e5c-4b8b-a106-35370f2f68aa tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:22.315995 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-86f96458-5e5c-4b8b-a106-35370f2f68aa tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:22.317104 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-86f96458-5e5c-4b8b-a106-35370f2f68aa tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:22.317772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-86f96458-5e5c-4b8b-a106-35370f2f68aa tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:22.337175 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-86f96458-5e5c-4b8b-a106-35370f2f68aa tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] HTTP exception thrown: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-86f96458-5e5c-4b8b-a106-35370f2f68aa tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Request method failure captured: Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 HTTP/1.1 Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWFAKIsN470Eihf_ppnEMm8ScuYYi-RlEoEhYKrKGQKnWRVVx8CL1_cx_wavxZ5Yb1nB9a1dc8SNphqIFzgLzRw54v5bQ1jw4-zQ4tTxc1iksIQtwaDQzo2UoXyxxwU1KRjPyEgUzHrMWJINvtRxEjh7-x3pnpa9F8J8cCj9xcSqENw Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8030002dc7940b0a1bdf4f252fd5a8c", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0123721160c94b6785ed308618a2efc8 Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'c0e18c84-bf65-4225-8a78-916f5fc8eb09'} Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:22.339267 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:22.344285 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:22.344285 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:22.344285 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:22.344285 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:22.344285 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:57:22.344285 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:57:22.344285 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:22.344285 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:22.346673 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-86f96458-5e5c-4b8b-a106-35370f2f68aa tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Returning 404 to user: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:57:22.347802 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-86f96458-5e5c-4b8b-a106-35370f2f68aa tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 404 len: 111 microversion: 2.1 time: 0.046288 Jul 12 11:57:22.349291 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1024/1909] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:22 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:57:22.354620 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-066ee21e-e0b0-41cb-9921-c92c05df3e03 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:22.355318 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-066ee21e-e0b0-41cb-9921-c92c05df3e03 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:22.369409 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0f965596-f815-4f3c-ab8f-033695b119e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:22.376800 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-066ee21e-e0b0-41cb-9921-c92c05df3e03 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:22.379195 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0f965596-f815-4f3c-ab8f-033695b119e2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1501 microversion: 2.1 time: 0.380704 Jul 12 11:57:22.380095 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 886/1910] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:21 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1501 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:22.387227 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-066ee21e-e0b0-41cb-9921-c92c05df3e03 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:22.389981 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-04fdd4a8-5b15-4415-bfcc-191f4fa214b4 req-5c1afc3a-78d9-414e-85c1-ed15751bf7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "tag": "05e9b75d-65e4-454a-9576-1b50e1900608"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:22.392139 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-066ee21e-e0b0-41cb-9921-c92c05df3e03 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:22.394446 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-066ee21e-e0b0-41cb-9921-c92c05df3e03 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:22.420481 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-04fdd4a8-5b15-4415-bfcc-191f4fa214b4 req-5c1afc3a-78d9-414e-85c1-ed15751bf7f2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:22.420481 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-04fdd4a8-5b15-4415-bfcc-191f4fa214b4 req-5c1afc3a-78d9-414e-85c1-ed15751bf7f2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:22.476118 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-04fdd4a8-5b15-4415-bfcc-191f4fa214b4 req-5c1afc3a-78d9-414e-85c1-ed15751bf7f2 service nova] Creating event network-changed:05e9b75d-65e4-454a-9576-1b50e1900608 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:57:22.489502 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-04fdd4a8-5b15-4415-bfcc-191f4fa214b4 req-5c1afc3a-78d9-414e-85c1-ed15751bf7f2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107854 Jul 12 11:57:22.490194 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 887/1911] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:22.505561 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-45d0631a-a61e-4fe9-ab51-5df24881dd92 tempest-SecurityGroupsTestAdminJSON-2049990688 tempest-SecurityGroupsTestAdminJSON-2049990688-project] Action: 'create', calling method: .version_select at 0x7f5e13accb80>, body: {"security_group": {"name": "tempest-securitygroup-1883009545", "description": "tempest-description-1784453805"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:22.676651 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=15 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:22.900837 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-066ee21e-e0b0-41cb-9921-c92c05df3e03 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:22.903842 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:22.923263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-066ee21e-e0b0-41cb-9921-c92c05df3e03 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:22.926174 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-066ee21e-e0b0-41cb-9921-c92c05df3e03 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:22.929683 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-066ee21e-e0b0-41cb-9921-c92c05df3e03 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1362 microversion: 2.25 time: 0.578236 Jul 12 11:57:22.932064 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1025/1912] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:22 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1362 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:22.948131 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-7479a6ac-ad25-4139-a470-2fc57a4f2581 req-084beaec-e82a-4370-96b6-2bd81b31c8dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5836cf59-e6e4-4504-953a-733dead8acde", "name": "network-vif-plugged", "status": "completed", "tag": "9d1c95ba-995c-41c8-92ae-3e0b94344536"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:22.971638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-7479a6ac-ad25-4139-a470-2fc57a4f2581 req-084beaec-e82a-4370-96b6-2bd81b31c8dc service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:22.972206 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-7479a6ac-ad25-4139-a470-2fc57a4f2581 req-084beaec-e82a-4370-96b6-2bd81b31c8dc service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:22.975486 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-45d0631a-a61e-4fe9-ab51-5df24881dd92 tempest-SecurityGroupsTestAdminJSON-2049990688 tempest-SecurityGroupsTestAdminJSON-2049990688-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.480575 Jul 12 11:57:22.976121 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 888/1913] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:57:22 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:22.982993 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1d33d2ce-612f-4304-b30b-f948f418a036 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:22.984024 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1d33d2ce-612f-4304-b30b-f948f418a036 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:23.014081 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d33d2ce-612f-4304-b30b-f948f418a036 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:23.014649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d33d2ce-612f-4304-b30b-f948f418a036 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:23.015528 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d33d2ce-612f-4304-b30b-f948f418a036 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:23.015982 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1d33d2ce-612f-4304-b30b-f948f418a036 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:23.042129 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-7479a6ac-ad25-4139-a470-2fc57a4f2581 req-084beaec-e82a-4370-96b6-2bd81b31c8dc service nova] Creating event network-vif-plugged:9d1c95ba-995c-41c8-92ae-3e0b94344536 for instance 5836cf59-e6e4-4504-953a-733dead8acde on n-h1-849104-4 Jul 12 11:57:23.068341 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-7479a6ac-ad25-4139-a470-2fc57a4f2581 req-084beaec-e82a-4370-96b6-2bd81b31c8dc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131320 Jul 12 11:57:23.069626 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1026/1914] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:23.083896 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3023c2c4-30c2-4a02-97a8-7fa6782c04d9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:23.099409 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3023c2c4-30c2-4a02-97a8-7fa6782c04d9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:23.099887 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=68 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:23.101918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3023c2c4-30c2-4a02-97a8-7fa6782c04d9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:23.210675 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3023c2c4-30c2-4a02-97a8-7fa6782c04d9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Going to try to stop instance {{(pid=125984) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 11:57:23.285528 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3023c2c4-30c2-4a02-97a8-7fa6782c04d9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "POST /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c/action" status: 202 len: 0 microversion: 2.1 time: 0.206367 Jul 12 11:57:23.287955 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1027/1915] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:57:23 2022] POST /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:57:23.299600 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1807872466", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:23.422293 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1d33d2ce-612f-4304-b30b-f948f418a036 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:23.425436 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] validate_networks() for [('f8b910a9-6171-418a-9231-00298dc40684', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:57:23.435744 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1d33d2ce-612f-4304-b30b-f948f418a036 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.458482 Jul 12 11:57:23.452510 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 889/1916] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:22 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:23.570063 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-66895511-8548-4ddf-8e03-15eacb018021 tempest-SecurityGroupsTestAdminJSON-1578370117 tempest-SecurityGroupsTestAdminJSON-1578370117-project-admin] Action: 'create', calling method: .version_select at 0x7f5e13acc310>, body: {"security_group": {"name": "tempest-securitygroup-864465893", "description": "tempest-description-1155416839"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:23.951664 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-66895511-8548-4ddf-8e03-15eacb018021 tempest-SecurityGroupsTestAdminJSON-1578370117 tempest-SecurityGroupsTestAdminJSON-1578370117-project-admin] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.497907 Jul 12 11:57:23.952313 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 890/1917] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:57:23 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:23.964871 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0ebc3884-6879-48dc-9633-547582c08770 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:23.966065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0ebc3884-6879-48dc-9633-547582c08770 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:23.986451 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ebc3884-6879-48dc-9633-547582c08770 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:23.986909 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ebc3884-6879-48dc-9633-547582c08770 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:23.987695 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ebc3884-6879-48dc-9633-547582c08770 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:23.988155 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ebc3884-6879-48dc-9633-547582c08770 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:23.993876 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:24.292401 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0ebc3884-6879-48dc-9633-547582c08770 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:24.300824 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0ebc3884-6879-48dc-9633-547582c08770 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1511 microversion: 2.1 time: 0.340972 Jul 12 11:57:24.311845 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:57:24.313685 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 891/1918] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:23 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1511 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:24.314121 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:57:24.314874 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:57:24.315398 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:57:24.316138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:57:24.319882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-27ac0d11-33cb-4212-8b30-b10c8586e210 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:24.321389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-27ac0d11-33cb-4212-8b30-b10c8586e210 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:24.328381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27ac0d11-33cb-4212-8b30-b10c8586e210 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:24.329657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27ac0d11-33cb-4212-8b30-b10c8586e210 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:24.330642 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27ac0d11-33cb-4212-8b30-b10c8586e210 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:24.331267 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27ac0d11-33cb-4212-8b30-b10c8586e210 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:24.334453 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:24.342971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:24.349863 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:24.350643 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:24.419055 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Getting quotas for project d8030002dc7940b0a1bdf4f252fd5a8c. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:57:24.444610 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Getting quotas for user 0123721160c94b6785ed308618a2efc8 and project d8030002dc7940b0a1bdf4f252fd5a8c. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:57:24.482214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:57:24.485551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:57:24.550147 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-39be1d94-af79-466b-9153-d64eec1a1056 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.260529 Jul 12 11:57:24.552214 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1028/1919] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:57:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:57:24.559652 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-53f59474-c5dd-49e2-950e-9e83be8028a6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:24.560701 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-53f59474-c5dd-49e2-950e-9e83be8028a6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:24.571155 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53f59474-c5dd-49e2-950e-9e83be8028a6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:24.571891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53f59474-c5dd-49e2-950e-9e83be8028a6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:24.573086 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53f59474-c5dd-49e2-950e-9e83be8028a6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:24.573968 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-53f59474-c5dd-49e2-950e-9e83be8028a6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:24.736279 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-27ac0d11-33cb-4212-8b30-b10c8586e210 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:24.747766 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-27ac0d11-33cb-4212-8b30-b10c8586e210 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:24.749438 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-27ac0d11-33cb-4212-8b30-b10c8586e210 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:24.754806 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-27ac0d11-33cb-4212-8b30-b10c8586e210 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1870 microversion: 2.42 time: 0.439504 Jul 12 11:57:24.755713 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 892/1920] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:24 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1870 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:24.768543 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-427346e3-e0b5-480a-9e27-0912a32acdef tempest-SecurityGroupsTestAdminJSON-1578370117 tempest-SecurityGroupsTestAdminJSON-1578370117-project-admin] Action: 'create', calling method: .version_select at 0x7f5e13b88040>, body: {"security_group": {"name": "tempest-securitygroup-1901735482", "description": "tempest-description-135715380"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:24.907967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-53f59474-c5dd-49e2-950e-9e83be8028a6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:24.919987 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-53f59474-c5dd-49e2-950e-9e83be8028a6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:24.924947 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-53f59474-c5dd-49e2-950e-9e83be8028a6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:24.926119 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-53f59474-c5dd-49e2-950e-9e83be8028a6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1362 microversion: 2.25 time: 0.371479 Jul 12 11:57:24.926744 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1029/1921] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:24 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1362 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:24.941283 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-61050270-de59-4228-a8f9-7630914d1ca6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:24.942167 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-61050270-de59-4228-a8f9-7630914d1ca6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:24.957407 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61050270-de59-4228-a8f9-7630914d1ca6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:24.960014 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61050270-de59-4228-a8f9-7630914d1ca6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:24.960777 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61050270-de59-4228-a8f9-7630914d1ca6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:24.961227 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61050270-de59-4228-a8f9-7630914d1ca6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:25.074848 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-427346e3-e0b5-480a-9e27-0912a32acdef tempest-SecurityGroupsTestAdminJSON-1578370117 tempest-SecurityGroupsTestAdminJSON-1578370117-project-admin] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.317708 Jul 12 11:57:25.076627 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 893/1922] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:57:24 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:25.086282 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-baa53deb-18fc-493c-97d7-176f80ebd964 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:25.091360 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-baa53deb-18fc-493c-97d7-176f80ebd964 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:25.214072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-baa53deb-18fc-493c-97d7-176f80ebd964 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:25.224356 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-baa53deb-18fc-493c-97d7-176f80ebd964 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369" status: 200 len: 1225 microversion: 2.1 time: 0.145924 Jul 12 11:57:25.235044 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 894/1923] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:25 2022] GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 => generated 1225 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:25.240603 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-b226fec7-6bcd-416a-b2f7-352dc25d0ac1 req-2f4bd6e5-0602-4f82-b7cd-093f03f92c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "tag": "d2014975-7c3d-4b64-a57a-e0776062c564"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:25.252103 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-b226fec7-6bcd-416a-b2f7-352dc25d0ac1 req-2f4bd6e5-0602-4f82-b7cd-093f03f92c98 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:25.252877 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-b226fec7-6bcd-416a-b2f7-352dc25d0ac1 req-2f4bd6e5-0602-4f82-b7cd-093f03f92c98 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:25.265964 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-b226fec7-6bcd-416a-b2f7-352dc25d0ac1 req-2f4bd6e5-0602-4f82-b7cd-093f03f92c98 service nova] Creating event network-changed:d2014975-7c3d-4b64-a57a-e0776062c564 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:57:25.272216 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-b226fec7-6bcd-416a-b2f7-352dc25d0ac1 req-2f4bd6e5-0602-4f82-b7cd-093f03f92c98 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035398 Jul 12 11:57:25.273510 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 895/1924] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:25.280891 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-283d5200-0c92-4c32-abdb-4e488c55705a tempest-SecurityGroupsTestAdminJSON-1578370117 tempest-SecurityGroupsTestAdminJSON-1578370117-project-admin] Calling method '.version_select at 0x7f5e13ae9670>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:25.377919 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-61050270-de59-4228-a8f9-7630914d1ca6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:25.390262 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-61050270-de59-4228-a8f9-7630914d1ca6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.458020 Jul 12 11:57:25.395541 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1030/1925] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:24 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:25.402580 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-be7b9c49-b665-46fa-af3b-fa5625fcb841 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:25.413046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-be7b9c49-b665-46fa-af3b-fa5625fcb841 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:25.424095 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-be7b9c49-b665-46fa-af3b-fa5625fcb841 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:25.424806 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-be7b9c49-b665-46fa-af3b-fa5625fcb841 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:25.426114 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-be7b9c49-b665-46fa-af3b-fa5625fcb841 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:25.429281 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-be7b9c49-b665-46fa-af3b-fa5625fcb841 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:26.169848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-be7b9c49-b665-46fa-af3b-fa5625fcb841 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:26.194765 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-be7b9c49-b665-46fa-af3b-fa5625fcb841 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1511 microversion: 2.1 time: 0.792543 Jul 12 11:57:26.195451 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1031/1926] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:25 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1511 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:26.211724 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-86386280-1925-4c65-bfc8-d486182e52af tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:26.214264 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-86386280-1925-4c65-bfc8-d486182e52af tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:26.220237 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:26.233137 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-86386280-1925-4c65-bfc8-d486182e52af tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:26.236585 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-86386280-1925-4c65-bfc8-d486182e52af tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:26.238371 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-86386280-1925-4c65-bfc8-d486182e52af tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:26.240619 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-86386280-1925-4c65-bfc8-d486182e52af tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:26.683314 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-86386280-1925-4c65-bfc8-d486182e52af tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:26.704582 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-86386280-1925-4c65-bfc8-d486182e52af tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:26.706120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-86386280-1925-4c65-bfc8-d486182e52af tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:26.707558 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-86386280-1925-4c65-bfc8-d486182e52af tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1891 microversion: 2.42 time: 0.502788 Jul 12 11:57:26.708350 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1032/1927] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:26 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1891 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:26.713296 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-35eaa0b2-7d2f-4807-936b-7fbc4d883683 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:26.716927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-35eaa0b2-7d2f-4807-936b-7fbc4d883683 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:26.731384 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35eaa0b2-7d2f-4807-936b-7fbc4d883683 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:26.731840 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35eaa0b2-7d2f-4807-936b-7fbc4d883683 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:26.745244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35eaa0b2-7d2f-4807-936b-7fbc4d883683 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:26.745244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-35eaa0b2-7d2f-4807-936b-7fbc4d883683 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:27.066170 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-35eaa0b2-7d2f-4807-936b-7fbc4d883683 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:27.083225 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-35eaa0b2-7d2f-4807-936b-7fbc4d883683 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:27.088194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-35eaa0b2-7d2f-4807-936b-7fbc4d883683 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:27.093592 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-35eaa0b2-7d2f-4807-936b-7fbc4d883683 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1558 microversion: 2.25 time: 0.383991 Jul 12 11:57:27.097063 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1033/1928] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:26 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1558 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:27.109715 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1aa84191-edfd-47e6-bb4b-5415f4ce8e40 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:27.111133 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1aa84191-edfd-47e6-bb4b-5415f4ce8e40 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:27.131704 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1aa84191-edfd-47e6-bb4b-5415f4ce8e40 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:27.147617 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1aa84191-edfd-47e6-bb4b-5415f4ce8e40 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:27.149766 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1aa84191-edfd-47e6-bb4b-5415f4ce8e40 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:27.150639 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1aa84191-edfd-47e6-bb4b-5415f4ce8e40 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:27.355649 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1aa84191-edfd-47e6-bb4b-5415f4ce8e40 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:27.368193 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1aa84191-edfd-47e6-bb4b-5415f4ce8e40 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369" status: 200 len: 1277 microversion: 2.1 time: 0.266512 Jul 12 11:57:27.370567 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1034/1929] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:27 2022] GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 => generated 1277 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:27.377381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-610c6ab4-135a-4a74-98e7-ba670237af60 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:27.382421 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-610c6ab4-135a-4a74-98e7-ba670237af60 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:27.400602 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-610c6ab4-135a-4a74-98e7-ba670237af60 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:27.401201 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-610c6ab4-135a-4a74-98e7-ba670237af60 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:27.402319 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-610c6ab4-135a-4a74-98e7-ba670237af60 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:27.403316 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-610c6ab4-135a-4a74-98e7-ba670237af60 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:28.026039 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-610c6ab4-135a-4a74-98e7-ba670237af60 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:28.040047 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-610c6ab4-135a-4a74-98e7-ba670237af60 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.665800 Jul 12 11:57:28.050998 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1035/1930] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:27 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:28.056725 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-297f37be-0ee7-4528-8f61-1852c14d7c60 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:28.057698 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-297f37be-0ee7-4528-8f61-1852c14d7c60 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:28.065783 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-297f37be-0ee7-4528-8f61-1852c14d7c60 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:28.066623 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-297f37be-0ee7-4528-8f61-1852c14d7c60 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:28.067674 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-297f37be-0ee7-4528-8f61-1852c14d7c60 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:28.068404 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-297f37be-0ee7-4528-8f61-1852c14d7c60 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:28.508646 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-297f37be-0ee7-4528-8f61-1852c14d7c60 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'services' on Instance uuid 5836cf59-e6e4-4504-953a-733dead8acde {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:57:28.551326 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-297f37be-0ee7-4528-8f61-1852c14d7c60 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 2051 microversion: 2.25 time: 0.495808 Jul 12 11:57:28.552914 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1036/1931] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:28 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 2051 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:28.569863 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4a2eb571-4dca-44db-aeb4-4d624d9672f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:28.573667 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4a2eb571-4dca-44db-aeb4-4d624d9672f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:28.605708 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4a2eb571-4dca-44db-aeb4-4d624d9672f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:28.606234 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4a2eb571-4dca-44db-aeb4-4d624d9672f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:28.607095 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4a2eb571-4dca-44db-aeb4-4d624d9672f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:28.607583 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4a2eb571-4dca-44db-aeb4-4d624d9672f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:29.320537 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4a2eb571-4dca-44db-aeb4-4d624d9672f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:29.342392 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4a2eb571-4dca-44db-aeb4-4d624d9672f6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1511 microversion: 2.1 time: 0.788135 Jul 12 11:57:29.346396 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1037/1932] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:28 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1511 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:29.372143 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-d9394b41-004e-4230-bd0e-ff49fd667978 req-5e33bf82-e57b-4b9d-b045-2914fcd48c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "tag": "adac38f7-95b5-450a-bafb-4f4a814fa426"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:29.410024 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d9394b41-004e-4230-bd0e-ff49fd667978 req-5e33bf82-e57b-4b9d-b045-2914fcd48c1d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:29.413197 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d9394b41-004e-4230-bd0e-ff49fd667978 req-5e33bf82-e57b-4b9d-b045-2914fcd48c1d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:29.458748 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-d9394b41-004e-4230-bd0e-ff49fd667978 req-5e33bf82-e57b-4b9d-b045-2914fcd48c1d service nova] Creating event network-changed:adac38f7-95b5-450a-bafb-4f4a814fa426 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:57:29.473071 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-d9394b41-004e-4230-bd0e-ff49fd667978 req-5e33bf82-e57b-4b9d-b045-2914fcd48c1d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123324 Jul 12 11:57:29.475516 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1038/1933] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:29.506849 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bf6c142b-7b55-47bf-9bd5-004b8fdcc345 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:29.509944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bf6c142b-7b55-47bf-9bd5-004b8fdcc345 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:29.545629 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf6c142b-7b55-47bf-9bd5-004b8fdcc345 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:29.546427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf6c142b-7b55-47bf-9bd5-004b8fdcc345 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:29.547848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf6c142b-7b55-47bf-9bd5-004b8fdcc345 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:29.557818 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf6c142b-7b55-47bf-9bd5-004b8fdcc345 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:30.527015 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bf6c142b-7b55-47bf-9bd5-004b8fdcc345 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:30.539371 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bf6c142b-7b55-47bf-9bd5-004b8fdcc345 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:30.543213 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bf6c142b-7b55-47bf-9bd5-004b8fdcc345 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:30.544540 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bf6c142b-7b55-47bf-9bd5-004b8fdcc345 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1891 microversion: 2.42 time: 1.057216 Jul 12 11:57:30.545117 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1039/1934] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:29 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1891 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:30.560643 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c5bd2701-facd-46a9-bc3d-4f19ddd782de tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:30.574136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c5bd2701-facd-46a9-bc3d-4f19ddd782de tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:30.592398 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c5bd2701-facd-46a9-bc3d-4f19ddd782de tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:30.592858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c5bd2701-facd-46a9-bc3d-4f19ddd782de tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:30.593875 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c5bd2701-facd-46a9-bc3d-4f19ddd782de tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:30.594347 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c5bd2701-facd-46a9-bc3d-4f19ddd782de tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:31.034377 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c5bd2701-facd-46a9-bc3d-4f19ddd782de tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:31.061171 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c5bd2701-facd-46a9-bc3d-4f19ddd782de tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369" status: 200 len: 1325 microversion: 2.1 time: 0.509872 Jul 12 11:57:31.062497 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1040/1935] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:30 2022] GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 => generated 1325 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:31.071944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-af5fbde5-194a-4460-9098-a55c56b90bbf tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:31.075753 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-af5fbde5-194a-4460-9098-a55c56b90bbf tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:31.106448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af5fbde5-194a-4460-9098-a55c56b90bbf tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:31.114308 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af5fbde5-194a-4460-9098-a55c56b90bbf tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:31.116501 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af5fbde5-194a-4460-9098-a55c56b90bbf tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:31.116501 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af5fbde5-194a-4460-9098-a55c56b90bbf tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:32.029454 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-af5fbde5-194a-4460-9098-a55c56b90bbf tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'services' on Instance uuid 5836cf59-e6e4-4504-953a-733dead8acde {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:57:32.077277 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-af5fbde5-194a-4460-9098-a55c56b90bbf tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 2051 microversion: 2.25 time: 1.011573 Jul 12 11:57:32.088278 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1041/1936] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:31 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 2051 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:32.106299 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b20447c9-319a-4484-875c-418f69260ba7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:32.107239 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b20447c9-319a-4484-875c-418f69260ba7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:32.115153 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b20447c9-319a-4484-875c-418f69260ba7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:32.115912 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b20447c9-319a-4484-875c-418f69260ba7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:32.116946 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b20447c9-319a-4484-875c-418f69260ba7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:32.117828 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b20447c9-319a-4484-875c-418f69260ba7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:32.469811 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-283d5200-0c92-4c32-abdb-4e488c55705a tempest-SecurityGroupsTestAdminJSON-1578370117 tempest-SecurityGroupsTestAdminJSON-1578370117-project-admin] 10.222.0.50 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 14294 microversion: 2.1 time: 7.194836 Jul 12 11:57:32.471065 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 896/1937] 10.222.0.50 () {58 vars in 1190 bytes} [Tue Jul 12 11:57:25 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 14294 bytes in 7197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:57:32.476875 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a8cb8057-dc39-4e74-97ae-8d0bc8a6e048 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:32.477889 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a8cb8057-dc39-4e74-97ae-8d0bc8a6e048 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:32.505540 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a8cb8057-dc39-4e74-97ae-8d0bc8a6e048 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:32.506378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a8cb8057-dc39-4e74-97ae-8d0bc8a6e048 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:32.507390 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a8cb8057-dc39-4e74-97ae-8d0bc8a6e048 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:32.508063 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a8cb8057-dc39-4e74-97ae-8d0bc8a6e048 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:32.508548 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b20447c9-319a-4484-875c-418f69260ba7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:32.520950 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:32.524904 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b20447c9-319a-4484-875c-418f69260ba7 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.422373 Jul 12 11:57:32.527985 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1042/1938] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:32 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:32.535590 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d9af3753-b8c8-4cdd-b3c3-6aa3f3705268 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:32.544910 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d9af3753-b8c8-4cdd-b3c3-6aa3f3705268 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:32.550119 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d9af3753-b8c8-4cdd-b3c3-6aa3f3705268 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Searching by: {'deleted': False, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 11:57:32.561406 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9af3753-b8c8-4cdd-b3c3-6aa3f3705268 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:32.566708 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9af3753-b8c8-4cdd-b3c3-6aa3f3705268 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:32.571377 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9af3753-b8c8-4cdd-b3c3-6aa3f3705268 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:32.572109 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9af3753-b8c8-4cdd-b3c3-6aa3f3705268 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:32.638391 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-d9af3753-b8c8-4cdd-b3c3-6aa3f3705268 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 11:57:32.732432 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d9af3753-b8c8-4cdd-b3c3-6aa3f3705268 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.197032 Jul 12 11:57:32.743713 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1043/1939] 10.222.0.50 () {58 vars in 1124 bytes} [Tue Jul 12 11:57:32 2022] GET /compute/v2.1/servers => generated 340 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:32.752215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2e6698aa-41eb-4bc2-b131-5e501f269887 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:32.753214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2e6698aa-41eb-4bc2-b131-5e501f269887 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:32.760661 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e6698aa-41eb-4bc2-b131-5e501f269887 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:32.761113 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e6698aa-41eb-4bc2-b131-5e501f269887 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:32.761917 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e6698aa-41eb-4bc2-b131-5e501f269887 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:32.762357 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e6698aa-41eb-4bc2-b131-5e501f269887 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:32.792401 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a8cb8057-dc39-4e74-97ae-8d0bc8a6e048 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:32.803548 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a8cb8057-dc39-4e74-97ae-8d0bc8a6e048 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1511 microversion: 2.1 time: 0.330708 Jul 12 11:57:32.814607 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 897/1940] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:32 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:32.820787 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-43b4bfc7-a724-4fe6-aa5f-00498f55ce5b req-fcd2bd91-b26d-4034-8baa-0df1e5450988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2fb044-0422-4634-bd32-08f216c8f6ab", "name": "network-vif-unplugged", "status": "completed", "tag": "76d05327-fea5-4bb0-aa1a-55e0103cdbcf"}, {"name": "network-changed", "server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "tag": "c0a4bf74-eaa2-46bb-97d3-902c76d0da52"}, {"name": "network-changed", "server_uuid": "1a2fb044-0422-4634-bd32-08f216c8f6ab", "tag": "76d05327-fea5-4bb0-aa1a-55e0103cdbcf"}, {"name": "network-changed", "server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "tag": "e5630fc7-2a37-4d64-8b42-4467055177db"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:32.840635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-43b4bfc7-a724-4fe6-aa5f-00498f55ce5b req-fcd2bd91-b26d-4034-8baa-0df1e5450988 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:32.841086 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-43b4bfc7-a724-4fe6-aa5f-00498f55ce5b req-fcd2bd91-b26d-4034-8baa-0df1e5450988 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:32.859670 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-43b4bfc7-a724-4fe6-aa5f-00498f55ce5b req-fcd2bd91-b26d-4034-8baa-0df1e5450988 service nova] Creating event network-vif-unplugged:76d05327-fea5-4bb0-aa1a-55e0103cdbcf for instance 1a2fb044-0422-4634-bd32-08f216c8f6ab on n-h2-849104-4 Jul 12 11:57:32.861140 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-43b4bfc7-a724-4fe6-aa5f-00498f55ce5b req-fcd2bd91-b26d-4034-8baa-0df1e5450988 service nova] Creating event network-changed:c0a4bf74-eaa2-46bb-97d3-902c76d0da52 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:57:32.861267 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-43b4bfc7-a724-4fe6-aa5f-00498f55ce5b req-fcd2bd91-b26d-4034-8baa-0df1e5450988 service nova] Creating event network-changed:76d05327-fea5-4bb0-aa1a-55e0103cdbcf for instance 1a2fb044-0422-4634-bd32-08f216c8f6ab on n-h2-849104-4 Jul 12 11:57:32.861676 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-43b4bfc7-a724-4fe6-aa5f-00498f55ce5b req-fcd2bd91-b26d-4034-8baa-0df1e5450988 service nova] Creating event network-changed:e5630fc7-2a37-4d64-8b42-4467055177db for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:57:32.873359 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-43b4bfc7-a724-4fe6-aa5f-00498f55ce5b req-fcd2bd91-b26d-4034-8baa-0df1e5450988 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 686 microversion: 2.1 time: 0.057321 Jul 12 11:57:32.874347 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 898/1941] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 686 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:32.886253 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9868f570-941a-484c-ab75-580b69ed91a8 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:32.887246 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9868f570-941a-484c-ab75-580b69ed91a8 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:32.900108 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9868f570-941a-484c-ab75-580b69ed91a8 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:32.900573 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9868f570-941a-484c-ab75-580b69ed91a8 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:32.901366 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9868f570-941a-484c-ab75-580b69ed91a8 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:32.901812 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9868f570-941a-484c-ab75-580b69ed91a8 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:33.465274 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9868f570-941a-484c-ab75-580b69ed91a8 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:33.482865 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9868f570-941a-484c-ab75-580b69ed91a8 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369" status: 200 len: 1325 microversion: 2.1 time: 0.607092 Jul 12 11:57:33.484950 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 899/1942] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:32 2022] GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 => generated 1325 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:33.491215 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0d614ec8-9d38-48ad-bab2-12cee28ed7f0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:33.494691 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:57:33.494691 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:57:33.498577 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2e6698aa-41eb-4bc2-b131-5e501f269887 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:33.502867 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0d614ec8-9d38-48ad-bab2-12cee28ed7f0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:33.509890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0d614ec8-9d38-48ad-bab2-12cee28ed7f0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:33.515264 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0d614ec8-9d38-48ad-bab2-12cee28ed7f0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:33.517280 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0d614ec8-9d38-48ad-bab2-12cee28ed7f0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:33.532623 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2e6698aa-41eb-4bc2-b131-5e501f269887 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:33.540665 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2e6698aa-41eb-4bc2-b131-5e501f269887 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:33.547333 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2e6698aa-41eb-4bc2-b131-5e501f269887 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1891 microversion: 2.42 time: 0.806941 Jul 12 11:57:33.552513 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1044/1943] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:32 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1891 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:33.575345 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-afc5cf9d-b979-4e2c-8c58-af407fed366d req-d42f3946-ccdb-47d2-ba94-5fa3d075f289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ca97987-cbe1-4935-8285-25d11becf369", "tag": "c10832b8-0a8e-4f00-8f67-42689d927671"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:33.590754 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0d614ec8-9d38-48ad-bab2-12cee28ed7f0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.104220 Jul 12 11:57:33.591665 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 900/1944] 10.222.0.50 () {60 vars in 1216 bytes} [Tue Jul 12 11:57:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:57:33.598799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7a757197-6782-4fca-acd6-545f54c05221 tempest-SecurityGroupsTestAdminJSON-2049990688 tempest-SecurityGroupsTestAdminJSON-2049990688-project] Calling method '.version_select at 0x7f5e13aa08b0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:33.609002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-afc5cf9d-b979-4e2c-8c58-af407fed366d req-d42f3946-ccdb-47d2-ba94-5fa3d075f289 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:33.610898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-afc5cf9d-b979-4e2c-8c58-af407fed366d req-d42f3946-ccdb-47d2-ba94-5fa3d075f289 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:33.633088 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-afc5cf9d-b979-4e2c-8c58-af407fed366d req-d42f3946-ccdb-47d2-ba94-5fa3d075f289 service nova] Creating event network-changed:c10832b8-0a8e-4f00-8f67-42689d927671 for instance 0ca97987-cbe1-4935-8285-25d11becf369 on n-h1-849104-4 Jul 12 11:57:33.643325 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-afc5cf9d-b979-4e2c-8c58-af407fed366d req-d42f3946-ccdb-47d2-ba94-5fa3d075f289 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085268 Jul 12 11:57:33.644401 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1045/1945] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:33.672541 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2e0444c4-2479-4ac8-aa06-95b9c647723b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:33.681874 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2e0444c4-2479-4ac8-aa06-95b9c647723b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:33.683711 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2e0444c4-2479-4ac8-aa06-95b9c647723b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Searching by: {'deleted': False, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 11:57:33.696011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e0444c4-2479-4ac8-aa06-95b9c647723b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:33.697758 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e0444c4-2479-4ac8-aa06-95b9c647723b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:33.700251 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e0444c4-2479-4ac8-aa06-95b9c647723b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:33.701216 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e0444c4-2479-4ac8-aa06-95b9c647723b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:33.796768 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-2e0444c4-2479-4ac8-aa06-95b9c647723b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 11:57:33.930886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2e0444c4-2479-4ac8-aa06-95b9c647723b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:33.947791 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e0444c4-2479-4ac8-aa06-95b9c647723b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:33.948563 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e0444c4-2479-4ac8-aa06-95b9c647723b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:34.103346 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7a757197-6782-4fca-acd6-545f54c05221 tempest-SecurityGroupsTestAdminJSON-2049990688 tempest-SecurityGroupsTestAdminJSON-2049990688-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.510259 Jul 12 11:57:34.104546 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 901/1946] 10.222.0.50 () {58 vars in 1190 bytes} [Tue Jul 12 11:57:33 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:34.109503 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-77951c8d-f6fc-459d-a73b-4d575b798cec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:34.110938 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-77951c8d-f6fc-459d-a73b-4d575b798cec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:34.127495 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77951c8d-f6fc-459d-a73b-4d575b798cec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:34.136258 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77951c8d-f6fc-459d-a73b-4d575b798cec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:34.143624 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77951c8d-f6fc-459d-a73b-4d575b798cec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:34.144680 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77951c8d-f6fc-459d-a73b-4d575b798cec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:34.333180 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2e0444c4-2479-4ac8-aa06-95b9c647723b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.687193 Jul 12 11:57:34.334357 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1046/1947] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 11:57:33 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:34.356963 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cb41db28-fc49-4c9d-a48b-715d4d23a53e tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:34.357873 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cb41db28-fc49-4c9d-a48b-715d4d23a53e tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:34.369460 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb41db28-fc49-4c9d-a48b-715d4d23a53e tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:34.387007 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb41db28-fc49-4c9d-a48b-715d4d23a53e tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:34.388392 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb41db28-fc49-4c9d-a48b-715d4d23a53e tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:34.389305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb41db28-fc49-4c9d-a48b-715d4d23a53e tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:34.527989 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-77951c8d-f6fc-459d-a73b-4d575b798cec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:34.537726 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-77951c8d-f6fc-459d-a73b-4d575b798cec tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.431589 Jul 12 11:57:34.538058 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 902/1948] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:34 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:34.543133 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1f1ee844-1faa-419a-9339-fe4221c25f5a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:34.543991 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1f1ee844-1faa-419a-9339-fe4221c25f5a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:34.552708 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f1ee844-1faa-419a-9339-fe4221c25f5a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:34.553529 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f1ee844-1faa-419a-9339-fe4221c25f5a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:34.554530 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f1ee844-1faa-419a-9339-fe4221c25f5a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:34.555193 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f1ee844-1faa-419a-9339-fe4221c25f5a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:34.585938 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cb41db28-fc49-4c9d-a48b-715d4d23a53e tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde/action" status: 202 len: 0 microversion: 2.25 time: 0.230305 Jul 12 11:57:34.587013 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1047/1949] 10.222.0.50 () {62 vars in 1318 bytes} [Tue Jul 12 11:57:34 2022] POST /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:57:34.611032 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3dcbaaae-21b1-4ca9-bf7f-fdcfd205581f tempest-SecurityGroupsTestAdminJSON-1578370117 tempest-SecurityGroupsTestAdminJSON-1578370117-project-admin] Calling method '.version_select at 0x7f5e0ad6a0d0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:34.774996 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1f1ee844-1faa-419a-9339-fe4221c25f5a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:34.800317 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1f1ee844-1faa-419a-9339-fe4221c25f5a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1511 microversion: 2.1 time: 0.260914 Jul 12 11:57:34.801347 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 903/1950] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:34 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:34.808460 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c2c3341b-c95e-41e8-ae01-386239df0b80 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:34.823288 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c2c3341b-c95e-41e8-ae01-386239df0b80 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019768 Jul 12 11:57:34.825701 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 904/1951] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:57:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:34.835410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d0926f17-e536-45bc-86dc-ca9470dbd1cf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:34.837633 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d0926f17-e536-45bc-86dc-ca9470dbd1cf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:34.853254 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d0926f17-e536-45bc-86dc-ca9470dbd1cf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:34.854316 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d0926f17-e536-45bc-86dc-ca9470dbd1cf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:34.855518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d0926f17-e536-45bc-86dc-ca9470dbd1cf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:34.856196 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d0926f17-e536-45bc-86dc-ca9470dbd1cf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:35.218777 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:35.264942 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3dcbaaae-21b1-4ca9-bf7f-fdcfd205581f tempest-SecurityGroupsTestAdminJSON-1578370117 tempest-SecurityGroupsTestAdminJSON-1578370117-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/70c048ee-6634-4a75-84d8-bb074d88b023" status: 202 len: 0 microversion: 2.1 time: 0.674708 Jul 12 11:57:35.266549 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1048/1952] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:57:34 2022] DELETE /compute/v2.1/os-security-groups/70c048ee-6634-4a75-84d8-bb074d88b023 => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:57:35.272683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bfd03922-4638-4c20-8f52-b2ecec3d91c8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:35.273729 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bfd03922-4638-4c20-8f52-b2ecec3d91c8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:35.278568 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d0926f17-e536-45bc-86dc-ca9470dbd1cf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:35.293564 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bfd03922-4638-4c20-8f52-b2ecec3d91c8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:35.294124 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bfd03922-4638-4c20-8f52-b2ecec3d91c8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:35.294940 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bfd03922-4638-4c20-8f52-b2ecec3d91c8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:35.295386 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bfd03922-4638-4c20-8f52-b2ecec3d91c8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:35.301179 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d0926f17-e536-45bc-86dc-ca9470dbd1cf tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369" status: 200 len: 1325 microversion: 2.1 time: 0.472899 Jul 12 11:57:35.301792 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 905/1953] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:34 2022] GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 => generated 1325 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:35.314677 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-11491cc1-21b1-4be7-8b5a-2379b6806be6 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:35.326482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-11491cc1-21b1-4be7-8b5a-2379b6806be6 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:35.364477 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11491cc1-21b1-4be7-8b5a-2379b6806be6 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:35.367966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11491cc1-21b1-4be7-8b5a-2379b6806be6 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:35.369355 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11491cc1-21b1-4be7-8b5a-2379b6806be6 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:35.369901 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11491cc1-21b1-4be7-8b5a-2379b6806be6 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:35.787316 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bfd03922-4638-4c20-8f52-b2ecec3d91c8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:35.806647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bfd03922-4638-4c20-8f52-b2ecec3d91c8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:35.811919 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bfd03922-4638-4c20-8f52-b2ecec3d91c8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:35.813814 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bfd03922-4638-4c20-8f52-b2ecec3d91c8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1891 microversion: 2.42 time: 0.545783 Jul 12 11:57:35.825583 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1049/1954] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:35 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1891 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:35.832228 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-ab539462-3413-47bc-b3fd-031f3f9cb8f4 req-fa13d199-bfd7-47d6-af5c-62a464b61673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "tag": "f4cee665-cebb-4239-899b-d9d2a125a5c3"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:35.849180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-ab539462-3413-47bc-b3fd-031f3f9cb8f4 req-fa13d199-bfd7-47d6-af5c-62a464b61673 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:35.849639 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-ab539462-3413-47bc-b3fd-031f3f9cb8f4 req-fa13d199-bfd7-47d6-af5c-62a464b61673 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:35.873483 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-ab539462-3413-47bc-b3fd-031f3f9cb8f4 req-fa13d199-bfd7-47d6-af5c-62a464b61673 service nova] Creating event network-changed:f4cee665-cebb-4239-899b-d9d2a125a5c3 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:57:35.879081 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-ab539462-3413-47bc-b3fd-031f3f9cb8f4 req-fa13d199-bfd7-47d6-af5c-62a464b61673 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051998 Jul 12 11:57:35.879713 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1050/1955] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:35.886410 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7783944b-291f-4278-9ad7-b35d1990cafe tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:35.887003 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7783944b-291f-4278-9ad7-b35d1990cafe tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:35.894817 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7783944b-291f-4278-9ad7-b35d1990cafe tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:35.895575 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7783944b-291f-4278-9ad7-b35d1990cafe tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:35.896594 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7783944b-291f-4278-9ad7-b35d1990cafe tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:35.897206 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7783944b-291f-4278-9ad7-b35d1990cafe tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:35.926189 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7783944b-291f-4278-9ad7-b35d1990cafe tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:57:36.003454 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-11491cc1-21b1-4be7-8b5a-2379b6806be6 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'services' on Instance uuid 5836cf59-e6e4-4504-953a-733dead8acde {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:57:36.044961 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-11491cc1-21b1-4be7-8b5a-2379b6806be6 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 2036 microversion: 2.25 time: 0.742083 Jul 12 11:57:36.073084 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 906/1956] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:35 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 2036 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:36.074022 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7783944b-291f-4278-9ad7-b35d1990cafe tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 204 len: 0 microversion: 2.1 time: 0.192385 Jul 12 11:57:36.077907 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1051/1957] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:57:35 2022] DELETE /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:57:36.082209 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-56f640e3-8b40-4d39-ba9d-9423cd16ffdd tempest-SecurityGroupsTestAdminJSON-1578370117 tempest-SecurityGroupsTestAdminJSON-1578370117-project-admin] Calling method '.version_select at 0x7f5e13b060d0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:36.085653 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-830d9be8-087c-41e5-a02f-a832450466ed tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:36.086418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-830d9be8-087c-41e5-a02f-a832450466ed tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:36.093635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-830d9be8-087c-41e5-a02f-a832450466ed tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:36.094690 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-830d9be8-087c-41e5-a02f-a832450466ed tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:36.095494 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-830d9be8-087c-41e5-a02f-a832450466ed tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:36.095935 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-830d9be8-087c-41e5-a02f-a832450466ed tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:36.329460 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-830d9be8-087c-41e5-a02f-a832450466ed tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:36.338963 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-830d9be8-087c-41e5-a02f-a832450466ed tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.259137 Jul 12 11:57:36.339522 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1052/1958] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:36 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:36.344873 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-34b923a6-3e79-413c-8c4d-5c63203eaeea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:36.345831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-34b923a6-3e79-413c-8c4d-5c63203eaeea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:36.352545 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-34b923a6-3e79-413c-8c4d-5c63203eaeea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:36.353234 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-34b923a6-3e79-413c-8c4d-5c63203eaeea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:36.354574 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-34b923a6-3e79-413c-8c4d-5c63203eaeea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:36.355012 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-34b923a6-3e79-413c-8c4d-5c63203eaeea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:36.524999 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-34b923a6-3e79-413c-8c4d-5c63203eaeea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:36.535267 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-34b923a6-3e79-413c-8c4d-5c63203eaeea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1511 microversion: 2.1 time: 0.193595 Jul 12 11:57:36.539069 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1053/1959] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:36 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:36.550725 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-249b5cc2-0355-41db-a853-c53750d4e8fe tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849104-4", "block_migration": "auto"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:36.552914 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-249b5cc2-0355-41db-a853-c53750d4e8fe tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:36.559060 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-56f640e3-8b40-4d39-ba9d-9423cd16ffdd tempest-SecurityGroupsTestAdminJSON-1578370117 tempest-SecurityGroupsTestAdminJSON-1578370117-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/64c5ed76-795c-4c43-bed0-87f2e1d2e106" status: 202 len: 0 microversion: 2.1 time: 0.484630 Jul 12 11:57:36.560217 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 907/1960] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:57:36 2022] DELETE /compute/v2.1/os-security-groups/64c5ed76-795c-4c43-bed0-87f2e1d2e106 => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:57:36.565743 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-249b5cc2-0355-41db-a853-c53750d4e8fe tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:36.566304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-aa848f83-854a-4fe2-acf8-47444a004fd0 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:36.566812 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-249b5cc2-0355-41db-a853-c53750d4e8fe tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:36.566959 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-aa848f83-854a-4fe2-acf8-47444a004fd0 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:36.567983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-249b5cc2-0355-41db-a853-c53750d4e8fe tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:36.568699 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-249b5cc2-0355-41db-a853-c53750d4e8fe tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:36.576773 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aa848f83-854a-4fe2-acf8-47444a004fd0 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:36.582374 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aa848f83-854a-4fe2-acf8-47444a004fd0 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:36.583816 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aa848f83-854a-4fe2-acf8-47444a004fd0 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:36.584544 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aa848f83-854a-4fe2-acf8-47444a004fd0 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:36.616876 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-249b5cc2-0355-41db-a853-c53750d4e8fe tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'flavor' on Instance uuid 5836cf59-e6e4-4504-953a-733dead8acde {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:57:36.643246 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-249b5cc2-0355-41db-a853-c53750d4e8fe tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Going to try to live migrate instance to n-h2-849104-4 {{(pid=125984) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 12 11:57:36.927741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-aa848f83-854a-4fe2-acf8-47444a004fd0 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:36.944628 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-aa848f83-854a-4fe2-acf8-47444a004fd0 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 200 len: 1712 microversion: 2.1 time: 0.383029 Jul 12 11:57:36.945706 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 908/1961] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:36 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 1712 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:36.950849 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-26b7d1c7-22d8-4800-8037-baa36daabbce tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:36.951762 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-26b7d1c7-22d8-4800-8037-baa36daabbce tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:36.959246 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26b7d1c7-22d8-4800-8037-baa36daabbce tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:36.959770 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26b7d1c7-22d8-4800-8037-baa36daabbce tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:36.960656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26b7d1c7-22d8-4800-8037-baa36daabbce tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:36.961213 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26b7d1c7-22d8-4800-8037-baa36daabbce tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:37.255721 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-26b7d1c7-22d8-4800-8037-baa36daabbce tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:37.267035 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-26b7d1c7-22d8-4800-8037-baa36daabbce tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369" status: 200 len: 1325 microversion: 2.1 time: 0.318381 Jul 12 11:57:37.273036 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 909/1962] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:36 2022] GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 => generated 1325 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:37.290196 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-df0113aa-e9b3-4242-b748-96bcdf3c66be tempest-SecurityGroupsTestAdminJSON-2049990688 tempest-SecurityGroupsTestAdminJSON-2049990688-project] Calling method '.version_select at 0x7f5e13aae5e0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:38.473570 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-249b5cc2-0355-41db-a853-c53750d4e8fe tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde/action" status: 202 len: 0 microversion: 2.25 time: 1.931190 Jul 12 11:57:38.476540 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1054/1963] 10.222.0.50 () {62 vars in 1318 bytes} [Tue Jul 12 11:57:36 2022] POST /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde/action => generated 0 bytes in 1936 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:57:38.482799 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b011128d-a0bc-4b0e-8b2a-a9d784c418eb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:38.484244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b011128d-a0bc-4b0e-8b2a-a9d784c418eb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:38.494628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b011128d-a0bc-4b0e-8b2a-a9d784c418eb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:38.495608 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b011128d-a0bc-4b0e-8b2a-a9d784c418eb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:38.496797 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b011128d-a0bc-4b0e-8b2a-a9d784c418eb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:38.497460 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b011128d-a0bc-4b0e-8b2a-a9d784c418eb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:38.543226 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-df0113aa-e9b3-4242-b748-96bcdf3c66be tempest-SecurityGroupsTestAdminJSON-2049990688 tempest-SecurityGroupsTestAdminJSON-2049990688-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/e9dbb6ee-0a43-4b95-83d4-40ef681aa662" status: 202 len: 0 microversion: 2.1 time: 1.266948 Jul 12 11:57:38.545106 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 910/1964] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:57:37 2022] DELETE /compute/v2.1/os-security-groups/e9dbb6ee-0a43-4b95-83d4-40ef681aa662 => generated 0 bytes in 1270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:57:38.551238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-60f4f67b-8d37-457a-9633-65ecf36a6bc5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:38.552121 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-60f4f67b-8d37-457a-9633-65ecf36a6bc5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:38.568449 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60f4f67b-8d37-457a-9633-65ecf36a6bc5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:38.569063 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60f4f67b-8d37-457a-9633-65ecf36a6bc5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:38.586670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60f4f67b-8d37-457a-9633-65ecf36a6bc5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:38.587324 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60f4f67b-8d37-457a-9633-65ecf36a6bc5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:38.884399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b011128d-a0bc-4b0e-8b2a-a9d784c418eb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:38.898331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b011128d-a0bc-4b0e-8b2a-a9d784c418eb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:38.900198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b011128d-a0bc-4b0e-8b2a-a9d784c418eb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:38.907841 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b011128d-a0bc-4b0e-8b2a-a9d784c418eb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.428880 Jul 12 11:57:38.921527 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1055/1965] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:38 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:38.927844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-61933d4f-575d-4c4d-99f4-4738e6c7b41a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:38.929382 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-61933d4f-575d-4c4d-99f4-4738e6c7b41a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:38.940471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61933d4f-575d-4c4d-99f4-4738e6c7b41a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:38.941165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61933d4f-575d-4c4d-99f4-4738e6c7b41a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:38.942240 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61933d4f-575d-4c4d-99f4-4738e6c7b41a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:38.942916 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61933d4f-575d-4c4d-99f4-4738e6c7b41a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:38.948774 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:39.206050 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-60f4f67b-8d37-457a-9633-65ecf36a6bc5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:39.215282 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-60f4f67b-8d37-457a-9633-65ecf36a6bc5 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.668717 Jul 12 11:57:39.215863 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 911/1966] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:38 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:39.229208 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-d71a0a01-6e72-4a3f-b414-4ed61df9aad2 req-a564f03b-b7d7-4819-95d2-3ff9bb72322b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "tag": "89649079-3e25-40bb-b461-65345a57ea7f"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:39.255472 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-d71a0a01-6e72-4a3f-b414-4ed61df9aad2 req-a564f03b-b7d7-4819-95d2-3ff9bb72322b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:39.255963 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-d71a0a01-6e72-4a3f-b414-4ed61df9aad2 req-a564f03b-b7d7-4819-95d2-3ff9bb72322b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:39.270236 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-d71a0a01-6e72-4a3f-b414-4ed61df9aad2 req-a564f03b-b7d7-4819-95d2-3ff9bb72322b service nova] Creating event network-changed:89649079-3e25-40bb-b461-65345a57ea7f for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:57:39.275157 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-d71a0a01-6e72-4a3f-b414-4ed61df9aad2 req-a564f03b-b7d7-4819-95d2-3ff9bb72322b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051688 Jul 12 11:57:39.275766 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 912/1967] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:39.280929 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a4d9bf10-db7a-493c-9a53-eaa71e1a4a7b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:39.281656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a4d9bf10-db7a-493c-9a53-eaa71e1a4a7b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:39.288652 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4d9bf10-db7a-493c-9a53-eaa71e1a4a7b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:39.289109 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4d9bf10-db7a-493c-9a53-eaa71e1a4a7b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:39.290209 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4d9bf10-db7a-493c-9a53-eaa71e1a4a7b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:39.290817 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4d9bf10-db7a-493c-9a53-eaa71e1a4a7b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:39.381378 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-61933d4f-575d-4c4d-99f4-4738e6c7b41a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:39.394957 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-61933d4f-575d-4c4d-99f4-4738e6c7b41a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1511 microversion: 2.1 time: 0.472045 Jul 12 11:57:39.405026 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1056/1968] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:38 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1511 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:39.411809 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-248a504c-5c5e-41db-969b-e1df963269a2 req-e139fe7e-b451-47ac-8c41-dd5e1da39d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca97987-cbe1-4935-8285-25d11becf369", "name": "network-vif-plugged", "status": "completed", "tag": "c10832b8-0a8e-4f00-8f67-42689d927671"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:39.420716 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-248a504c-5c5e-41db-969b-e1df963269a2 req-e139fe7e-b451-47ac-8c41-dd5e1da39d79 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:39.421983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-248a504c-5c5e-41db-969b-e1df963269a2 req-e139fe7e-b451-47ac-8c41-dd5e1da39d79 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:39.437809 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-248a504c-5c5e-41db-969b-e1df963269a2 req-e139fe7e-b451-47ac-8c41-dd5e1da39d79 service nova] Creating event network-vif-plugged:c10832b8-0a8e-4f00-8f67-42689d927671 for instance 0ca97987-cbe1-4935-8285-25d11becf369 on n-h1-849104-4 Jul 12 11:57:39.443104 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-248a504c-5c5e-41db-969b-e1df963269a2 req-e139fe7e-b451-47ac-8c41-dd5e1da39d79 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036696 Jul 12 11:57:39.446818 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1057/1969] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:39.451961 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8acfab93-862d-4333-b585-8fe338765a1b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:39.452775 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8acfab93-862d-4333-b585-8fe338765a1b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:39.470527 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8acfab93-862d-4333-b585-8fe338765a1b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:39.470807 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8acfab93-862d-4333-b585-8fe338765a1b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:39.471602 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8acfab93-862d-4333-b585-8fe338765a1b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:39.472061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8acfab93-862d-4333-b585-8fe338765a1b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:39.642923 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a4d9bf10-db7a-493c-9a53-eaa71e1a4a7b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:39.651382 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a4d9bf10-db7a-493c-9a53-eaa71e1a4a7b tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 200 len: 1712 microversion: 2.1 time: 0.374303 Jul 12 11:57:39.652107 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 913/1970] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:39 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 1712 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:39.665905 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b6650ce2-4463-4ecc-a187-d5266ac03f55 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:39.666604 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b6650ce2-4463-4ecc-a187-d5266ac03f55 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:39.673337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b6650ce2-4463-4ecc-a187-d5266ac03f55 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:39.673844 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b6650ce2-4463-4ecc-a187-d5266ac03f55 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:39.674572 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b6650ce2-4463-4ecc-a187-d5266ac03f55 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:39.675010 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b6650ce2-4463-4ecc-a187-d5266ac03f55 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:39.777744 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8acfab93-862d-4333-b585-8fe338765a1b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:39.787375 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8acfab93-862d-4333-b585-8fe338765a1b tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369" status: 200 len: 1325 microversion: 2.1 time: 0.339379 Jul 12 11:57:39.797582 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1058/1971] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:39 2022] GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 => generated 1325 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:39.802814 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-84e222d4-936e-487b-a4ec-56ec159e2eef tempest-SecurityGroupsTestAdminJSON-2049990688 tempest-SecurityGroupsTestAdminJSON-2049990688-project] Calling method '.version_select at 0x7f5e09c250d0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:40.092288 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b6650ce2-4463-4ecc-a187-d5266ac03f55 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:40.106978 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b6650ce2-4463-4ecc-a187-d5266ac03f55 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:40.109443 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b6650ce2-4463-4ecc-a187-d5266ac03f55 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:40.111940 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b6650ce2-4463-4ecc-a187-d5266ac03f55 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1568 microversion: 2.25 time: 0.458246 Jul 12 11:57:40.112725 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 914/1972] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:39 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1568 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:40.141406 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3aaa41fe-66b2-413e-9ec3-32fc8aeee0d1 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:40.142253 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3aaa41fe-66b2-413e-9ec3-32fc8aeee0d1 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:40.151613 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3aaa41fe-66b2-413e-9ec3-32fc8aeee0d1 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:40.152623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3aaa41fe-66b2-413e-9ec3-32fc8aeee0d1 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:40.153804 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3aaa41fe-66b2-413e-9ec3-32fc8aeee0d1 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:40.155145 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3aaa41fe-66b2-413e-9ec3-32fc8aeee0d1 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:40.279954 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-84e222d4-936e-487b-a4ec-56ec159e2eef tempest-SecurityGroupsTestAdminJSON-2049990688 tempest-SecurityGroupsTestAdminJSON-2049990688-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/6db6d2e0-38b2-41f3-8e7f-d88c9fee6194" status: 202 len: 0 microversion: 2.1 time: 0.480589 Jul 12 11:57:40.281740 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1059/1973] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:57:39 2022] DELETE /compute/v2.1/os-security-groups/6db6d2e0-38b2-41f3-8e7f-d88c9fee6194 => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:57:40.290658 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-46bb5130-f470-46ae-86be-d68de2a1409d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:40.292384 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-46bb5130-f470-46ae-86be-d68de2a1409d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:40.302049 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46bb5130-f470-46ae-86be-d68de2a1409d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:40.302711 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46bb5130-f470-46ae-86be-d68de2a1409d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:40.303605 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46bb5130-f470-46ae-86be-d68de2a1409d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:40.304484 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46bb5130-f470-46ae-86be-d68de2a1409d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:40.680920 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-46bb5130-f470-46ae-86be-d68de2a1409d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:40.690004 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-46bb5130-f470-46ae-86be-d68de2a1409d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.406887 Jul 12 11:57:40.690593 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1060/1974] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:40 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:40.722852 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8c4c4e6f-9bc3-4302-b423-5b848202726f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:40.723906 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8c4c4e6f-9bc3-4302-b423-5b848202726f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:40.744687 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c4c4e6f-9bc3-4302-b423-5b848202726f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:40.745320 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c4c4e6f-9bc3-4302-b423-5b848202726f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:40.746423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c4c4e6f-9bc3-4302-b423-5b848202726f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:40.747030 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c4c4e6f-9bc3-4302-b423-5b848202726f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:40.820982 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3aaa41fe-66b2-413e-9ec3-32fc8aeee0d1 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:40.838309 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3aaa41fe-66b2-413e-9ec3-32fc8aeee0d1 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:40.844090 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3aaa41fe-66b2-413e-9ec3-32fc8aeee0d1 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:40.846668 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3aaa41fe-66b2-413e-9ec3-32fc8aeee0d1 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.719822 Jul 12 11:57:40.859285 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 915/1975] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:40 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:40.865783 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-526ccbc7-eb58-4963-abf2-52b315e47ae2 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:40.866976 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-526ccbc7-eb58-4963-abf2-52b315e47ae2 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:40.874706 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-526ccbc7-eb58-4963-abf2-52b315e47ae2 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:40.875972 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-526ccbc7-eb58-4963-abf2-52b315e47ae2 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:40.877132 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-526ccbc7-eb58-4963-abf2-52b315e47ae2 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:40.878016 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-526ccbc7-eb58-4963-abf2-52b315e47ae2 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:40.991257 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-526ccbc7-eb58-4963-abf2-52b315e47ae2 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964cbaadd80b4f5a9b9fb5e93ffb823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0302b07f834b4ea63ce4acf974e7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:41.004425 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-526ccbc7-eb58-4963-abf2-52b315e47ae2 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 200 len: 1361 microversion: 2.1 time: 0.151771 Jul 12 11:57:41.005598 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 916/1976] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:40 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:41.018260 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-66823b95-4e09-4eb3-b1c7-0d78cf6e0fb0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:41.019982 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-66823b95-4e09-4eb3-b1c7-0d78cf6e0fb0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:41.036821 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66823b95-4e09-4eb3-b1c7-0d78cf6e0fb0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:41.037597 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66823b95-4e09-4eb3-b1c7-0d78cf6e0fb0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:41.039056 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66823b95-4e09-4eb3-b1c7-0d78cf6e0fb0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:41.039675 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66823b95-4e09-4eb3-b1c7-0d78cf6e0fb0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:41.051336 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:41.564639 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8c4c4e6f-9bc3-4302-b423-5b848202726f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:41.576439 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-66823b95-4e09-4eb3-b1c7-0d78cf6e0fb0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:41.576816 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8c4c4e6f-9bc3-4302-b423-5b848202726f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1511 microversion: 2.1 time: 0.860550 Jul 12 11:57:41.579532 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1061/1977] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:40 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1511 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:41.593554 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-928b2360-8fbe-48de-9d9e-0323f2cca424 req-cba75afc-348e-41ce-aa82-ae9fdf86e3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc3618a9-c706-4a66-8b04-e989cdeff839", "name": "network-vif-deleted", "tag": "6927b294-4d68-4167-97e4-0188fa5d26fc"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:41.597433 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-66823b95-4e09-4eb3-b1c7-0d78cf6e0fb0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369" status: 200 len: 1325 microversion: 2.1 time: 0.589943 Jul 12 11:57:41.598297 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 917/1978] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:41 2022] GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 => generated 1325 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:41.607248 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-37c4250d-dd9b-4de6-a95b-85ff80042cbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:41.607880 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-37c4250d-dd9b-4de6-a95b-85ff80042cbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:41.616977 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-928b2360-8fbe-48de-9d9e-0323f2cca424 req-cba75afc-348e-41ce-aa82-ae9fdf86e3ea service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:41.619836 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-928b2360-8fbe-48de-9d9e-0323f2cca424 req-cba75afc-348e-41ce-aa82-ae9fdf86e3ea service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:41.639245 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37c4250d-dd9b-4de6-a95b-85ff80042cbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:41.639714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37c4250d-dd9b-4de6-a95b-85ff80042cbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:41.641810 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37c4250d-dd9b-4de6-a95b-85ff80042cbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:41.642268 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37c4250d-dd9b-4de6-a95b-85ff80042cbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:41.666098 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-928b2360-8fbe-48de-9d9e-0323f2cca424 req-cba75afc-348e-41ce-aa82-ae9fdf86e3ea service nova] Creating event network-vif-deleted:6927b294-4d68-4167-97e4-0188fa5d26fc for instance cc3618a9-c706-4a66-8b04-e989cdeff839 on n-h1-849104-4 Jul 12 11:57:41.675113 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-928b2360-8fbe-48de-9d9e-0323f2cca424 req-cba75afc-348e-41ce-aa82-ae9fdf86e3ea service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093727 Jul 12 11:57:41.678371 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1062/1979] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:41.685427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-170d8808-f63f-4d7c-865a-c943cf959c14 req-fed217b0-a7ab-4682-b15f-74da70edbe13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5836cf59-e6e4-4504-953a-733dead8acde", "name": "network-vif-unplugged", "status": "completed", "tag": "9d1c95ba-995c-41c8-92ae-3e0b94344536"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:41.710914 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-170d8808-f63f-4d7c-865a-c943cf959c14 req-fed217b0-a7ab-4682-b15f-74da70edbe13 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:41.712591 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-170d8808-f63f-4d7c-865a-c943cf959c14 req-fed217b0-a7ab-4682-b15f-74da70edbe13 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:41.753206 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-170d8808-f63f-4d7c-865a-c943cf959c14 req-fed217b0-a7ab-4682-b15f-74da70edbe13 service nova] Creating event network-vif-unplugged:9d1c95ba-995c-41c8-92ae-3e0b94344536 for instance 5836cf59-e6e4-4504-953a-733dead8acde on n-h1-849104-4 Jul 12 11:57:41.773066 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-170d8808-f63f-4d7c-865a-c943cf959c14 req-fed217b0-a7ab-4682-b15f-74da70edbe13 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091021 Jul 12 11:57:41.775355 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1063/1980] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:41.784938 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-850f31bc-0dd3-46e8-a529-50d65e88d865 req-c83fb5e8-8dc2-4991-bd51-66e80e464aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2fb044-0422-4634-bd32-08f216c8f6ab", "name": "network-vif-unplugged", "status": "completed", "tag": "76d05327-fea5-4bb0-aa1a-55e0103cdbcf"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:41.796510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-850f31bc-0dd3-46e8-a529-50d65e88d865 req-c83fb5e8-8dc2-4991-bd51-66e80e464aac service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:41.797933 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-850f31bc-0dd3-46e8-a529-50d65e88d865 req-c83fb5e8-8dc2-4991-bd51-66e80e464aac service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:41.816156 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-850f31bc-0dd3-46e8-a529-50d65e88d865 req-c83fb5e8-8dc2-4991-bd51-66e80e464aac service nova] Creating event network-vif-unplugged:76d05327-fea5-4bb0-aa1a-55e0103cdbcf for instance 1a2fb044-0422-4634-bd32-08f216c8f6ab on n-h2-849104-4 Jul 12 11:57:41.821829 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-850f31bc-0dd3-46e8-a529-50d65e88d865 req-c83fb5e8-8dc2-4991-bd51-66e80e464aac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044732 Jul 12 11:57:41.823036 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1064/1981] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:41.831662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c57a63b4-6bee-48aa-80b2-ff918a1ff853 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:41.833111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c57a63b4-6bee-48aa-80b2-ff918a1ff853 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:41.844295 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c57a63b4-6bee-48aa-80b2-ff918a1ff853 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:41.845226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c57a63b4-6bee-48aa-80b2-ff918a1ff853 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:41.846733 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c57a63b4-6bee-48aa-80b2-ff918a1ff853 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:41.847452 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c57a63b4-6bee-48aa-80b2-ff918a1ff853 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:42.213493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-37c4250d-dd9b-4de6-a95b-85ff80042cbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:42.234453 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-37c4250d-dd9b-4de6-a95b-85ff80042cbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:42.243748 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-37c4250d-dd9b-4de6-a95b-85ff80042cbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:42.245019 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-37c4250d-dd9b-4de6-a95b-85ff80042cbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1568 microversion: 2.25 time: 0.645610 Jul 12 11:57:42.255126 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 918/1982] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:41 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1568 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:42.270148 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-60d8e554-1a8a-4454-87d3-7ec389a8a884 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:42.274706 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-60d8e554-1a8a-4454-87d3-7ec389a8a884 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:42.316304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60d8e554-1a8a-4454-87d3-7ec389a8a884 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:42.317166 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60d8e554-1a8a-4454-87d3-7ec389a8a884 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:42.319801 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60d8e554-1a8a-4454-87d3-7ec389a8a884 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:42.322434 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60d8e554-1a8a-4454-87d3-7ec389a8a884 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:42.648534 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c57a63b4-6bee-48aa-80b2-ff918a1ff853 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:42.667958 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c57a63b4-6bee-48aa-80b2-ff918a1ff853 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.840822 Jul 12 11:57:42.669916 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1065/1983] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:41 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:42.679130 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0114ba44-16d6-4c5b-b52e-ec86f0adb131 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:42.681006 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0114ba44-16d6-4c5b-b52e-ec86f0adb131 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] [instance: cc3618a9-c706-4a66-8b04-e989cdeff839] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:42.699327 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0114ba44-16d6-4c5b-b52e-ec86f0adb131 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:42.700531 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0114ba44-16d6-4c5b-b52e-ec86f0adb131 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:42.706920 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0114ba44-16d6-4c5b-b52e-ec86f0adb131 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:42.708202 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0114ba44-16d6-4c5b-b52e-ec86f0adb131 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:42.742728 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-0114ba44-16d6-4c5b-b52e-ec86f0adb131 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] HTTP exception thrown: Instance cc3618a9-c706-4a66-8b04-e989cdeff839 could not be found. Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0114ba44-16d6-4c5b-b52e-ec86f0adb131 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Request method failure captured: Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 HTTP/1.1 Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWFfKLODT1IEEBdYCfGvqbeF0KRq5Tf3RI5OtdjsjhX4dvq_z7UicF9AlLxT3IpHahn6LDjf1bLbtT6RLT6pZCFXf_ToSyzJAAbXa4I4iT_ygMsmKHjavEKS01dPAOX850o1si4nqeuOx20zXOh8-wslv6pS7u--mM9ZJfqfFpI9KsY Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: bf0302b07f834b4ea63ce4acf974e7f8 Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersTestManualDisk-356120857 Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf0302b07f834b4ea63ce4acf974e7f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf0302b07f834b4ea63ce4acf974e7f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bf0302b07f834b4ea63ce4acf974e7f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bf0302b07f834b4ea63ce4acf974e7f8", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersTestManualDisk-356120857 Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: bf0302b07f834b4ea63ce4acf974e7f8 Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersTestManualDisk-356120857 Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersTestManualDisk-356120857-project Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 964cbaadd80b4f5a9b9fb5e93ffb823b Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersTestManualDisk-356120857-project Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance cc3618a9-c706-4a66-8b04-e989cdeff839 could not be found. Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'cc3618a9-c706-4a66-8b04-e989cdeff839'} Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc3618a9-c706-4a66-8b04-e989cdeff839 could not be found. Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc3618a9-c706-4a66-8b04-e989cdeff839 could not be found. Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:42.746143 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:42.753000 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:42.753000 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:42.753000 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:42.753000 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:57:42.753000 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:57:42.753000 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc3618a9-c706-4a66-8b04-e989cdeff839 could not be found. Jul 12 11:57:42.753000 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:42.754536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0114ba44-16d6-4c5b-b52e-ec86f0adb131 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Returning 404 to user: Instance cc3618a9-c706-4a66-8b04-e989cdeff839 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:57:42.756080 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0114ba44-16d6-4c5b-b52e-ec86f0adb131 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839" status: 404 len: 111 microversion: 2.1 time: 0.084090 Jul 12 11:57:42.757203 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1066/1984] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:42 2022] GET /compute/v2.1/servers/cc3618a9-c706-4a66-8b04-e989cdeff839 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:57:42.768208 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e066c3d5-8460-4a4d-a834-2d6539468ff0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:42.769842 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e066c3d5-8460-4a4d-a834-2d6539468ff0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:42.783838 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e066c3d5-8460-4a4d-a834-2d6539468ff0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:42.786703 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e066c3d5-8460-4a4d-a834-2d6539468ff0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:42.789284 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e066c3d5-8460-4a4d-a834-2d6539468ff0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:42.790340 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e066c3d5-8460-4a4d-a834-2d6539468ff0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:43.080989 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e066c3d5-8460-4a4d-a834-2d6539468ff0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:43.091985 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e066c3d5-8460-4a4d-a834-2d6539468ff0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1511 microversion: 2.1 time: 0.332393 Jul 12 11:57:43.092599 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1067/1985] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:42 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1511 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:43.098630 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7f7cb709-16bf-4e3f-b597-6464ed0a1ac0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:43.099503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7f7cb709-16bf-4e3f-b597-6464ed0a1ac0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:43.106662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7f7cb709-16bf-4e3f-b597-6464ed0a1ac0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:43.107776 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7f7cb709-16bf-4e3f-b597-6464ed0a1ac0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:43.108775 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7f7cb709-16bf-4e3f-b597-6464ed0a1ac0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:43.110198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7f7cb709-16bf-4e3f-b597-6464ed0a1ac0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:43.245442 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-60d8e554-1a8a-4454-87d3-7ec389a8a884 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:43.266680 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-60d8e554-1a8a-4454-87d3-7ec389a8a884 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:43.268647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-60d8e554-1a8a-4454-87d3-7ec389a8a884 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:43.270085 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-60d8e554-1a8a-4454-87d3-7ec389a8a884 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 1.012171 Jul 12 11:57:43.271142 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 919/1986] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:42 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:43.277568 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-04f9863a-f8bc-4554-8590-b7941009f468 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] Calling method '.version_select at 0x7f5e13a8a1f0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:43.306687 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-04f9863a-f8bc-4554-8590-b7941009f468 tempest-ServersTestManualDisk-356120857 tempest-ServersTestManualDisk-356120857-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-10054068" status: 202 len: 0 microversion: 2.1 time: 0.034302 Jul 12 11:57:43.308616 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 920/1987] 10.222.0.50 () {58 vars in 1214 bytes} [Tue Jul 12 11:57:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-10054068 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:57:43.316437 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-278d4955-9d51-473f-8ac6-cedcd83b798f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:43.317123 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-278d4955-9d51-473f-8ac6-cedcd83b798f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:43.337161 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-278d4955-9d51-473f-8ac6-cedcd83b798f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:43.340064 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-278d4955-9d51-473f-8ac6-cedcd83b798f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:43.342525 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-278d4955-9d51-473f-8ac6-cedcd83b798f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:43.343106 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-278d4955-9d51-473f-8ac6-cedcd83b798f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:43.445831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7f7cb709-16bf-4e3f-b597-6464ed0a1ac0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:43.458351 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7f7cb709-16bf-4e3f-b597-6464ed0a1ac0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369" status: 200 len: 1522 microversion: 2.1 time: 0.364418 Jul 12 11:57:43.462039 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1068/1988] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:43 2022] GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:43.480569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6744dbe7-9e9f-4cba-8944-ce8d687a2eee tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:43.481389 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6744dbe7-9e9f-4cba-8944-ce8d687a2eee tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:43.490148 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6744dbe7-9e9f-4cba-8944-ce8d687a2eee tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:43.490900 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6744dbe7-9e9f-4cba-8944-ce8d687a2eee tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:43.491929 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6744dbe7-9e9f-4cba-8944-ce8d687a2eee tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:43.492833 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6744dbe7-9e9f-4cba-8944-ce8d687a2eee tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:43.526844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6744dbe7-9e9f-4cba-8944-ce8d687a2eee tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:57:43.548112 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:43.649801 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6744dbe7-9e9f-4cba-8944-ce8d687a2eee tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369" status: 204 len: 0 microversion: 2.1 time: 0.171089 Jul 12 11:57:43.652137 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1069/1989] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:57:43 2022] DELETE /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:57:43.664289 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f11c8183-6195-4fa8-94e8-dc9c7f4727dd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:43.665342 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f11c8183-6195-4fa8-94e8-dc9c7f4727dd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:43.673483 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f11c8183-6195-4fa8-94e8-dc9c7f4727dd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:43.674288 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f11c8183-6195-4fa8-94e8-dc9c7f4727dd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:43.675612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f11c8183-6195-4fa8-94e8-dc9c7f4727dd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:43.676173 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f11c8183-6195-4fa8-94e8-dc9c7f4727dd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:43.716565 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:43.800462 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-278d4955-9d51-473f-8ac6-cedcd83b798f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:43.816237 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-278d4955-9d51-473f-8ac6-cedcd83b798f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:43.818028 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-278d4955-9d51-473f-8ac6-cedcd83b798f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:43.819223 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-278d4955-9d51-473f-8ac6-cedcd83b798f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1568 microversion: 2.25 time: 0.509080 Jul 12 11:57:43.819796 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 921/1990] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:43 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1568 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:43.836130 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-323e89f1-c7fe-4b6b-a9ce-25a794bfc692 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:43.836786 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-323e89f1-c7fe-4b6b-a9ce-25a794bfc692 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:43.854408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-323e89f1-c7fe-4b6b-a9ce-25a794bfc692 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:43.854698 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-323e89f1-c7fe-4b6b-a9ce-25a794bfc692 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:43.855344 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-323e89f1-c7fe-4b6b-a9ce-25a794bfc692 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:43.855979 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-323e89f1-c7fe-4b6b-a9ce-25a794bfc692 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:43.926805 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=8 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:43.932955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f11c8183-6195-4fa8-94e8-dc9c7f4727dd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:43.944386 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f11c8183-6195-4fa8-94e8-dc9c7f4727dd tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369" status: 200 len: 1528 microversion: 2.1 time: 0.286465 Jul 12 11:57:43.945245 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1070/1991] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:43 2022] GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 => generated 1528 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:57:43.950472 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-1521af2c-3c0e-46d5-9327-2b9f95c4cb0b req-2789bde6-885d-4e22-9223-75758ebd11e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5836cf59-e6e4-4504-953a-733dead8acde", "tag": "9d1c95ba-995c-41c8-92ae-3e0b94344536"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:43.960982 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-1521af2c-3c0e-46d5-9327-2b9f95c4cb0b req-2789bde6-885d-4e22-9223-75758ebd11e2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:43.961644 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-1521af2c-3c0e-46d5-9327-2b9f95c4cb0b req-2789bde6-885d-4e22-9223-75758ebd11e2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:43.978497 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-1521af2c-3c0e-46d5-9327-2b9f95c4cb0b req-2789bde6-885d-4e22-9223-75758ebd11e2 service nova] Creating event network-changed:9d1c95ba-995c-41c8-92ae-3e0b94344536 for instance 5836cf59-e6e4-4504-953a-733dead8acde on n-h1-849104-4 Jul 12 11:57:43.983891 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-1521af2c-3c0e-46d5-9327-2b9f95c4cb0b req-2789bde6-885d-4e22-9223-75758ebd11e2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037303 Jul 12 11:57:43.984822 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1071/1992] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:44.121177 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4c42e9e6-c1e4-41d2-8c71-4cb21254b48f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:44.122785 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4c42e9e6-c1e4-41d2-8c71-4cb21254b48f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:44.151757 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c42e9e6-c1e4-41d2-8c71-4cb21254b48f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:44.166664 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c42e9e6-c1e4-41d2-8c71-4cb21254b48f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:44.169864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c42e9e6-c1e4-41d2-8c71-4cb21254b48f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:44.171185 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4c42e9e6-c1e4-41d2-8c71-4cb21254b48f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:44.405952 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-323e89f1-c7fe-4b6b-a9ce-25a794bfc692 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:44.433225 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-323e89f1-c7fe-4b6b-a9ce-25a794bfc692 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.612060 Jul 12 11:57:44.435387 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 922/1993] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:43 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:44.455000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4e591df9-c71f-424e-9a3d-d75b211f7212 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:44.458297 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4e591df9-c71f-424e-9a3d-d75b211f7212 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:44.479809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e591df9-c71f-424e-9a3d-d75b211f7212 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:44.480689 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e591df9-c71f-424e-9a3d-d75b211f7212 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:44.483324 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e591df9-c71f-424e-9a3d-d75b211f7212 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:44.484435 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e591df9-c71f-424e-9a3d-d75b211f7212 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:44.573465 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4c42e9e6-c1e4-41d2-8c71-4cb21254b48f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:44.585809 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4c42e9e6-c1e4-41d2-8c71-4cb21254b48f tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1511 microversion: 2.1 time: 0.471633 Jul 12 11:57:44.588436 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1072/1994] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:44 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1511 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:44.856638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-40a224e3-3738-4de4-98ff-01aced818392 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:44.860679 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-40a224e3-3738-4de4-98ff-01aced818392 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:44.881707 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40a224e3-3738-4de4-98ff-01aced818392 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:44.882363 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40a224e3-3738-4de4-98ff-01aced818392 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:44.883598 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40a224e3-3738-4de4-98ff-01aced818392 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:44.884321 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40a224e3-3738-4de4-98ff-01aced818392 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:45.097491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4e591df9-c71f-424e-9a3d-d75b211f7212 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:45.121136 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4e591df9-c71f-424e-9a3d-d75b211f7212 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:45.123222 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4e591df9-c71f-424e-9a3d-d75b211f7212 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:45.128419 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4e591df9-c71f-424e-9a3d-d75b211f7212 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.687772 Jul 12 11:57:45.129080 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 923/1995] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:44 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:45.153015 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1b73e301-3e3f-41f9-a038-ac1caee6c7ac tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:45.154317 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1b73e301-3e3f-41f9-a038-ac1caee6c7ac tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:45.167700 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1b73e301-3e3f-41f9-a038-ac1caee6c7ac tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:45.168227 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1b73e301-3e3f-41f9-a038-ac1caee6c7ac tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:45.177507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1b73e301-3e3f-41f9-a038-ac1caee6c7ac tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:45.178834 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1b73e301-3e3f-41f9-a038-ac1caee6c7ac tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:45.580470 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-40a224e3-3738-4de4-98ff-01aced818392 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:45.591951 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-40a224e3-3738-4de4-98ff-01aced818392 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:45.594840 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-40a224e3-3738-4de4-98ff-01aced818392 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:45.597049 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-40a224e3-3738-4de4-98ff-01aced818392 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1568 microversion: 2.25 time: 0.747412 Jul 12 11:57:45.616496 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1073/1996] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:44 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1568 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:45.641515 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-59807e90-1cae-4acf-9028-5db552218f88 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:45.642623 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-59807e90-1cae-4acf-9028-5db552218f88 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:45.677181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59807e90-1cae-4acf-9028-5db552218f88 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:45.678850 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59807e90-1cae-4acf-9028-5db552218f88 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:45.689936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59807e90-1cae-4acf-9028-5db552218f88 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:45.693111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59807e90-1cae-4acf-9028-5db552218f88 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:46.143817 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1b73e301-3e3f-41f9-a038-ac1caee6c7ac tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:46.162970 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1b73e301-3e3f-41f9-a038-ac1caee6c7ac tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369" status: 200 len: 1528 microversion: 2.1 time: 1.025663 Jul 12 11:57:46.163875 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 924/1997] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:45 2022] GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 => generated 1528 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:46.169458 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4b6689c6-186d-411d-8d1f-4960deb89549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:46.170332 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4b6689c6-186d-411d-8d1f-4960deb89549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:46.177130 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:46.182159 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4b6689c6-186d-411d-8d1f-4960deb89549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:46.185139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4b6689c6-186d-411d-8d1f-4960deb89549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:46.186425 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4b6689c6-186d-411d-8d1f-4960deb89549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:46.186996 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4b6689c6-186d-411d-8d1f-4960deb89549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:46.441326 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-59807e90-1cae-4acf-9028-5db552218f88 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:46.457339 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-59807e90-1cae-4acf-9028-5db552218f88 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1391 microversion: 2.1 time: 0.829365 Jul 12 11:57:46.461006 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1074/1998] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:45 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1391 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:46.477242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-03c0435d-b24c-4778-9f65-83997ade71fb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:46.478224 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-03c0435d-b24c-4778-9f65-83997ade71fb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:46.496864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-03c0435d-b24c-4778-9f65-83997ade71fb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:46.497585 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-03c0435d-b24c-4778-9f65-83997ade71fb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:46.498544 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-03c0435d-b24c-4778-9f65-83997ade71fb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:46.502984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-03c0435d-b24c-4778-9f65-83997ade71fb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:46.799058 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4b6689c6-186d-411d-8d1f-4960deb89549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:46.807096 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4b6689c6-186d-411d-8d1f-4960deb89549 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1511 microversion: 2.1 time: 0.642025 Jul 12 11:57:46.812362 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 925/1999] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:46 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1511 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:47.121719 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1239634543", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:47.224437 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] validate_networks() for None {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:57:47.327868 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-03c0435d-b24c-4778-9f65-83997ade71fb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:47.348514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-03c0435d-b24c-4778-9f65-83997ade71fb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:47.353124 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-03c0435d-b24c-4778-9f65-83997ade71fb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:47.354927 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-03c0435d-b24c-4778-9f65-83997ade71fb tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.890297 Jul 12 11:57:47.355920 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1075/2000] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:46 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:47.371161 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a3b59f8f-3f0c-4e24-b67f-b69ce213bd06 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:47.372292 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a3b59f8f-3f0c-4e24-b67f-b69ce213bd06 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:47.380647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:47.383141 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3b59f8f-3f0c-4e24-b67f-b69ce213bd06 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:47.383861 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3b59f8f-3f0c-4e24-b67f-b69ce213bd06 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:47.385047 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3b59f8f-3f0c-4e24-b67f-b69ce213bd06 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:47.385958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3b59f8f-3f0c-4e24-b67f-b69ce213bd06 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:47.390852 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:47.803258 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a3b59f8f-3f0c-4e24-b67f-b69ce213bd06 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:47.822517 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a3b59f8f-3f0c-4e24-b67f-b69ce213bd06 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:47.824101 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a3b59f8f-3f0c-4e24-b67f-b69ce213bd06 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:47.829358 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a3b59f8f-3f0c-4e24-b67f-b69ce213bd06 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1568 microversion: 2.25 time: 0.470983 Jul 12 11:57:47.840865 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1076/2001] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:47 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1568 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:47.846613 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-56f9ce92-2679-48c8-bd07-a65b81c6db98 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:47.847533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-56f9ce92-2679-48c8-bd07-a65b81c6db98 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:47.864024 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-56f9ce92-2679-48c8-bd07-a65b81c6db98 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:47.865316 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-56f9ce92-2679-48c8-bd07-a65b81c6db98 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:47.866483 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-56f9ce92-2679-48c8-bd07-a65b81c6db98 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:47.867153 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-56f9ce92-2679-48c8-bd07-a65b81c6db98 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:48.567736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:57:48.568639 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:57:48.569200 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:57:48.569774 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:57:48.570674 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:57:48.616492 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:48.617693 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:48.621137 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:48.623036 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:48.681030 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Getting quotas for project 9846c91b05b54476a049745bed4d5528. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:57:48.702567 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Getting quotas for user bfe83c08467e4c5a9809b6f92e159761 and project 9846c91b05b54476a049745bed4d5528. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:57:48.743525 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:57:48.746133 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:57:48.815605 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cd26d171-c414-4940-aaf1-4d37a230132a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.001640 Jul 12 11:57:48.824732 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 926/2002] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:57:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:57:48.832781 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-19bf77fb-88e6-4a8f-b739-c2f1abf08d8d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:48.835944 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-19bf77fb-88e6-4a8f-b739-c2f1abf08d8d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:48.848089 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-19bf77fb-88e6-4a8f-b739-c2f1abf08d8d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:48.848957 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-19bf77fb-88e6-4a8f-b739-c2f1abf08d8d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:48.850158 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-19bf77fb-88e6-4a8f-b739-c2f1abf08d8d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:48.850788 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-19bf77fb-88e6-4a8f-b739-c2f1abf08d8d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:48.983396 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-56f9ce92-2679-48c8-bd07-a65b81c6db98 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0123721160c94b6785ed308618a2efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8030002dc7940b0a1bdf4f252fd5a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:48.996699 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-56f9ce92-2679-48c8-bd07-a65b81c6db98 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369" status: 200 len: 1528 microversion: 2.1 time: 1.152487 Jul 12 11:57:48.998613 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1077/2003] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:47 2022] GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 => generated 1528 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:49.008701 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-78359302-1de1-4fe5-89ff-300eb56d79c8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:49.009341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-78359302-1de1-4fe5-89ff-300eb56d79c8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:49.056796 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78359302-1de1-4fe5-89ff-300eb56d79c8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:49.058495 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78359302-1de1-4fe5-89ff-300eb56d79c8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:49.061100 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78359302-1de1-4fe5-89ff-300eb56d79c8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:49.063547 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-78359302-1de1-4fe5-89ff-300eb56d79c8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:49.641916 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-19bf77fb-88e6-4a8f-b739-c2f1abf08d8d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:49.663530 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-19bf77fb-88e6-4a8f-b739-c2f1abf08d8d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1381 microversion: 2.1 time: 0.833320 Jul 12 11:57:49.664918 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 927/2004] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:48 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1381 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:49.696006 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1ca219f0-0f47-4eda-9e77-c2379e11f657 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:49.700218 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1ca219f0-0f47-4eda-9e77-c2379e11f657 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:49.719351 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1ca219f0-0f47-4eda-9e77-c2379e11f657 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:49.721121 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1ca219f0-0f47-4eda-9e77-c2379e11f657 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:49.724490 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1ca219f0-0f47-4eda-9e77-c2379e11f657 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:49.726212 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1ca219f0-0f47-4eda-9e77-c2379e11f657 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:50.231606 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1ca219f0-0f47-4eda-9e77-c2379e11f657 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:50.245936 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1ca219f0-0f47-4eda-9e77-c2379e11f657 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:50.247882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1ca219f0-0f47-4eda-9e77-c2379e11f657 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:50.249371 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1ca219f0-0f47-4eda-9e77-c2379e11f657 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.567537 Jul 12 11:57:50.251068 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 928/2005] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:49 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:50.256602 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-217f96ca-b39d-4b08-be96-837f6531db93 req-7b0a95ed-0a58-4a90-abe1-3ca2a3bfee91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca97987-cbe1-4935-8285-25d11becf369", "name": "network-vif-deleted", "tag": "c10832b8-0a8e-4f00-8f67-42689d927671"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:50.265649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-217f96ca-b39d-4b08-be96-837f6531db93 req-7b0a95ed-0a58-4a90-abe1-3ca2a3bfee91 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:50.266462 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-217f96ca-b39d-4b08-be96-837f6531db93 req-7b0a95ed-0a58-4a90-abe1-3ca2a3bfee91 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:50.278872 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-217f96ca-b39d-4b08-be96-837f6531db93 req-7b0a95ed-0a58-4a90-abe1-3ca2a3bfee91 service nova] Creating event network-vif-deleted:c10832b8-0a8e-4f00-8f67-42689d927671 for instance 0ca97987-cbe1-4935-8285-25d11becf369 on n-h1-849104-4 Jul 12 11:57:50.289289 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-217f96ca-b39d-4b08-be96-837f6531db93 req-7b0a95ed-0a58-4a90-abe1-3ca2a3bfee91 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036723 Jul 12 11:57:50.291269 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 929/2006] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:50.298393 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-aebf0c60-e382-4383-b012-08083026f897 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:50.299451 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-aebf0c60-e382-4383-b012-08083026f897 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:50.306623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aebf0c60-e382-4383-b012-08083026f897 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:50.307485 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aebf0c60-e382-4383-b012-08083026f897 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:50.308620 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aebf0c60-e382-4383-b012-08083026f897 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:50.309322 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aebf0c60-e382-4383-b012-08083026f897 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:50.389926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-78359302-1de1-4fe5-89ff-300eb56d79c8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:50.411187 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-78359302-1de1-4fe5-89ff-300eb56d79c8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1511 microversion: 2.1 time: 1.408935 Jul 12 11:57:50.412621 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1078/2007] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:48 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1511 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:50.413083 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-aebf0c60-e382-4383-b012-08083026f897 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:50.432973 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-494ac812-4d4b-400b-a361-1dca0907e254 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:50.435091 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-494ac812-4d4b-400b-a361-1dca0907e254 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:50.442324 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-aebf0c60-e382-4383-b012-08083026f897 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 200 len: 1274 microversion: 2.1 time: 0.145744 Jul 12 11:57:50.443516 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 930/2008] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:50 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:50.450856 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-494ac812-4d4b-400b-a361-1dca0907e254 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:50.454937 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-494ac812-4d4b-400b-a361-1dca0907e254 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:50.457732 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-77b8a03c-2ea3-4cc7-9542-7f0b004c2678 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '.version_select at 0x7f5e13a4a790>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:50.458257 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-494ac812-4d4b-400b-a361-1dca0907e254 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:50.459410 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-494ac812-4d4b-400b-a361-1dca0907e254 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:50.467237 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77b8a03c-2ea3-4cc7-9542-7f0b004c2678 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:50.472160 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77b8a03c-2ea3-4cc7-9542-7f0b004c2678 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:50.497120 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-77b8a03c-2ea3-4cc7-9542-7f0b004c2678 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 2319 microversion: 2.1 time: 0.049321 Jul 12 11:57:50.500524 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 931/2009] 10.222.0.50 () {58 vars in 1142 bytes} [Tue Jul 12 11:57:50 2022] GET /compute/v2.1/os-migrations => generated 2319 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:50.511040 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-38457b3e-60d9-4d66-9ac3-ad659518a366 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:50.513298 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-38457b3e-60d9-4d66-9ac3-ad659518a366 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 0ca97987-cbe1-4935-8285-25d11becf369] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:50.530569 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-38457b3e-60d9-4d66-9ac3-ad659518a366 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:50.532061 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-38457b3e-60d9-4d66-9ac3-ad659518a366 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:50.536788 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-38457b3e-60d9-4d66-9ac3-ad659518a366 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:50.538239 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-38457b3e-60d9-4d66-9ac3-ad659518a366 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:50.571741 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-38457b3e-60d9-4d66-9ac3-ad659518a366 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] HTTP exception thrown: Instance 0ca97987-cbe1-4935-8285-25d11becf369 could not be found. Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-38457b3e-60d9-4d66-9ac3-ad659518a366 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Request method failure captured: Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 HTTP/1.1 Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWFAKIsN470Eihf_ppnEMm8ScuYYi-RlEoEhYKrKGQKnWRVVx8CL1_cx_wavxZ5Yb1nB9a1dc8SNphqIFzgLzRw54v5bQ1jw4-zQ4tTxc1iksIQtwaDQzo2UoXyxxwU1KRjPyEgUzHrMWJINvtRxEjh7-x3pnpa9F8J8cCj9xcSqENw Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8030002dc7940b0a1bdf4f252fd5a8c", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 0123721160c94b6785ed308618a2efc8 Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 0ca97987-cbe1-4935-8285-25d11becf369 could not be found. Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '0ca97987-cbe1-4935-8285-25d11becf369'} Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca97987-cbe1-4935-8285-25d11becf369 could not be found. Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca97987-cbe1-4935-8285-25d11becf369 could not be found. Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:50.574104 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:50.579524 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:50.579524 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:50.579524 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:50.579524 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:50.579524 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:57:50.579524 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:57:50.579524 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca97987-cbe1-4935-8285-25d11becf369 could not be found. Jul 12 11:57:50.579524 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:50.583436 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-38457b3e-60d9-4d66-9ac3-ad659518a366 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Returning 404 to user: Instance 0ca97987-cbe1-4935-8285-25d11becf369 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:57:50.585746 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-38457b3e-60d9-4d66-9ac3-ad659518a366 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369" status: 404 len: 111 microversion: 2.1 time: 0.083986 Jul 12 11:57:50.586916 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 932/2010] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:50 2022] GET /compute/v2.1/servers/0ca97987-cbe1-4935-8285-25d11becf369 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:57:50.594708 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-df626fec-779f-45b1-9cc0-a3541ea54db3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:50.595680 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-df626fec-779f-45b1-9cc0-a3541ea54db3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:50.603413 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-df626fec-779f-45b1-9cc0-a3541ea54db3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:50.604445 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-df626fec-779f-45b1-9cc0-a3541ea54db3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:50.605738 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-df626fec-779f-45b1-9cc0-a3541ea54db3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:50.606614 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-df626fec-779f-45b1-9cc0-a3541ea54db3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:51.156573 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-df626fec-779f-45b1-9cc0-a3541ea54db3 tempest-LiveMigrationTest-374940316 tempest-LiveMigrationTest-374940316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1532 microversion: 2.1 time: 0.568216 Jul 12 11:57:51.168357 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 933/2011] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:50 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1532 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:51.174962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2398b227-64b7-4c69-959e-f125644ac198 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '.version_select at 0x7f5e13acc310>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:51.225920 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-2398b227-64b7-4c69-959e-f125644ac198 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] HTTP exception thrown: Image not found. Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2398b227-64b7-4c69-959e-f125644ac198 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Request method failure captured: Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/images/34f7a8c2-f921-4c1a-8d33-1a088393b8ce HTTP/1.1 Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWFAKIsN470Eihf_ppnEMm8ScuYYi-RlEoEhYKrKGQKnWRVVx8CL1_cx_wavxZ5Yb1nB9a1dc8SNphqIFzgLzRw54v5bQ1jw4-zQ4tTxc1iksIQtwaDQzo2UoXyxxwU1KRjPyEgUzHrMWJINvtRxEjh7-x3pnpa9F8J8cCj9xcSqENw Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8030002dc7940b0a1bdf4f252fd5a8c", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 0123721160c94b6785ed308618a2efc8 Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: exception: Image not found. Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '34f7a8c2-f921-4c1a-8d33-1a088393b8ce'} Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 34f7a8c2-f921-4c1a-8d33-1a088393b8ce to delete Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 34f7a8c2-f921-4c1a-8d33-1a088393b8ce could not be found. Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:51.227667 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2398b227-64b7-4c69-959e-f125644ac198 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Returning 404 to user: Image not found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2398b227-64b7-4c69-959e-f125644ac198 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "DELETE /compute/v2.1/images/34f7a8c2-f921-4c1a-8d33-1a088393b8ce" status: 404 len: 62 microversion: 2.1 time: 0.067676 Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 934/2012] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:51 2022] DELETE /compute/v2.1/images/34f7a8c2-f921-4c1a-8d33-1a088393b8ce => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2d6f5f37-4328-48f3-9b20-dfb5c5d2d4d8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:51.237736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2d6f5f37-4328-48f3-9b20-dfb5c5d2d4d8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:51.252821 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-494ac812-4d4b-400b-a361-1dca0907e254 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:51.252990 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d6f5f37-4328-48f3-9b20-dfb5c5d2d4d8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:51.253467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d6f5f37-4328-48f3-9b20-dfb5c5d2d4d8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:51.254315 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d6f5f37-4328-48f3-9b20-dfb5c5d2d4d8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:51.254837 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d6f5f37-4328-48f3-9b20-dfb5c5d2d4d8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:51.275162 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-494ac812-4d4b-400b-a361-1dca0907e254 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:51.277361 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-494ac812-4d4b-400b-a361-1dca0907e254 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:51.279003 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-494ac812-4d4b-400b-a361-1dca0907e254 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1568 microversion: 2.25 time: 0.860826 Jul 12 11:57:51.283573 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2d6f5f37-4328-48f3-9b20-dfb5c5d2d4d8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:57:51.289693 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1079/2013] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:50 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1568 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:51.308897 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d31713f4-6576-47a0-a037-9d881e43c7eb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:51.309542 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d31713f4-6576-47a0-a037-9d881e43c7eb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:51.316910 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d31713f4-6576-47a0-a037-9d881e43c7eb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:51.317748 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d31713f4-6576-47a0-a037-9d881e43c7eb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:51.318762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d31713f4-6576-47a0-a037-9d881e43c7eb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:51.319416 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d31713f4-6576-47a0-a037-9d881e43c7eb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:51.337036 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-d31713f4-6576-47a0-a037-9d881e43c7eb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] HTTP exception thrown: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d31713f4-6576-47a0-a037-9d881e43c7eb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Request method failure captured: Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 HTTP/1.1 Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWFAKIsN470Eihf_ppnEMm8ScuYYi-RlEoEhYKrKGQKnWRVVx8CL1_cx_wavxZ5Yb1nB9a1dc8SNphqIFzgLzRw54v5bQ1jw4-zQ4tTxc1iksIQtwaDQzo2UoXyxxwU1KRjPyEgUzHrMWJINvtRxEjh7-x3pnpa9F8J8cCj9xcSqENw Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8030002dc7940b0a1bdf4f252fd5a8c", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0123721160c94b6785ed308618a2efc8 Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'c0e18c84-bf65-4225-8a78-916f5fc8eb09'} Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:57:51.339153 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:57:51.344146 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:51.344146 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.344146 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:51.344146 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.344146 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:51.344146 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:51.344146 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:51.344146 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:57:51.344146 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:57:51.344146 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:51.344146 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.346357 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d31713f4-6576-47a0-a037-9d881e43c7eb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Returning 404 to user: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:57:51.347726 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d31713f4-6576-47a0-a037-9d881e43c7eb tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 404 len: 111 microversion: 2.1 time: 0.052890 Jul 12 11:57:51.351742 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1080/2014] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:57:51 2022] DELETE /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:57:51.357491 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bee2ff66-947a-452c-b495-7d99f8afe73e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:51.358504 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bee2ff66-947a-452c-b495-7d99f8afe73e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:51.366349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bee2ff66-947a-452c-b495-7d99f8afe73e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:51.367680 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bee2ff66-947a-452c-b495-7d99f8afe73e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:51.368805 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bee2ff66-947a-452c-b495-7d99f8afe73e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:51.369491 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bee2ff66-947a-452c-b495-7d99f8afe73e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:51.410624 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2d6f5f37-4328-48f3-9b20-dfb5c5d2d4d8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 204 len: 0 microversion: 2.1 time: 0.179384 Jul 12 11:57:51.411410 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 935/2015] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:57:51 2022] DELETE /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:57:51.420390 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4b95943c-747b-484b-b795-d8d96911ce82 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:51.421057 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4b95943c-747b-484b-b795-d8d96911ce82 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: c0e18c84-bf65-4225-8a78-916f5fc8eb09] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:51.428676 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4b95943c-747b-484b-b795-d8d96911ce82 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:51.428899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4b95943c-747b-484b-b795-d8d96911ce82 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:51.429651 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4b95943c-747b-484b-b795-d8d96911ce82 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:51.430954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4b95943c-747b-484b-b795-d8d96911ce82 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:51.447577 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-4b95943c-747b-484b-b795-d8d96911ce82 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] HTTP exception thrown: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4b95943c-747b-484b-b795-d8d96911ce82 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Request method failure captured: Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 HTTP/1.1 Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWFAKIsN470Eihf_ppnEMm8ScuYYi-RlEoEhYKrKGQKnWRVVx8CL1_cx_wavxZ5Yb1nB9a1dc8SNphqIFzgLzRw54v5bQ1jw4-zQ4tTxc1iksIQtwaDQzo2UoXyxxwU1KRjPyEgUzHrMWJINvtRxEjh7-x3pnpa9F8J8cCj9xcSqENw Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8030002dc7940b0a1bdf4f252fd5a8c", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 0123721160c94b6785ed308618a2efc8 Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'c0e18c84-bf65-4225-8a78-916f5fc8eb09'} Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.449279 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:51.455405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.455405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:51.455405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:51.455405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:51.455405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:57:51.455405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:57:51.455405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. Jul 12 11:57:51.455405 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:51.455405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4b95943c-747b-484b-b795-d8d96911ce82 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Returning 404 to user: Instance c0e18c84-bf65-4225-8a78-916f5fc8eb09 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:57:51.455405 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4b95943c-747b-484b-b795-d8d96911ce82 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09" status: 404 len: 111 microversion: 2.1 time: 0.034781 Jul 12 11:57:51.455405 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 936/2016] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:51 2022] GET /compute/v2.1/servers/c0e18c84-bf65-4225-8a78-916f5fc8eb09 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:57:51.460737 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-172992bc-1bfb-4d39-bf66-872d7d4ee59d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:51.461354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-172992bc-1bfb-4d39-bf66-872d7d4ee59d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:51.467526 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-172992bc-1bfb-4d39-bf66-872d7d4ee59d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:51.467975 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-172992bc-1bfb-4d39-bf66-872d7d4ee59d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:51.469617 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-172992bc-1bfb-4d39-bf66-872d7d4ee59d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:51.470264 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-172992bc-1bfb-4d39-bf66-872d7d4ee59d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:51.490350 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:51.836922 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-172992bc-1bfb-4d39-bf66-872d7d4ee59d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:51.847711 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-172992bc-1bfb-4d39-bf66-872d7d4ee59d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1387 microversion: 2.1 time: 0.390702 Jul 12 11:57:51.858011 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 937/2017] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:51 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1387 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:51.863721 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-acf9924a-8710-42a5-8194-60b0d85e2dcd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:51.864717 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-acf9924a-8710-42a5-8194-60b0d85e2dcd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:51.873200 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-acf9924a-8710-42a5-8194-60b0d85e2dcd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:51.874077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-acf9924a-8710-42a5-8194-60b0d85e2dcd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:51.875154 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-acf9924a-8710-42a5-8194-60b0d85e2dcd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:51.875817 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-acf9924a-8710-42a5-8194-60b0d85e2dcd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:51.900965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bee2ff66-947a-452c-b495-7d99f8afe73e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:51.923190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bee2ff66-947a-452c-b495-7d99f8afe73e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:51.924954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bee2ff66-947a-452c-b495-7d99f8afe73e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:51.926225 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bee2ff66-947a-452c-b495-7d99f8afe73e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.573112 Jul 12 11:57:51.926873 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1081/2018] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:51 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:51.932159 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-66f1682c-70c6-4e06-802d-0d18f837ff02 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:51.932876 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-66f1682c-70c6-4e06-802d-0d18f837ff02 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:51.940523 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-66f1682c-70c6-4e06-802d-0d18f837ff02 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:51.941272 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-66f1682c-70c6-4e06-802d-0d18f837ff02 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:51.942181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-66f1682c-70c6-4e06-802d-0d18f837ff02 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:51.942698 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-66f1682c-70c6-4e06-802d-0d18f837ff02 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:52.037800 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-66f1682c-70c6-4e06-802d-0d18f837ff02 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:52.048307 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-66f1682c-70c6-4e06-802d-0d18f837ff02 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 200 len: 1280 microversion: 2.1 time: 0.119854 Jul 12 11:57:52.059574 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1082/2019] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:51 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 1280 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:52.059574 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f85e3cd4-749d-40fa-83f3-eaa891bdcea0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '.version_select at 0x7f5e0a31ba60>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:52.079241 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f85e3cd4-749d-40fa-83f3-eaa891bdcea0 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050432502" status: 202 len: 0 microversion: 2.1 time: 0.027151 Jul 12 11:57:52.080487 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1083/2020] 10.222.0.50 () {58 vars in 1220 bytes} [Tue Jul 12 11:57:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050432502 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:57:52.306645 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2bbb421a-7edb-4e1a-8328-69aa60dce6db tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:52.308239 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2bbb421a-7edb-4e1a-8328-69aa60dce6db tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:52.321659 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2bbb421a-7edb-4e1a-8328-69aa60dce6db tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:52.322409 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2bbb421a-7edb-4e1a-8328-69aa60dce6db tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:52.323601 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2bbb421a-7edb-4e1a-8328-69aa60dce6db tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:52.324391 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2bbb421a-7edb-4e1a-8328-69aa60dce6db tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:52.356269 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-acf9924a-8710-42a5-8194-60b0d85e2dcd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:52.373011 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-acf9924a-8710-42a5-8194-60b0d85e2dcd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1511 microversion: 2.1 time: 0.513460 Jul 12 11:57:52.386296 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 938/2021] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:51 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1511 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:52.392159 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-28960a8a-89b0-4c72-ab9c-77b007072116 req-e64ffd54-7db6-4a08-9a83-40719430161f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5836cf59-e6e4-4504-953a-733dead8acde", "name": "network-vif-unplugged", "status": "completed", "tag": "9d1c95ba-995c-41c8-92ae-3e0b94344536"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:52.415787 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-28960a8a-89b0-4c72-ab9c-77b007072116 req-e64ffd54-7db6-4a08-9a83-40719430161f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:52.416271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-28960a8a-89b0-4c72-ab9c-77b007072116 req-e64ffd54-7db6-4a08-9a83-40719430161f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:52.432729 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-28960a8a-89b0-4c72-ab9c-77b007072116 req-e64ffd54-7db6-4a08-9a83-40719430161f service nova] Creating event network-vif-unplugged:9d1c95ba-995c-41c8-92ae-3e0b94344536 for instance 5836cf59-e6e4-4504-953a-733dead8acde on n-h1-849104-4 Jul 12 11:57:52.439283 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-28960a8a-89b0-4c72-ab9c-77b007072116 req-e64ffd54-7db6-4a08-9a83-40719430161f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050849 Jul 12 11:57:52.440160 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 939/2022] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:52.867901 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-be36031a-fd72-4aec-b059-f187d2957385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:52.868917 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-be36031a-fd72-4aec-b059-f187d2957385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:52.875733 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-be36031a-fd72-4aec-b059-f187d2957385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:52.876926 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-be36031a-fd72-4aec-b059-f187d2957385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:52.878097 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-be36031a-fd72-4aec-b059-f187d2957385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:52.878714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-be36031a-fd72-4aec-b059-f187d2957385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:52.969035 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2bbb421a-7edb-4e1a-8328-69aa60dce6db tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:52.984559 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2bbb421a-7edb-4e1a-8328-69aa60dce6db tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:52.986680 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2bbb421a-7edb-4e1a-8328-69aa60dce6db tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:52.988586 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2bbb421a-7edb-4e1a-8328-69aa60dce6db tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1568 microversion: 2.25 time: 0.686309 Jul 12 11:57:52.989445 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1084/2023] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:52 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1568 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:52.996955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-97a996e7-5ad6-4f82-bd7c-e56c90faca47 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:52.999077 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-97a996e7-5ad6-4f82-bd7c-e56c90faca47 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:53.007613 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-97a996e7-5ad6-4f82-bd7c-e56c90faca47 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:53.008454 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-97a996e7-5ad6-4f82-bd7c-e56c90faca47 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:53.009432 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-97a996e7-5ad6-4f82-bd7c-e56c90faca47 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:53.010066 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-97a996e7-5ad6-4f82-bd7c-e56c90faca47 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:53.358449 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-be36031a-fd72-4aec-b059-f187d2957385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:53.368818 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-be36031a-fd72-4aec-b059-f187d2957385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1387 microversion: 2.1 time: 0.507262 Jul 12 11:57:53.369721 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 940/2024] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:52 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1387 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:57:53.374616 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d353c897-ed8d-49ef-88b2-6b63307445cd tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:53.376385 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d353c897-ed8d-49ef-88b2-6b63307445cd tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:53.393491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d353c897-ed8d-49ef-88b2-6b63307445cd tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:53.394310 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d353c897-ed8d-49ef-88b2-6b63307445cd tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:53.395534 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d353c897-ed8d-49ef-88b2-6b63307445cd tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:53.396231 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d353c897-ed8d-49ef-88b2-6b63307445cd tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:53.541839 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d353c897-ed8d-49ef-88b2-6b63307445cd tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:53.551113 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d353c897-ed8d-49ef-88b2-6b63307445cd tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 200 len: 1280 microversion: 2.1 time: 0.180105 Jul 12 11:57:53.552194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-97a996e7-5ad6-4f82-bd7c-e56c90faca47 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:53.552643 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 941/2025] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:53 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 1280 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:53.558082 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-67d00043-9b63-4a9d-9627-dc5fe51488c6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:53.558893 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-67d00043-9b63-4a9d-9627-dc5fe51488c6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:53.569775 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-67d00043-9b63-4a9d-9627-dc5fe51488c6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:53.570140 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-67d00043-9b63-4a9d-9627-dc5fe51488c6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:53.570927 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-67d00043-9b63-4a9d-9627-dc5fe51488c6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:53.571480 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-67d00043-9b63-4a9d-9627-dc5fe51488c6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:53.580940 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-97a996e7-5ad6-4f82-bd7c-e56c90faca47 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:53.587254 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-97a996e7-5ad6-4f82-bd7c-e56c90faca47 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:53.588740 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-97a996e7-5ad6-4f82-bd7c-e56c90faca47 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.597201 Jul 12 11:57:53.620974 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1085/2026] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:52 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:53.916460 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e2f784bd-3a4e-4405-9847-1c8c52c05bf4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Action: 'create', calling method: .version_select at 0x7f5e09f5e040>, body: {"keypair": {"name": "tempest-keypair-1195270634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaRcOGa9kw8RLdcW2E1y7HW8ovUtU1GCr5yQ0sv60u2BIbAGQQH6CdngdD9f+9R8A3NWOluVhn7QsHkL3MHKf7TSsDNUVhQYctx/nU96/PvONQ265ps7aG5SSW1YzB7+A=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:53.967579 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-e2f784bd-3a4e-4405-9847-1c8c52c05bf4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Getting quotas for project 55402baffcd84d95ab9c09fc11b55fa5. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:57:53.979834 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-e2f784bd-3a4e-4405-9847-1c8c52c05bf4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Getting quotas for user 173724289979423aaa08135e91b7f3dc and project 55402baffcd84d95ab9c09fc11b55fa5. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:57:53.997816 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-67d00043-9b63-4a9d-9627-dc5fe51488c6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:54.013506 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-67d00043-9b63-4a9d-9627-dc5fe51488c6 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1511 microversion: 2.1 time: 0.458922 Jul 12 11:57:54.015037 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 942/2027] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:53 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1511 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:54.025543 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-62b98ea9-f68d-40aa-927b-532ed2f2fdf9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:54.033302 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e2f784bd-3a4e-4405-9847-1c8c52c05bf4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.121871 Jul 12 11:57:54.037575 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1086/2028] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Jul 12 11:57:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 11:57:54.040505 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-62b98ea9-f68d-40aa-927b-532ed2f2fdf9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:54.056718 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-62b98ea9-f68d-40aa-927b-532ed2f2fdf9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:54.060304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-62b98ea9-f68d-40aa-927b-532ed2f2fdf9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:54.061483 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-62b98ea9-f68d-40aa-927b-532ed2f2fdf9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:54.067088 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-62b98ea9-f68d-40aa-927b-532ed2f2fdf9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:54.400758 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1e671cde-b852-4871-956f-202cdb9282fa tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:54.401752 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1e671cde-b852-4871-956f-202cdb9282fa tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:54.407369 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-62b98ea9-f68d-40aa-927b-532ed2f2fdf9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:54.421187 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-62b98ea9-f68d-40aa-927b-532ed2f2fdf9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:54.425407 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-62b98ea9-f68d-40aa-927b-532ed2f2fdf9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:54.432304 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-62b98ea9-f68d-40aa-927b-532ed2f2fdf9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1543 microversion: 2.25 time: 0.409506 Jul 12 11:57:54.436488 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 943/2029] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:54 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1543 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:54.457468 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6b6b1024-b987-4ec1-8f79-f8e986341a15 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '.version_select at 0x7f5e13a63f70>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:54.466245 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1e671cde-b852-4871-956f-202cdb9282fa tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:54.467305 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6b6b1024-b987-4ec1-8f79-f8e986341a15 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:54.468112 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1e671cde-b852-4871-956f-202cdb9282fa tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:54.469604 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6b6b1024-b987-4ec1-8f79-f8e986341a15 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:54.470267 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1e671cde-b852-4871-956f-202cdb9282fa tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:54.471370 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1e671cde-b852-4871-956f-202cdb9282fa tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:54.490968 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6b6b1024-b987-4ec1-8f79-f8e986341a15 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 2783 microversion: 2.25 time: 0.040241 Jul 12 11:57:54.499595 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 944/2030] 10.222.0.50 () {60 vars in 1183 bytes} [Tue Jul 12 11:57:54 2022] GET /compute/v2.1/os-migrations => generated 2783 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:57:54.514123 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3b3cd701-2b5c-4dce-9f49-3bd08da458a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:54.516140 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3b3cd701-2b5c-4dce-9f49-3bd08da458a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:54.529240 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b3cd701-2b5c-4dce-9f49-3bd08da458a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:54.530741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b3cd701-2b5c-4dce-9f49-3bd08da458a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:54.534445 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b3cd701-2b5c-4dce-9f49-3bd08da458a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:54.535588 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b3cd701-2b5c-4dce-9f49-3bd08da458a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:54.604307 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1e671cde-b852-4871-956f-202cdb9282fa tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:54.627090 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1e671cde-b852-4871-956f-202cdb9282fa tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1345 microversion: 2.1 time: 0.239954 Jul 12 11:57:54.628676 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1087/2031] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:54 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1345 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:54.646968 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-763f9758-a87e-4f38-9b22-a5e54fcaa9a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:54.647952 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-763f9758-a87e-4f38-9b22-a5e54fcaa9a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:54.660297 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-763f9758-a87e-4f38-9b22-a5e54fcaa9a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:54.661626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-763f9758-a87e-4f38-9b22-a5e54fcaa9a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:54.663050 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-763f9758-a87e-4f38-9b22-a5e54fcaa9a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:54.664177 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-763f9758-a87e-4f38-9b22-a5e54fcaa9a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:54.923096 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-3b3cd701-2b5c-4dce-9f49-3bd08da458a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'services' on Instance uuid 5836cf59-e6e4-4504-953a-733dead8acde {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:57:54.958523 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3b3cd701-2b5c-4dce-9f49-3bd08da458a0 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 2036 microversion: 2.25 time: 0.454741 Jul 12 11:57:54.959667 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 945/2032] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:54 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 2036 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:57:54.964444 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-eda9a64c-f01e-4aef-ba93-633c8ccee552 req-cab700b2-57b3-4256-8026-9a647aa99b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2fb044-0422-4634-bd32-08f216c8f6ab", "name": "network-vif-deleted", "tag": "76d05327-fea5-4bb0-aa1a-55e0103cdbcf"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:54.987393 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-eda9a64c-f01e-4aef-ba93-633c8ccee552 req-cab700b2-57b3-4256-8026-9a647aa99b57 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:54.988197 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-eda9a64c-f01e-4aef-ba93-633c8ccee552 req-cab700b2-57b3-4256-8026-9a647aa99b57 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:55.009437 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-eda9a64c-f01e-4aef-ba93-633c8ccee552 req-cab700b2-57b3-4256-8026-9a647aa99b57 service nova] Creating event network-vif-deleted:76d05327-fea5-4bb0-aa1a-55e0103cdbcf for instance 1a2fb044-0422-4634-bd32-08f216c8f6ab on n-h1-849104-4 Jul 12 11:57:55.026068 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-eda9a64c-f01e-4aef-ba93-633c8ccee552 req-cab700b2-57b3-4256-8026-9a647aa99b57 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064828 Jul 12 11:57:55.027139 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 946/2033] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:55.033074 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fe1e236a-93d4-4756-8a99-39bd40a4ea5e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:55.033709 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fe1e236a-93d4-4756-8a99-39bd40a4ea5e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:55.052067 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe1e236a-93d4-4756-8a99-39bd40a4ea5e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:55.052682 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe1e236a-93d4-4756-8a99-39bd40a4ea5e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:55.053476 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe1e236a-93d4-4756-8a99-39bd40a4ea5e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:55.053917 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fe1e236a-93d4-4756-8a99-39bd40a4ea5e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:55.176952 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-763f9758-a87e-4f38-9b22-a5e54fcaa9a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:55.187620 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-763f9758-a87e-4f38-9b22-a5e54fcaa9a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 200 len: 1322 microversion: 2.1 time: 0.557238 Jul 12 11:57:55.197348 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1088/2034] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:54 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 1322 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:55.203579 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9fe08853-958d-47ff-b0b1-89a214948f1a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Action: 'create', calling method: .version_select at 0x7f5e09dd44c0>, body: {"keypair": {"name": "tempest-keypair-1580805149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD75galbpR/zMi9zmoBYbKjkFv8D5vj2iBpcEu4MZhBnZp8iLIqpcX2bDPg1dWPYe+PmYq+lvdVRsZIoiRT3NHEDIEDbZxsqg4j4/nQxFPngc+tSgfnt8CqJpyEeKUL8Pg=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:55.230393 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-9fe08853-958d-47ff-b0b1-89a214948f1a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Getting quotas for project 29fd5f6c853549a794c75ebff736ccf4. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:57:55.245917 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-9fe08853-958d-47ff-b0b1-89a214948f1a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Getting quotas for user ae0b32f84b7146d49338e7a2c06bc579 and project 29fd5f6c853549a794c75ebff736ccf4. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:57:55.291792 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9fe08853-958d-47ff-b0b1-89a214948f1a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.092902 Jul 12 11:57:55.293069 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1089/2035] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Jul 12 11:57:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 11:57:55.301269 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fd91096b-043a-47d4-8161-80bc2970a3ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:55.302157 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fd91096b-043a-47d4-8161-80bc2970a3ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:55.311202 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fd91096b-043a-47d4-8161-80bc2970a3ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:55.311962 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fd91096b-043a-47d4-8161-80bc2970a3ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:55.312979 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fd91096b-043a-47d4-8161-80bc2970a3ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:55.313619 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fd91096b-043a-47d4-8161-80bc2970a3ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:55.475716 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fe1e236a-93d4-4756-8a99-39bd40a4ea5e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:55.488815 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fe1e236a-93d4-4756-8a99-39bd40a4ea5e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:55.492375 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fe1e236a-93d4-4756-8a99-39bd40a4ea5e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:55.494867 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fe1e236a-93d4-4756-8a99-39bd40a4ea5e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.466590 Jul 12 11:57:55.495900 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 947/2036] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:55 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:55.514640 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6aa0ba0c-3952-4d9c-b8b9-581e0f99cd66 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '.version_select at 0x7f5e13a56ca0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:55.569623 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-6aa0ba0c-3952-4d9c-b8b9-581e0f99cd66 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] HTTP exception thrown: Image not found. Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6aa0ba0c-3952-4d9c-b8b9-581e0f99cd66 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Request method failure captured: Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/images/669e67fa-6b39-42e8-b6f2-f11711fb248f HTTP/1.1 Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWFAKIsN470Eihf_ppnEMm8ScuYYi-RlEoEhYKrKGQKnWRVVx8CL1_cx_wavxZ5Yb1nB9a1dc8SNphqIFzgLzRw54v5bQ1jw4-zQ4tTxc1iksIQtwaDQzo2UoXyxxwU1KRjPyEgUzHrMWJINvtRxEjh7-x3pnpa9F8J8cCj9xcSqENw Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8030002dc7940b0a1bdf4f252fd5a8c", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 0123721160c94b6785ed308618a2efc8 Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: exception: Image not found. Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '669e67fa-6b39-42e8-b6f2-f11711fb248f'} Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 669e67fa-6b39-42e8-b6f2-f11711fb248f to delete Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 669e67fa-6b39-42e8-b6f2-f11711fb248f could not be found. Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:55.571517 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.578254 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6aa0ba0c-3952-4d9c-b8b9-581e0f99cd66 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Returning 404 to user: Image not found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:57:55.583715 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6aa0ba0c-3952-4d9c-b8b9-581e0f99cd66 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "DELETE /compute/v2.1/images/669e67fa-6b39-42e8-b6f2-f11711fb248f" status: 404 len: 62 microversion: 2.1 time: 0.084548 Jul 12 11:57:55.584867 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 948/2037] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:55 2022] DELETE /compute/v2.1/images/669e67fa-6b39-42e8-b6f2-f11711fb248f => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:57:55.598282 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d2bcfbae-b62d-4d54-b557-d04ec6187675 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:55.598952 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d2bcfbae-b62d-4d54-b557-d04ec6187675 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:55.607434 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d2bcfbae-b62d-4d54-b557-d04ec6187675 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:55.608092 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d2bcfbae-b62d-4d54-b557-d04ec6187675 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:55.609741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d2bcfbae-b62d-4d54-b557-d04ec6187675 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:55.610310 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d2bcfbae-b62d-4d54-b557-d04ec6187675 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:55.627138 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-d2bcfbae-b62d-4d54-b557-d04ec6187675 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] HTTP exception thrown: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d2bcfbae-b62d-4d54-b557-d04ec6187675 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Request method failure captured: Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed HTTP/1.1 Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWFAKIsN470Eihf_ppnEMm8ScuYYi-RlEoEhYKrKGQKnWRVVx8CL1_cx_wavxZ5Yb1nB9a1dc8SNphqIFzgLzRw54v5bQ1jw4-zQ4tTxc1iksIQtwaDQzo2UoXyxxwU1KRjPyEgUzHrMWJINvtRxEjh7-x3pnpa9F8J8cCj9xcSqENw Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8030002dc7940b0a1bdf4f252fd5a8c", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 0123721160c94b6785ed308618a2efc8 Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '00c4b145-fdb3-4993-9354-f18a94e807ed'} Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:57:55.629171 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:57:55.634833 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:57:55.634833 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.634833 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:55.634833 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.634833 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:55.634833 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:55.634833 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:55.634833 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:57:55.634833 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:57:55.634833 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:57:55.634833 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.634833 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d2bcfbae-b62d-4d54-b557-d04ec6187675 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Returning 404 to user: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:57:55.636218 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d2bcfbae-b62d-4d54-b557-d04ec6187675 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "DELETE /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 404 len: 111 microversion: 2.1 time: 0.041366 Jul 12 11:57:55.637108 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 949/2038] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:57:55 2022] DELETE /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:57:55.645065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-afb3b855-775e-44b8-bb83-d58d2e0fce7f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:55.646099 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-afb3b855-775e-44b8-bb83-d58d2e0fce7f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:55.653105 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-afb3b855-775e-44b8-bb83-d58d2e0fce7f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:55.653966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-afb3b855-775e-44b8-bb83-d58d2e0fce7f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:55.655020 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-afb3b855-775e-44b8-bb83-d58d2e0fce7f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:55.655727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-afb3b855-775e-44b8-bb83-d58d2e0fce7f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:55.812252 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-afb3b855-775e-44b8-bb83-d58d2e0fce7f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:55.831323 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-afb3b855-775e-44b8-bb83-d58d2e0fce7f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1184 microversion: 2.1 time: 0.190159 Jul 12 11:57:55.831908 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 950/2039] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:55 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1184 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:55.837139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a3ad3a44-183f-43b2-a4d7-cd11982eb3b5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:55.837770 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a3ad3a44-183f-43b2-a4d7-cd11982eb3b5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] [instance: 00c4b145-fdb3-4993-9354-f18a94e807ed] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:55.845219 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a3ad3a44-183f-43b2-a4d7-cd11982eb3b5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:55.845988 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a3ad3a44-183f-43b2-a4d7-cd11982eb3b5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:55.847039 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a3ad3a44-183f-43b2-a4d7-cd11982eb3b5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:55.847949 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a3ad3a44-183f-43b2-a4d7-cd11982eb3b5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:55.872812 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-a3ad3a44-183f-43b2-a4d7-cd11982eb3b5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] HTTP exception thrown: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a3ad3a44-183f-43b2-a4d7-cd11982eb3b5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Request method failure captured: Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed HTTP/1.1 Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWFAKIsN470Eihf_ppnEMm8ScuYYi-RlEoEhYKrKGQKnWRVVx8CL1_cx_wavxZ5Yb1nB9a1dc8SNphqIFzgLzRw54v5bQ1jw4-zQ4tTxc1iksIQtwaDQzo2UoXyxxwU1KRjPyEgUzHrMWJINvtRxEjh7-x3pnpa9F8J8cCj9xcSqENw Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8030002dc7940b0a1bdf4f252fd5a8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8030002dc7940b0a1bdf4f252fd5a8c", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: d8030002dc7940b0a1bdf4f252fd5a8c Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808776984 Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 0123721160c94b6785ed308618a2efc8 Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808776984-project Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '00c4b145-fdb3-4993-9354-f18a94e807ed'} Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.888306 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:57:55.894821 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.894821 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:57:55.894821 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:57:55.894821 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:57:55.894821 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:57:55.894821 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:57:55.894821 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. Jul 12 11:57:55.894821 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:57:55.897342 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a3ad3a44-183f-43b2-a4d7-cd11982eb3b5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] Returning 404 to user: Instance 00c4b145-fdb3-4993-9354-f18a94e807ed could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:57:55.898706 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a3ad3a44-183f-43b2-a4d7-cd11982eb3b5 tempest-ImagesOneServerNegativeTestJSON-808776984 tempest-ImagesOneServerNegativeTestJSON-808776984-project] 10.222.0.50 "GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed" status: 404 len: 111 microversion: 2.1 time: 0.065412 Jul 12 11:57:55.899796 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 951/2040] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:55 2022] GET /compute/v2.1/servers/00c4b145-fdb3-4993-9354-f18a94e807ed => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:57:55.905503 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-d2fc4eca-dfd2-417e-bedb-c0112402fe66 req-6eb863bb-5f7a-44b0-a625-12eb917b7d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f7a3be4-ad42-48af-ad94-1eb23cb5a198", "tag": "405808ec-8898-4789-89b7-b93f71cb824d"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:57:55.916326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-d2fc4eca-dfd2-417e-bedb-c0112402fe66 req-6eb863bb-5f7a-44b0-a625-12eb917b7d28 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:55.918287 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-d2fc4eca-dfd2-417e-bedb-c0112402fe66 req-6eb863bb-5f7a-44b0-a625-12eb917b7d28 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:55.933727 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-d2fc4eca-dfd2-417e-bedb-c0112402fe66 req-6eb863bb-5f7a-44b0-a625-12eb917b7d28 service nova] Creating event network-changed:405808ec-8898-4789-89b7-b93f71cb824d for instance 2f7a3be4-ad42-48af-ad94-1eb23cb5a198 on n-h1-849104-4 Jul 12 11:57:55.940510 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-d2fc4eca-dfd2-417e-bedb-c0112402fe66 req-6eb863bb-5f7a-44b0-a625-12eb917b7d28 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038939 Jul 12 11:57:55.942006 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 952/2041] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:57:56.169639 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fd91096b-043a-47d4-8161-80bc2970a3ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:56.180891 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fd91096b-043a-47d4-8161-80bc2970a3ad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1488 microversion: 2.1 time: 0.886572 Jul 12 11:57:56.182186 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1090/2042] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:55 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1488 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:56.199188 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-84e28728-8bae-4b5b-a812-e11de76a7318 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:56.199754 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-84e28728-8bae-4b5b-a812-e11de76a7318 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:56.205578 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-86bc629d-6e51-4091-a12a-813a154fb824 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:56.207899 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-86bc629d-6e51-4091-a12a-813a154fb824 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:56.222506 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-84e28728-8bae-4b5b-a812-e11de76a7318 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:56.225659 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-86bc629d-6e51-4091-a12a-813a154fb824 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:56.226474 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-84e28728-8bae-4b5b-a812-e11de76a7318 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:56.229181 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-84e28728-8bae-4b5b-a812-e11de76a7318 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:56.229893 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-86bc629d-6e51-4091-a12a-813a154fb824 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:56.232936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-86bc629d-6e51-4091-a12a-813a154fb824 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:56.233113 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-84e28728-8bae-4b5b-a812-e11de76a7318 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:56.236841 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-86bc629d-6e51-4091-a12a-813a154fb824 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:56.292711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-84e28728-8bae-4b5b-a812-e11de76a7318 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:57:56.414381 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-84e28728-8bae-4b5b-a812-e11de76a7318 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 204 len: 0 microversion: 2.1 time: 0.219221 Jul 12 11:57:56.421318 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 953/2043] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:57:56 2022] DELETE /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:57:56.430184 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8cc6c835-650f-4cd0-89fe-6da4661f26e5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:56.431201 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8cc6c835-650f-4cd0-89fe-6da4661f26e5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:56.441925 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8cc6c835-650f-4cd0-89fe-6da4661f26e5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:56.442711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8cc6c835-650f-4cd0-89fe-6da4661f26e5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:56.443999 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8cc6c835-650f-4cd0-89fe-6da4661f26e5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:56.444650 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8cc6c835-650f-4cd0-89fe-6da4661f26e5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:56.509612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-86bc629d-6e51-4091-a12a-813a154fb824 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:56.529246 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-86bc629d-6e51-4091-a12a-813a154fb824 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 200 len: 1322 microversion: 2.1 time: 0.327305 Jul 12 11:57:56.533880 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1091/2044] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:56 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:56.540263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f861ab1a-4b07-4bea-ae6d-58dee200b0d6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:56.541157 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f861ab1a-4b07-4bea-ae6d-58dee200b0d6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:56.549231 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f861ab1a-4b07-4bea-ae6d-58dee200b0d6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:56.550722 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f861ab1a-4b07-4bea-ae6d-58dee200b0d6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:56.551719 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f861ab1a-4b07-4bea-ae6d-58dee200b0d6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:56.552683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f861ab1a-4b07-4bea-ae6d-58dee200b0d6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:56.948702 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f861ab1a-4b07-4bea-ae6d-58dee200b0d6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:56.967394 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f861ab1a-4b07-4bea-ae6d-58dee200b0d6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:56.972147 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f861ab1a-4b07-4bea-ae6d-58dee200b0d6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:56.975651 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f861ab1a-4b07-4bea-ae6d-58dee200b0d6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.439837 Jul 12 11:57:56.977085 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1092/2045] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:56 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:57:56.983736 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d358dddc-3e46-4628-8928-684856c0d105 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:56.985668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d358dddc-3e46-4628-8928-684856c0d105 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:56.994426 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d358dddc-3e46-4628-8928-684856c0d105 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:56.995605 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d358dddc-3e46-4628-8928-684856c0d105 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:56.996572 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d358dddc-3e46-4628-8928-684856c0d105 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:56.997244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d358dddc-3e46-4628-8928-684856c0d105 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:57.023384 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8cc6c835-650f-4cd0-89fe-6da4661f26e5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:57.038749 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8cc6c835-650f-4cd0-89fe-6da4661f26e5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1494 microversion: 2.1 time: 0.613768 Jul 12 11:57:57.039857 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 954/2046] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:56 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1494 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:57.132155 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d358dddc-3e46-4628-8928-684856c0d105 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:57.146192 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d358dddc-3e46-4628-8928-684856c0d105 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1184 microversion: 2.1 time: 0.166834 Jul 12 11:57:57.148196 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1093/2047] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:56 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1184 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:57.550701 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ba6570d0-3120-46c6-a8c9-2c8ec1ee5a36 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:57.551478 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ba6570d0-3120-46c6-a8c9-2c8ec1ee5a36 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:57.558356 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ba6570d0-3120-46c6-a8c9-2c8ec1ee5a36 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:57.559012 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ba6570d0-3120-46c6-a8c9-2c8ec1ee5a36 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:57.560295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ba6570d0-3120-46c6-a8c9-2c8ec1ee5a36 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:57.560295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ba6570d0-3120-46c6-a8c9-2c8ec1ee5a36 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:57.995007 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e49ae5c1-94fa-422d-b46a-e7698a4bd395 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:57.995891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e49ae5c1-94fa-422d-b46a-e7698a4bd395 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:58.015003 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e49ae5c1-94fa-422d-b46a-e7698a4bd395 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:58.021450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e49ae5c1-94fa-422d-b46a-e7698a4bd395 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:58.022513 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e49ae5c1-94fa-422d-b46a-e7698a4bd395 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:58.023369 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e49ae5c1-94fa-422d-b46a-e7698a4bd395 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:58.261900 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ba6570d0-3120-46c6-a8c9-2c8ec1ee5a36 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:58.272357 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ba6570d0-3120-46c6-a8c9-2c8ec1ee5a36 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 200 len: 1322 microversion: 2.1 time: 0.726584 Jul 12 11:57:58.273063 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 955/2048] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:57 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 1322 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:57:58.294717 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-35a5fe83-34c6-4396-a9d4-739d1b59c3eb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:58.295628 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-35a5fe83-34c6-4396-a9d4-739d1b59c3eb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:58.311074 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35a5fe83-34c6-4396-a9d4-739d1b59c3eb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:58.315508 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35a5fe83-34c6-4396-a9d4-739d1b59c3eb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:58.316688 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35a5fe83-34c6-4396-a9d4-739d1b59c3eb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:58.317335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-35a5fe83-34c6-4396-a9d4-739d1b59c3eb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:58.378238 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e49ae5c1-94fa-422d-b46a-e7698a4bd395 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:58.394520 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e49ae5c1-94fa-422d-b46a-e7698a4bd395 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:58.398476 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e49ae5c1-94fa-422d-b46a-e7698a4bd395 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:58.401968 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e49ae5c1-94fa-422d-b46a-e7698a4bd395 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.411075 Jul 12 11:57:58.405626 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1094/2049] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:57 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:57:58.413692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dc2fce95-082a-4f22-9c52-af515cbe8ff8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:58.420766 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dc2fce95-082a-4f22-9c52-af515cbe8ff8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:58.440576 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc2fce95-082a-4f22-9c52-af515cbe8ff8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:58.441434 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc2fce95-082a-4f22-9c52-af515cbe8ff8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:58.442518 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc2fce95-082a-4f22-9c52-af515cbe8ff8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:58.443201 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dc2fce95-082a-4f22-9c52-af515cbe8ff8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:58.650890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:58.736703 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=6 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:58.736897 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dc2fce95-082a-4f22-9c52-af515cbe8ff8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:58.745054 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dc2fce95-082a-4f22-9c52-af515cbe8ff8 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1184 microversion: 2.1 time: 0.335185 Jul 12 11:57:58.756754 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1095/2050] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:58 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1184 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:58.876354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-35a5fe83-34c6-4396-a9d4-739d1b59c3eb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:58.886477 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-35a5fe83-34c6-4396-a9d4-739d1b59c3eb tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1494 microversion: 2.1 time: 0.602725 Jul 12 11:57:58.887626 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 956/2051] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:58 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1494 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:59.290927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0124712a-ea59-49de-8a7b-cb415b7e30a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:59.292170 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0124712a-ea59-49de-8a7b-cb415b7e30a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:59.309996 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0124712a-ea59-49de-8a7b-cb415b7e30a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:59.310759 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0124712a-ea59-49de-8a7b-cb415b7e30a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:59.311733 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0124712a-ea59-49de-8a7b-cb415b7e30a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:59.312455 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0124712a-ea59-49de-8a7b-cb415b7e30a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:59.358506 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:59.424621 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6ca8a78e-2961-4c8c-9f94-cd63e6caa2f7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:59.425933 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6ca8a78e-2961-4c8c-9f94-cd63e6caa2f7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:59.441221 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ca8a78e-2961-4c8c-9f94-cd63e6caa2f7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:59.441982 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ca8a78e-2961-4c8c-9f94-cd63e6caa2f7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:59.442948 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ca8a78e-2961-4c8c-9f94-cd63e6caa2f7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:59.443552 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6ca8a78e-2961-4c8c-9f94-cd63e6caa2f7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:59.448209 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:57:59.696367 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0124712a-ea59-49de-8a7b-cb415b7e30a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:59.706366 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0124712a-ea59-49de-8a7b-cb415b7e30a4 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 200 len: 1322 microversion: 2.1 time: 0.419307 Jul 12 11:57:59.716077 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1096/2052] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:59 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 1322 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:59.802585 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5d824cf0-f468-4b91-b57e-aff5e89c4404 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:59.803638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5d824cf0-f468-4b91-b57e-aff5e89c4404 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:59.810831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5d824cf0-f468-4b91-b57e-aff5e89c4404 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:59.812994 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5d824cf0-f468-4b91-b57e-aff5e89c4404 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:59.816599 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5d824cf0-f468-4b91-b57e-aff5e89c4404 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:59.817257 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5d824cf0-f468-4b91-b57e-aff5e89c4404 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:59.913588 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5d824cf0-f468-4b91-b57e-aff5e89c4404 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:57:59.921864 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5d824cf0-f468-4b91-b57e-aff5e89c4404 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 200 len: 1184 microversion: 2.1 time: 0.138254 Jul 12 11:57:59.922520 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1097/2053] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:59 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 1184 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:57:59.947848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-33f30029-bb28-4824-810e-acb9da2331e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:57:59.952186 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-33f30029-bb28-4824-810e-acb9da2331e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:57:59.966099 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-33f30029-bb28-4824-810e-acb9da2331e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:59.966562 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-33f30029-bb28-4824-810e-acb9da2331e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:57:59.967370 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-33f30029-bb28-4824-810e-acb9da2331e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:57:59.967819 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-33f30029-bb28-4824-810e-acb9da2331e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:00.127388 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6ca8a78e-2961-4c8c-9f94-cd63e6caa2f7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:00.133453 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-33f30029-bb28-4824-810e-acb9da2331e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:00.153307 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-33f30029-bb28-4824-810e-acb9da2331e7 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 200 len: 1452 microversion: 2.1 time: 0.209179 Jul 12 11:58:00.156359 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1098/2054] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:57:59 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 1452 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:00.165567 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6ca8a78e-2961-4c8c-9f94-cd63e6caa2f7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:00.171131 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6ca8a78e-2961-4c8c-9f94-cd63e6caa2f7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:00.173255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-22584cd0-c300-4548-9b84-04f4e0a46e3b req-99a94702-bc8f-4c87-9387-6652bbceed81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6a507e-64a6-490c-8dbd-bf23feec571c", "name": "network-vif-deleted", "tag": "ec142fac-be48-431f-8191-564d18afd7ca"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:00.176864 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6ca8a78e-2961-4c8c-9f94-cd63e6caa2f7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.756374 Jul 12 11:58:00.184416 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 957/2055] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:57:59 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:00.200788 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-22584cd0-c300-4548-9b84-04f4e0a46e3b req-99a94702-bc8f-4c87-9387-6652bbceed81 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:00.203736 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-22584cd0-c300-4548-9b84-04f4e0a46e3b req-99a94702-bc8f-4c87-9387-6652bbceed81 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:00.239207 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-22584cd0-c300-4548-9b84-04f4e0a46e3b req-99a94702-bc8f-4c87-9387-6652bbceed81 service nova] Creating event network-vif-deleted:ec142fac-be48-431f-8191-564d18afd7ca for instance cd6a507e-64a6-490c-8dbd-bf23feec571c on n-h2-849104-4 Jul 12 11:58:00.247929 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-22584cd0-c300-4548-9b84-04f4e0a46e3b req-99a94702-bc8f-4c87-9387-6652bbceed81 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089107 Jul 12 11:58:00.249433 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1099/2056] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:00.408732 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1813322318", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "bce5ad19-a88b-413b-a502-a31beadbbd19"}, {"port": "62d08446-a99d-4f41-bebb-6117d86305fb", "tag": "port-1"}, {"port": "65251375-ff74-4521-a4d6-cec51c2c3fa2", "tag": "port-2"}, {"uuid": "0f6c38dc-d655-4353-87b9-07a58b3e4116", "tag": "net-1"}, {"uuid": "0f6c38dc-d655-4353-87b9-07a58b3e4116"}, {"uuid": "b381dbbb-e2ad-4d61-b8f7-de549115e25d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b381dbbb-e2ad-4d61-b8f7-de549115e25d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0172a915-d03d-4395-8dfc-6e32b853c9aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c9bcbb0f-1d85-4862-a980-ecc23a5cee28", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "8341cac3-73cf-42a3-89f9-eeb28afeacea", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2048772943"}], "key_name": "tempest-keypair-1195270634", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:00.666569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1457934173", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "c11f1e67-c837-46a3-8b49-fe30b3169d9e"}], "security_groups": [{"name": "tempest-securitygroup--1316270614"}], "key_name": "tempest-keypair-1580805149", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:00.881674 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] validate_networks() for [('bce5ad19-a88b-413b-a502-a31beadbbd19', None, None, None, None, None), (None, None, '62d08446-a99d-4f41-bebb-6117d86305fb', None, None, None), (None, None, '65251375-ff74-4521-a4d6-cec51c2c3fa2', None, None, None), ('0f6c38dc-d655-4353-87b9-07a58b3e4116', None, None, None, None, None), ('0f6c38dc-d655-4353-87b9-07a58b3e4116', None, None, None, None, None), ('b381dbbb-e2ad-4d61-b8f7-de549115e25d', '10.2.2.100', None, None, None, None), ('b381dbbb-e2ad-4d61-b8f7-de549115e25d', '10.2.2.200', None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:58:00.905978 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] validate_networks() for [('c11f1e67-c837-46a3-8b49-fe30b3169d9e', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:58:01.696318 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:58:01.697443 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:58:01.698327 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:58:01.699265 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:58:01.700139 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:58:01.711859 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:01.712926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:01.714000 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:01.714728 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:01.739090 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Getting quotas for project 29fd5f6c853549a794c75ebff736ccf4. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:58:01.750956 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Getting quotas for user ae0b32f84b7146d49338e7a2c06bc579 and project 29fd5f6c853549a794c75ebff736ccf4. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:58:01.769628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:58:01.772909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:58:01.848558 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f88e4853-9313-400a-be7a-867b7b3e219e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.187860 Jul 12 11:58:01.849950 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1100/2057] 10.222.0.50 () {62 vars in 1187 bytes} [Tue Jul 12 11:58:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 11:58:01.855624 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-752e2110-5640-4a53-8fbf-d2903eb10a46 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:01.856612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-752e2110-5640-4a53-8fbf-d2903eb10a46 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:01.866010 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-752e2110-5640-4a53-8fbf-d2903eb10a46 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:01.866561 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-752e2110-5640-4a53-8fbf-d2903eb10a46 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:01.867551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-752e2110-5640-4a53-8fbf-d2903eb10a46 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:01.868344 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-752e2110-5640-4a53-8fbf-d2903eb10a46 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:02.209412 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-752e2110-5640-4a53-8fbf-d2903eb10a46 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:02.220478 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-752e2110-5640-4a53-8fbf-d2903eb10a46 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 200 len: 1322 microversion: 2.1 time: 0.368832 Jul 12 11:58:02.221081 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1101/2058] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:01 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:02.240854 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7291697f-7d92-4a60-a819-80e1e04a8fe3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:02.246815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7291697f-7d92-4a60-a819-80e1e04a8fe3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1a2fb044-0422-4634-bd32-08f216c8f6ab] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:02.273053 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7291697f-7d92-4a60-a819-80e1e04a8fe3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:02.273417 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7291697f-7d92-4a60-a819-80e1e04a8fe3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:02.274848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7291697f-7d92-4a60-a819-80e1e04a8fe3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:02.276471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7291697f-7d92-4a60-a819-80e1e04a8fe3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:02.316052 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-7291697f-7d92-4a60-a819-80e1e04a8fe3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] HTTP exception thrown: Instance 1a2fb044-0422-4634-bd32-08f216c8f6ab could not be found. Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7291697f-7d92-4a60-a819-80e1e04a8fe3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Request method failure captured: Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab HTTP/1.1 Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_1bPlh-9DbWfpuroaFagX-wUcm8BudybeeTaxylo95Vpv4uRnVzuIBWiy9AhpsqpseLtQNBgg5QS2z6p3HoOMV5a2APzoe8yC62Oqbcf-9Tzb5r459iZaKhG_BShz49WIUXxSAcCd8UnJ3khLhulQJ5txh4YDtU2CzhtrvX3Aiij8 Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d9393a32f934440e975f62b7d59eed32 Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-LiveMigrationTest-16318272 Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d9393a32f934440e975f62b7d59eed32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d9393a32f934440e975f62b7d59eed32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d9393a32f934440e975f62b7d59eed32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d9393a32f934440e975f62b7d59eed32", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-LiveMigrationTest-16318272 Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d9393a32f934440e975f62b7d59eed32 Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-LiveMigrationTest-16318272 Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-LiveMigrationTest-16318272-project Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 86ca9c0d2f474f1f9c35aaf5fb9c6064 Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-LiveMigrationTest-16318272-project Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 1a2fb044-0422-4634-bd32-08f216c8f6ab could not be found. Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '1a2fb044-0422-4634-bd32-08f216c8f6ab'} Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a2fb044-0422-4634-bd32-08f216c8f6ab could not be found. Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a2fb044-0422-4634-bd32-08f216c8f6ab could not be found. Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:02.320984 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:02.327404 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:02.327404 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:02.327404 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:02.327404 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:02.327404 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a2fb044-0422-4634-bd32-08f216c8f6ab could not be found. Jul 12 11:58:02.327404 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:02.330474 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7291697f-7d92-4a60-a819-80e1e04a8fe3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Returning 404 to user: Instance 1a2fb044-0422-4634-bd32-08f216c8f6ab could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:02.331805 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7291697f-7d92-4a60-a819-80e1e04a8fe3 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab" status: 404 len: 111 microversion: 2.1 time: 0.103710 Jul 12 11:58:02.336101 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1102/2059] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:02 2022] GET /compute/v2.1/servers/1a2fb044-0422-4634-bd32-08f216c8f6ab => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:02.342715 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0f13d94a-9654-42ce-b4c1-10fe51ee3023 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:02.343716 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0f13d94a-9654-42ce-b4c1-10fe51ee3023 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:02.356513 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f13d94a-9654-42ce-b4c1-10fe51ee3023 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:02.368844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f13d94a-9654-42ce-b4c1-10fe51ee3023 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:02.370200 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f13d94a-9654-42ce-b4c1-10fe51ee3023 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:02.372354 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f13d94a-9654-42ce-b4c1-10fe51ee3023 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:02.399177 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-0f13d94a-9654-42ce-b4c1-10fe51ee3023 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0f13d94a-9654-42ce-b4c1-10fe51ee3023 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c HTTP/1.1 Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'cd6a507e-64a6-490c-8dbd-bf23feec571c'} Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:02.406060 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:02.411806 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:02.411806 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:02.411806 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:02.411806 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:02.411806 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:02.411806 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:02.411806 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:02.413423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0f13d94a-9654-42ce-b4c1-10fe51ee3023 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:02.417377 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0f13d94a-9654-42ce-b4c1-10fe51ee3023 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 404 len: 111 microversion: 2.1 time: 0.079673 Jul 12 11:58:02.421235 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1103/2060] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:02 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:02.433224 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-268e92cc-0404-40d4-8d2c-a82e4f6cb1a9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:02.434142 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-268e92cc-0404-40d4-8d2c-a82e4f6cb1a9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:02.453962 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-268e92cc-0404-40d4-8d2c-a82e4f6cb1a9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:02.454876 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-268e92cc-0404-40d4-8d2c-a82e4f6cb1a9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:02.458871 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-268e92cc-0404-40d4-8d2c-a82e4f6cb1a9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:02.459796 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-268e92cc-0404-40d4-8d2c-a82e4f6cb1a9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:03.205133 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-268e92cc-0404-40d4-8d2c-a82e4f6cb1a9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:03.228613 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-268e92cc-0404-40d4-8d2c-a82e4f6cb1a9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:03.236941 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-268e92cc-0404-40d4-8d2c-a82e4f6cb1a9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:03.239392 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-268e92cc-0404-40d4-8d2c-a82e4f6cb1a9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.815304 Jul 12 11:58:03.243540 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1104/2061] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:02 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:03.252564 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2191d957-db80-410b-a5f6-1f1f1e2d8e71 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:03.268789 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2191d957-db80-410b-a5f6-1f1f1e2d8e71 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:03.279849 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2191d957-db80-410b-a5f6-1f1f1e2d8e71 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:03.285105 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2191d957-db80-410b-a5f6-1f1f1e2d8e71 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:03.286230 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2191d957-db80-410b-a5f6-1f1f1e2d8e71 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:03.286821 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2191d957-db80-410b-a5f6-1f1f1e2d8e71 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:03.436758 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2191d957-db80-410b-a5f6-1f1f1e2d8e71 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:03.461642 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2191d957-db80-410b-a5f6-1f1f1e2d8e71 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:03.469692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2191d957-db80-410b-a5f6-1f1f1e2d8e71 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:03.475195 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2191d957-db80-410b-a5f6-1f1f1e2d8e71 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1338 microversion: 2.25 time: 0.230067 Jul 12 11:58:03.476099 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1105/2062] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:03 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1338 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:03.494960 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-de3f9463-7e98-45a7-a5ac-352c58ee4841 req-de905514-2a45-4436-a556-4da52467eab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7a3be4-ad42-48af-ad94-1eb23cb5a198", "name": "network-vif-plugged", "status": "completed", "tag": "405808ec-8898-4789-89b7-b93f71cb824d"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:03.529046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-de3f9463-7e98-45a7-a5ac-352c58ee4841 req-de905514-2a45-4436-a556-4da52467eab4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:03.530279 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-de3f9463-7e98-45a7-a5ac-352c58ee4841 req-de905514-2a45-4436-a556-4da52467eab4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:03.565550 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-de3f9463-7e98-45a7-a5ac-352c58ee4841 req-de905514-2a45-4436-a556-4da52467eab4 service nova] Creating event network-vif-plugged:405808ec-8898-4789-89b7-b93f71cb824d for instance 2f7a3be4-ad42-48af-ad94-1eb23cb5a198 on n-h1-849104-4 Jul 12 11:58:03.574003 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-de3f9463-7e98-45a7-a5ac-352c58ee4841 req-de905514-2a45-4436-a556-4da52467eab4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094975 Jul 12 11:58:03.575195 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1106/2063] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:03.587027 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-235233645", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "24a2b846-48a0-496a-b982-522753a2dd1f"}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:03.598341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:03.696342 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] validate_networks() for [('24a2b846-48a0-496a-b982-522753a2dd1f', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:58:04.394943 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:58:04.395782 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:58:04.396379 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:58:04.396803 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:58:04.397230 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:58:04.408382 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:04.408986 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:04.409908 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:04.410520 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:04.433435 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Getting quotas for project 6acea80b1e154ffcb3e657056d6e8dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:58:04.443614 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Getting quotas for user 4c93078ac6044bf6b62ca073b3850016 and project 6acea80b1e154ffcb3e657056d6e8dbc. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:58:04.463148 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:58:04.467807 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:58:04.545413 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-413c2d09-b906-416a-8e9d-0bae5c9bbd09 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.968610 Jul 12 11:58:04.548327 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1107/2064] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:58:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:58:04.554768 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-940f2be5-cee0-426b-af02-2123436015a7 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:04.556242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-940f2be5-cee0-426b-af02-2123436015a7 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:04.567403 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-940f2be5-cee0-426b-af02-2123436015a7 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:04.568199 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-940f2be5-cee0-426b-af02-2123436015a7 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:04.593932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-940f2be5-cee0-426b-af02-2123436015a7 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:04.594679 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-940f2be5-cee0-426b-af02-2123436015a7 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:05.083462 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-940f2be5-cee0-426b-af02-2123436015a7 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:05.145214 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-940f2be5-cee0-426b-af02-2123436015a7 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 200 len: 1322 microversion: 2.1 time: 0.595487 Jul 12 11:58:05.152242 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1108/2065] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:04 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:05.171341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3969b01d-8f8e-42a9-afef-e99522379b50 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:05.176897 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3969b01d-8f8e-42a9-afef-e99522379b50 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:05.201288 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3969b01d-8f8e-42a9-afef-e99522379b50 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:05.205192 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3969b01d-8f8e-42a9-afef-e99522379b50 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:05.210672 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3969b01d-8f8e-42a9-afef-e99522379b50 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:05.211403 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3969b01d-8f8e-42a9-afef-e99522379b50 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:05.836588 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3969b01d-8f8e-42a9-afef-e99522379b50 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:05.854178 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3969b01d-8f8e-42a9-afef-e99522379b50 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:05.856108 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3969b01d-8f8e-42a9-afef-e99522379b50 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:05.857528 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3969b01d-8f8e-42a9-afef-e99522379b50 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.704073 Jul 12 11:58:05.858307 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1109/2066] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:05 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:05.869640 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f45f7138-47dc-4d0c-9df2-79f6c1af3886 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:05.871182 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f45f7138-47dc-4d0c-9df2-79f6c1af3886 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:05.887732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45f7138-47dc-4d0c-9df2-79f6c1af3886 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:05.888396 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45f7138-47dc-4d0c-9df2-79f6c1af3886 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:05.889316 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45f7138-47dc-4d0c-9df2-79f6c1af3886 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:05.889894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45f7138-47dc-4d0c-9df2-79f6c1af3886 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:06.097352 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f45f7138-47dc-4d0c-9df2-79f6c1af3886 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:06.111507 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f45f7138-47dc-4d0c-9df2-79f6c1af3886 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:06.115594 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f45f7138-47dc-4d0c-9df2-79f6c1af3886 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:06.119267 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f45f7138-47dc-4d0c-9df2-79f6c1af3886 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1344 microversion: 2.25 time: 0.259793 Jul 12 11:58:06.122677 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1110/2067] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:05 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1344 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:06.134102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-93aa6880-9434-4e98-a5b4-4e9c75bbffa2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:06.136670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-93aa6880-9434-4e98-a5b4-4e9c75bbffa2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:06.164742 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-93aa6880-9434-4e98-a5b4-4e9c75bbffa2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:06.165210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-93aa6880-9434-4e98-a5b4-4e9c75bbffa2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:06.166002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-93aa6880-9434-4e98-a5b4-4e9c75bbffa2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:06.167604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-93aa6880-9434-4e98-a5b4-4e9c75bbffa2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:06.387650 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-93aa6880-9434-4e98-a5b4-4e9c75bbffa2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:06.402427 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-93aa6880-9434-4e98-a5b4-4e9c75bbffa2 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 200 len: 1266 microversion: 2.1 time: 0.278449 Jul 12 11:58:06.403354 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1111/2068] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:06 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:06.417289 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0a1ea5d6-6fe2-465f-9ead-4fc2c4a58512 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:06.418812 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0a1ea5d6-6fe2-465f-9ead-4fc2c4a58512 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:06.434681 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a1ea5d6-6fe2-465f-9ead-4fc2c4a58512 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:06.435138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a1ea5d6-6fe2-465f-9ead-4fc2c4a58512 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:06.439191 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a1ea5d6-6fe2-465f-9ead-4fc2c4a58512 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:06.439623 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a1ea5d6-6fe2-465f-9ead-4fc2c4a58512 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:06.754205 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0a1ea5d6-6fe2-465f-9ead-4fc2c4a58512 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:06.768786 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0a1ea5d6-6fe2-465f-9ead-4fc2c4a58512 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 200 len: 1472 microversion: 2.1 time: 0.363887 Jul 12 11:58:06.773338 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1112/2069] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:06 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 1472 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:07.268585 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a2c2ae2b-5004-40b5-ac6d-25b0fdc0c9c9 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:07.269306 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a2c2ae2b-5004-40b5-ac6d-25b0fdc0c9c9 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] [instance: 67c4b75f-a1b3-44b4-9c01-132b6dc5ccf0] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:07.284810 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-a2c2ae2b-5004-40b5-ac6d-25b0fdc0c9c9 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] HTTP exception thrown: Instance 67c4b75f-a1b3-44b4-9c01-132b6dc5ccf0 could not be found. Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a2c2ae2b-5004-40b5-ac6d-25b0fdc0c9c9 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Request method failure captured: Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/servers/67c4b75f-a1b3-44b4-9c01-132b6dc5ccf0/action HTTP/1.1 Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 15 Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWG5YM8fKXuS8srU_HZEWXknqKn7VwtugR1GVJaI3S3DfzzqtloJALDsOMk26lQMY-lrE_w9Ph_UMVK2lL4nwV6VvrhqLTkC3qUIiizwrL35j4yIz_zH0c8GVbeEyqYkjXZ-pWw8OhHtFbIccSoFARnyZEJH76d7-ZFBeue4PBXOeg4 Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: c60203ad156c4a698f2cbe2898564feb Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c60203ad156c4a698f2cbe2898564feb", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: c60203ad156c4a698f2cbe2898564feb Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersAdminNegativeTestJSON-1964131451-project-admin Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0e9f351c3767449eafed6bc16fd7cc00 Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1964131451-project-admin Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: {"migrate": {}} Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 67c4b75f-a1b3-44b4-9c01-132b6dc5ccf0 could not be found. Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '67c4b75f-a1b3-44b4-9c01-132b6dc5ccf0', 'body': {'migrate': {}}} Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67c4b75f-a1b3-44b4-9c01-132b6dc5ccf0 could not be found. Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67c4b75f-a1b3-44b4-9c01-132b6dc5ccf0 could not be found. Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:07.292435 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:07.296228 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:07.296228 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:07.296228 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:07.296228 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:07.296228 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67c4b75f-a1b3-44b4-9c01-132b6dc5ccf0 could not be found. Jul 12 11:58:07.296228 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:07.300769 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a2c2ae2b-5004-40b5-ac6d-25b0fdc0c9c9 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Returning 404 to user: Instance 67c4b75f-a1b3-44b4-9c01-132b6dc5ccf0 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:07.303796 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a2c2ae2b-5004-40b5-ac6d-25b0fdc0c9c9 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/67c4b75f-a1b3-44b4-9c01-132b6dc5ccf0/action" status: 404 len: 111 microversion: 2.1 time: 0.512543 Jul 12 11:58:07.305326 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1113/2070] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:58:06 2022] POST /compute/v2.1/servers/67c4b75f-a1b3-44b4-9c01-132b6dc5ccf0/action => generated 111 bytes in 515 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:07.319358 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bf701e1b-93d1-4f66-b332-99661b03bc20 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:07.321614 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bf701e1b-93d1-4f66-b332-99661b03bc20 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:07.368472 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf701e1b-93d1-4f66-b332-99661b03bc20 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:07.369116 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf701e1b-93d1-4f66-b332-99661b03bc20 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:07.373352 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf701e1b-93d1-4f66-b332-99661b03bc20 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:07.373993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bf701e1b-93d1-4f66-b332-99661b03bc20 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:09.025497 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bf701e1b-93d1-4f66-b332-99661b03bc20 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:09.038232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bf701e1b-93d1-4f66-b332-99661b03bc20 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:09.039773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bf701e1b-93d1-4f66-b332-99661b03bc20 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:09.053697 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bf701e1b-93d1-4f66-b332-99661b03bc20 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 1.745780 Jul 12 11:58:09.054288 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1114/2071] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:07 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:09.064773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-628f23c3-6324-4a15-9936-90954717d1ab tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:09.070546 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-628f23c3-6324-4a15-9936-90954717d1ab tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:09.084737 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-628f23c3-6324-4a15-9936-90954717d1ab tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:09.085207 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-628f23c3-6324-4a15-9936-90954717d1ab tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:09.088219 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-628f23c3-6324-4a15-9936-90954717d1ab tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:09.088918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-628f23c3-6324-4a15-9936-90954717d1ab tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:09.500304 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-628f23c3-6324-4a15-9936-90954717d1ab tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:09.519847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-628f23c3-6324-4a15-9936-90954717d1ab tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:09.525969 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-628f23c3-6324-4a15-9936-90954717d1ab tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:09.529732 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-628f23c3-6324-4a15-9936-90954717d1ab tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1412 microversion: 2.25 time: 0.470052 Jul 12 11:58:09.543828 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1115/2072] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:09 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1412 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:09.557538 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b46882bb-10b9-46a0-854a-3bcabca2f729 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:09.558212 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b46882bb-10b9-46a0-854a-3bcabca2f729 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:09.575443 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b46882bb-10b9-46a0-854a-3bcabca2f729 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:09.575950 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b46882bb-10b9-46a0-854a-3bcabca2f729 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:09.578838 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b46882bb-10b9-46a0-854a-3bcabca2f729 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:09.581654 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b46882bb-10b9-46a0-854a-3bcabca2f729 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:09.947519 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b46882bb-10b9-46a0-854a-3bcabca2f729 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:09.973408 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b46882bb-10b9-46a0-854a-3bcabca2f729 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 200 len: 1314 microversion: 2.1 time: 0.427172 Jul 12 11:58:09.987421 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1116/2073] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:09 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:10.020881 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-991587501", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:10.142104 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=4 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:10.162552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] validate_networks() for None {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:58:10.817973 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:58:10.818589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:58:10.819081 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:58:10.819498 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:58:10.819919 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:58:10.833734 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:10.834195 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:10.834999 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:10.835467 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:10.895504 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Getting quotas for project 9846c91b05b54476a049745bed4d5528. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:58:10.902180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Getting quotas for user bfe83c08467e4c5a9809b6f92e159761 and project 9846c91b05b54476a049745bed4d5528. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:58:10.927929 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:58:10.932239 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:58:11.043063 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-59e79962-bb01-4084-84f9-e07690afe6b3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.054143 Jul 12 11:58:11.043727 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1117/2074] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:58:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:58:11.056329 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-39e640fa-162f-45a9-b854-69bd78883385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:11.056414 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-39e640fa-162f-45a9-b854-69bd78883385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:11.067460 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39e640fa-162f-45a9-b854-69bd78883385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:11.068153 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39e640fa-162f-45a9-b854-69bd78883385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:11.069741 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39e640fa-162f-45a9-b854-69bd78883385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:11.070791 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39e640fa-162f-45a9-b854-69bd78883385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:11.143476 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-39e640fa-162f-45a9-b854-69bd78883385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:58:11.148954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:11.331885 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-39e640fa-162f-45a9-b854-69bd78883385 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 204 len: 0 microversion: 2.1 time: 0.285779 Jul 12 11:58:11.336440 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1118/2075] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:58:11 2022] DELETE /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:58:11.350781 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2e9a6a2a-da8c-4c0e-8fac-085d1ac2aeb2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:11.351501 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2e9a6a2a-da8c-4c0e-8fac-085d1ac2aeb2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:11.371119 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e9a6a2a-da8c-4c0e-8fac-085d1ac2aeb2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:11.371585 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e9a6a2a-da8c-4c0e-8fac-085d1ac2aeb2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:11.374632 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e9a6a2a-da8c-4c0e-8fac-085d1ac2aeb2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:11.375139 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e9a6a2a-da8c-4c0e-8fac-085d1ac2aeb2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:11.496601 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:58:11.497104 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:58:11.497576 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:58:11.498002 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:58:11.498425 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:58:11.518946 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:11.520779 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:11.525176 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:11.525641 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:11.591174 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Getting quotas for project 55402baffcd84d95ab9c09fc11b55fa5. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:58:11.598935 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Getting quotas for user 173724289979423aaa08135e91b7f3dc and project 55402baffcd84d95ab9c09fc11b55fa5. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:58:11.899979 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:58:11.904069 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0172a915-d03d-4395-8dfc-6e32b853c9aa',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c9bcbb0f-1d85-4862-a980-ecc23a5cee28',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8341cac3-73cf-42a3-89f9-eeb28afeacea',volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:58:12.137134 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2e9a6a2a-da8c-4c0e-8fac-085d1ac2aeb2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:12.152154 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2e9a6a2a-da8c-4c0e-8fac-085d1ac2aeb2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:12.160358 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2e9a6a2a-da8c-4c0e-8fac-085d1ac2aeb2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:12.169787 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2e9a6a2a-da8c-4c0e-8fac-085d1ac2aeb2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.831670 Jul 12 11:58:12.170768 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1119/2076] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:11 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:12.203305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ffd2a173-f267-4fdd-bed9-4e2270ea12bd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:12.205387 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ffd2a173-f267-4fdd-bed9-4e2270ea12bd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:12.228709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ffd2a173-f267-4fdd-bed9-4e2270ea12bd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:12.231622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ffd2a173-f267-4fdd-bed9-4e2270ea12bd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:12.235688 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ffd2a173-f267-4fdd-bed9-4e2270ea12bd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:12.240116 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ffd2a173-f267-4fdd-bed9-4e2270ea12bd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:12.740510 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:12.867704 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-52006413-f992-4526-983f-038fe781a617 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 12.468429 Jul 12 11:58:12.869298 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 958/2077] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Jul 12 11:58:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 12471 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 11:58:12.874736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c79fc4aa-10cf-49c5-b020-aa366205ece9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:12.875741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c79fc4aa-10cf-49c5-b020-aa366205ece9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:12.888335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c79fc4aa-10cf-49c5-b020-aa366205ece9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:12.889074 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c79fc4aa-10cf-49c5-b020-aa366205ece9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:12.890088 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c79fc4aa-10cf-49c5-b020-aa366205ece9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:12.892140 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c79fc4aa-10cf-49c5-b020-aa366205ece9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:13.118349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ffd2a173-f267-4fdd-bed9-4e2270ea12bd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:13.141052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ffd2a173-f267-4fdd-bed9-4e2270ea12bd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:13.143217 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ffd2a173-f267-4fdd-bed9-4e2270ea12bd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:13.146924 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ffd2a173-f267-4fdd-bed9-4e2270ea12bd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1412 microversion: 2.25 time: 0.968691 Jul 12 11:58:13.162121 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1120/2078] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:12 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1412 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:13.176604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-217882d7-76b1-468d-a770-0a3905c08862 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:13.188224 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-217882d7-76b1-468d-a770-0a3905c08862 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:13.198115 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-217882d7-76b1-468d-a770-0a3905c08862 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:13.198115 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-217882d7-76b1-468d-a770-0a3905c08862 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:13.198115 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-217882d7-76b1-468d-a770-0a3905c08862 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:13.198655 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-217882d7-76b1-468d-a770-0a3905c08862 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:13.537434 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-217882d7-76b1-468d-a770-0a3905c08862 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:13.545708 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-217882d7-76b1-468d-a770-0a3905c08862 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1281 microversion: 2.1 time: 0.381663 Jul 12 11:58:13.546279 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1121/2079] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:13 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1281 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:13.569722 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cbb4a8c5-425d-4d76-864e-947b31e6d420 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:13.572415 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cbb4a8c5-425d-4d76-864e-947b31e6d420 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:13.586456 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cbb4a8c5-425d-4d76-864e-947b31e6d420 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:13.588165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cbb4a8c5-425d-4d76-864e-947b31e6d420 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:13.589133 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cbb4a8c5-425d-4d76-864e-947b31e6d420 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:13.591500 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cbb4a8c5-425d-4d76-864e-947b31e6d420 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:14.314717 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c79fc4aa-10cf-49c5-b020-aa366205ece9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:14.326563 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c79fc4aa-10cf-49c5-b020-aa366205ece9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 200 len: 1314 microversion: 2.1 time: 1.454248 Jul 12 11:58:14.341756 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 959/2080] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:12 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 1314 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:14.350102 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-1b5ed34e-ba8d-40aa-91b1-4a823d435aab req-d84e7241-838a-4b52-85fa-09676495f5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fcb0bf4-be39-45d1-ab06-c887502b711e", "tag": "9e38df3e-7c88-4f8c-abec-a27230d337ba"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:14.365918 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-1b5ed34e-ba8d-40aa-91b1-4a823d435aab req-d84e7241-838a-4b52-85fa-09676495f5a3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:14.366603 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-1b5ed34e-ba8d-40aa-91b1-4a823d435aab req-d84e7241-838a-4b52-85fa-09676495f5a3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:14.388582 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-1b5ed34e-ba8d-40aa-91b1-4a823d435aab req-d84e7241-838a-4b52-85fa-09676495f5a3 service nova] Creating event network-changed:9e38df3e-7c88-4f8c-abec-a27230d337ba for instance 9fcb0bf4-be39-45d1-ab06-c887502b711e on n-h1-849104-4 Jul 12 11:58:14.397184 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-1b5ed34e-ba8d-40aa-91b1-4a823d435aab req-d84e7241-838a-4b52-85fa-09676495f5a3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052944 Jul 12 11:58:14.398052 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 960/2081] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:14.404744 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-da0cc65a-1ca6-428e-8ff3-ae42d8a9ce9f tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:14.407318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-da0cc65a-1ca6-428e-8ff3-ae42d8a9ce9f tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:14.418326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-da0cc65a-1ca6-428e-8ff3-ae42d8a9ce9f tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:14.419168 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-da0cc65a-1ca6-428e-8ff3-ae42d8a9ce9f tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:14.420939 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-da0cc65a-1ca6-428e-8ff3-ae42d8a9ce9f tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:14.422476 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-da0cc65a-1ca6-428e-8ff3-ae42d8a9ce9f tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:14.538550 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-da0cc65a-1ca6-428e-8ff3-ae42d8a9ce9f tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:14.551008 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-da0cc65a-1ca6-428e-8ff3-ae42d8a9ce9f tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:14.553676 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-da0cc65a-1ca6-428e-8ff3-ae42d8a9ce9f tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:14.555421 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-da0cc65a-1ca6-428e-8ff3-ae42d8a9ce9f tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1520 microversion: 2.32 time: 0.156105 Jul 12 11:58:14.568203 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 961/2082] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:14 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:14.573468 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9f38d7cf-c9af-46ce-a425-0c707f849e36 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:14.574464 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9f38d7cf-c9af-46ce-a425-0c707f849e36 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:14.583283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9f38d7cf-c9af-46ce-a425-0c707f849e36 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:14.584176 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9f38d7cf-c9af-46ce-a425-0c707f849e36 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:14.585241 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9f38d7cf-c9af-46ce-a425-0c707f849e36 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:14.585909 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9f38d7cf-c9af-46ce-a425-0c707f849e36 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:14.826253 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cbb4a8c5-425d-4d76-864e-947b31e6d420 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:14.835572 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cbb4a8c5-425d-4d76-864e-947b31e6d420 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1668 microversion: 2.1 time: 1.274221 Jul 12 11:58:14.836365 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1122/2083] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:13 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1668 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:14.852359 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-678beb92-6405-4c0e-a46b-945b37540fac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:14.853394 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-678beb92-6405-4c0e-a46b-945b37540fac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:14.865105 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-678beb92-6405-4c0e-a46b-945b37540fac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:14.865644 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-678beb92-6405-4c0e-a46b-945b37540fac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:14.866525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-678beb92-6405-4c0e-a46b-945b37540fac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:14.867048 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-678beb92-6405-4c0e-a46b-945b37540fac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:14.931457 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9f38d7cf-c9af-46ce-a425-0c707f849e36 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:14.942062 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9f38d7cf-c9af-46ce-a425-0c707f849e36 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:14.943518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9f38d7cf-c9af-46ce-a425-0c707f849e36 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:14.944706 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9f38d7cf-c9af-46ce-a425-0c707f849e36 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.375271 Jul 12 11:58:14.945562 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 962/2084] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:14 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:14.950036 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e4fd446f-eaaa-4b8c-9c4f-d0bab4c71227 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:14.950635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e4fd446f-eaaa-4b8c-9c4f-d0bab4c71227 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:14.958126 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4fd446f-eaaa-4b8c-9c4f-d0bab4c71227 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:14.959721 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4fd446f-eaaa-4b8c-9c4f-d0bab4c71227 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:14.959721 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4fd446f-eaaa-4b8c-9c4f-d0bab4c71227 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:14.959721 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4fd446f-eaaa-4b8c-9c4f-d0bab4c71227 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:15.078940 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e4fd446f-eaaa-4b8c-9c4f-d0bab4c71227 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:15.089216 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e4fd446f-eaaa-4b8c-9c4f-d0bab4c71227 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1279 microversion: 2.1 time: 0.142251 Jul 12 11:58:15.090314 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 963/2085] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:14 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1279 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:15.344933 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2fd0fa18-d259-4f65-951b-461d1bd5c08c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:15.345827 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2fd0fa18-d259-4f65-951b-461d1bd5c08c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:15.353701 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2fd0fa18-d259-4f65-951b-461d1bd5c08c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:15.354406 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2fd0fa18-d259-4f65-951b-461d1bd5c08c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:15.355138 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2fd0fa18-d259-4f65-951b-461d1bd5c08c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:15.356150 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2fd0fa18-d259-4f65-951b-461d1bd5c08c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:15.592852 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-678beb92-6405-4c0e-a46b-945b37540fac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:15.616519 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-678beb92-6405-4c0e-a46b-945b37540fac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:15.620870 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-678beb92-6405-4c0e-a46b-945b37540fac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:15.626057 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-678beb92-6405-4c0e-a46b-945b37540fac tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1412 microversion: 2.25 time: 0.787179 Jul 12 11:58:15.627142 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1123/2086] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:14 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1412 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:15.637425 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9cb80351-08e4-4af6-81ea-1f95939fb645 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:15.638292 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9cb80351-08e4-4af6-81ea-1f95939fb645 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:15.651956 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9cb80351-08e4-4af6-81ea-1f95939fb645 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:15.652721 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9cb80351-08e4-4af6-81ea-1f95939fb645 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:15.653725 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9cb80351-08e4-4af6-81ea-1f95939fb645 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:15.654439 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9cb80351-08e4-4af6-81ea-1f95939fb645 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:15.720725 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2fd0fa18-d259-4f65-951b-461d1bd5c08c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:15.729806 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2fd0fa18-d259-4f65-951b-461d1bd5c08c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 200 len: 1314 microversion: 2.1 time: 0.388659 Jul 12 11:58:15.730571 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 964/2087] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:15 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:58:15.841282 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9cb80351-08e4-4af6-81ea-1f95939fb645 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:15.856142 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c522451f-808e-4d5f-b526-49fc5c84c6d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:15.857086 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c522451f-808e-4d5f-b526-49fc5c84c6d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:15.863853 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9cb80351-08e4-4af6-81ea-1f95939fb645 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:15.866622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9cb80351-08e4-4af6-81ea-1f95939fb645 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:15.868657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c522451f-808e-4d5f-b526-49fc5c84c6d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:15.869559 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c522451f-808e-4d5f-b526-49fc5c84c6d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:15.869687 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9cb80351-08e4-4af6-81ea-1f95939fb645 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1576 microversion: 2.32 time: 0.239469 Jul 12 11:58:15.871035 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c522451f-808e-4d5f-b526-49fc5c84c6d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:15.871149 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1124/2088] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:15 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:15.873586 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c522451f-808e-4d5f-b526-49fc5c84c6d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:15.971985 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4e612bf7-b4cb-4d1d-95c1-79ed9da54d34 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:15.973293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4e612bf7-b4cb-4d1d-95c1-79ed9da54d34 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:15.996365 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4e612bf7-b4cb-4d1d-95c1-79ed9da54d34 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:16.004783 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4e612bf7-b4cb-4d1d-95c1-79ed9da54d34 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:16.006296 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4e612bf7-b4cb-4d1d-95c1-79ed9da54d34 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:16.010351 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4e612bf7-b4cb-4d1d-95c1-79ed9da54d34 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:16.193796 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c522451f-808e-4d5f-b526-49fc5c84c6d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:16.204583 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c522451f-808e-4d5f-b526-49fc5c84c6d1 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1600 microversion: 2.1 time: 0.353185 Jul 12 11:58:16.214734 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 965/2089] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:15 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1600 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:16.214734 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8ab2e769-eb6c-45b3-904e-af6e3f66372f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:16.214734 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8ab2e769-eb6c-45b3-904e-af6e3f66372f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:16.232882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ab2e769-eb6c-45b3-904e-af6e3f66372f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:16.233703 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ab2e769-eb6c-45b3-904e-af6e3f66372f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:16.235374 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ab2e769-eb6c-45b3-904e-af6e3f66372f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:16.236069 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ab2e769-eb6c-45b3-904e-af6e3f66372f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:16.319388 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8ab2e769-eb6c-45b3-904e-af6e3f66372f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:16.330368 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8ab2e769-eb6c-45b3-904e-af6e3f66372f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1279 microversion: 2.1 time: 0.121177 Jul 12 11:58:16.331189 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 966/2090] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:16 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1279 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:16.532487 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-0be46604-bddb-49cc-9510-3281f2fa2a06 req-d6e9bbef-ad33-40d6-ae05-c7623f443b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26b640d-3b19-492b-99f2-4c0cb3c10c25", "tag": "fefc048a-c90e-4ca6-908e-d9728a5304fa"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:16.556403 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-0be46604-bddb-49cc-9510-3281f2fa2a06 req-d6e9bbef-ad33-40d6-ae05-c7623f443b84 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:16.564012 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-0be46604-bddb-49cc-9510-3281f2fa2a06 req-d6e9bbef-ad33-40d6-ae05-c7623f443b84 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:16.597967 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-0be46604-bddb-49cc-9510-3281f2fa2a06 req-d6e9bbef-ad33-40d6-ae05-c7623f443b84 service nova] Creating event network-changed:fefc048a-c90e-4ca6-908e-d9728a5304fa for instance b26b640d-3b19-492b-99f2-4c0cb3c10c25 on n-h2-849104-4 Jul 12 11:58:16.625223 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-0be46604-bddb-49cc-9510-3281f2fa2a06 req-d6e9bbef-ad33-40d6-ae05-c7623f443b84 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098670 Jul 12 11:58:16.633179 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 967/2091] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:16.661537 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2d3f1f45-0f36-4859-bf88-925ed53578d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:16.665232 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2d3f1f45-0f36-4859-bf88-925ed53578d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:16.692229 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d3f1f45-0f36-4859-bf88-925ed53578d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:16.696146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d3f1f45-0f36-4859-bf88-925ed53578d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:16.700414 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d3f1f45-0f36-4859-bf88-925ed53578d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:16.703655 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d3f1f45-0f36-4859-bf88-925ed53578d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:16.801211 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4e612bf7-b4cb-4d1d-95c1-79ed9da54d34 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:16.830527 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4e612bf7-b4cb-4d1d-95c1-79ed9da54d34 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:16.836378 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4e612bf7-b4cb-4d1d-95c1-79ed9da54d34 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:16.848946 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4e612bf7-b4cb-4d1d-95c1-79ed9da54d34 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.877110 Jul 12 11:58:16.855771 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1125/2092] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:15 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:58:16.877587 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7481b86b-3988-440d-b957-5fd6225a2b8c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:16.878433 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7481b86b-3988-440d-b957-5fd6225a2b8c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:16.912441 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7481b86b-3988-440d-b957-5fd6225a2b8c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:16.915593 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7481b86b-3988-440d-b957-5fd6225a2b8c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:16.920585 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7481b86b-3988-440d-b957-5fd6225a2b8c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:16.925198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7481b86b-3988-440d-b957-5fd6225a2b8c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:17.535069 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2d3f1f45-0f36-4859-bf88-925ed53578d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:17.552393 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2d3f1f45-0f36-4859-bf88-925ed53578d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:17.572709 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2d3f1f45-0f36-4859-bf88-925ed53578d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:17.574762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7481b86b-3988-440d-b957-5fd6225a2b8c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:17.576187 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2d3f1f45-0f36-4859-bf88-925ed53578d2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1412 microversion: 2.25 time: 0.920787 Jul 12 11:58:17.583362 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 968/2093] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:16 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1412 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:17.590041 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7481b86b-3988-440d-b957-5fd6225a2b8c tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 200 len: 1314 microversion: 2.1 time: 0.732665 Jul 12 11:58:17.593270 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1126/2094] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:16 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:17.603700 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-edf23c58-373f-405e-9fe4-77946c8799e9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:17.607302 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-edf23c58-373f-405e-9fe4-77946c8799e9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:17.610519 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-99b2416e-ba92-4e36-aecc-d73fe41888d4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:17.613058 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-99b2416e-ba92-4e36-aecc-d73fe41888d4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:17.628700 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-edf23c58-373f-405e-9fe4-77946c8799e9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:17.633257 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-edf23c58-373f-405e-9fe4-77946c8799e9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:17.633442 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99b2416e-ba92-4e36-aecc-d73fe41888d4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:17.634471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-edf23c58-373f-405e-9fe4-77946c8799e9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:17.635219 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-edf23c58-373f-405e-9fe4-77946c8799e9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:17.640849 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99b2416e-ba92-4e36-aecc-d73fe41888d4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:17.641883 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99b2416e-ba92-4e36-aecc-d73fe41888d4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:17.643739 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99b2416e-ba92-4e36-aecc-d73fe41888d4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:17.804260 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-edf23c58-373f-405e-9fe4-77946c8799e9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:17.818166 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-edf23c58-373f-405e-9fe4-77946c8799e9 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 200 len: 1600 microversion: 2.1 time: 0.223364 Jul 12 11:58:17.821504 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1127/2095] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:17 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 1600 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:17.842827 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e34b9c39-4d83-4494-a4f2-112b837da123 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:17.844880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e34b9c39-4d83-4494-a4f2-112b837da123 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:17.862283 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e34b9c39-4d83-4494-a4f2-112b837da123 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:17.863580 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e34b9c39-4d83-4494-a4f2-112b837da123 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:17.867667 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e34b9c39-4d83-4494-a4f2-112b837da123 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:17.871248 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e34b9c39-4d83-4494-a4f2-112b837da123 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:18.218403 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-99b2416e-ba92-4e36-aecc-d73fe41888d4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:18.263634 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-99b2416e-ba92-4e36-aecc-d73fe41888d4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:18.273431 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-99b2416e-ba92-4e36-aecc-d73fe41888d4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:18.279228 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-99b2416e-ba92-4e36-aecc-d73fe41888d4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1594 microversion: 2.32 time: 0.690599 Jul 12 11:58:18.285582 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 969/2096] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:17 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1594 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:18.307826 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-6518baed-2267-440a-94fe-d6eb4d7a0f04 req-09961f1c-d86e-4486-9461-b2ccac2e5690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec6989c-9a01-4cd9-a91b-421af9130b46", "name": "network-vif-deleted", "tag": "694302fc-4796-4f12-bc02-b17c9376ebbb"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:18.321093 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-6518baed-2267-440a-94fe-d6eb4d7a0f04 req-09961f1c-d86e-4486-9461-b2ccac2e5690 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:18.322157 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-6518baed-2267-440a-94fe-d6eb4d7a0f04 req-09961f1c-d86e-4486-9461-b2ccac2e5690 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:18.355927 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-6518baed-2267-440a-94fe-d6eb4d7a0f04 req-09961f1c-d86e-4486-9461-b2ccac2e5690 service nova] Creating event network-vif-deleted:694302fc-4796-4f12-bc02-b17c9376ebbb for instance dec6989c-9a01-4cd9-a91b-421af9130b46 on n-h1-849104-4 Jul 12 11:58:18.397530 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-6518baed-2267-440a-94fe-d6eb4d7a0f04 req-09961f1c-d86e-4486-9461-b2ccac2e5690 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088925 Jul 12 11:58:18.400450 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 970/2097] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:18.417516 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-23869f11-544b-4353-bca6-937f2ee98416 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:18.418482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-23869f11-544b-4353-bca6-937f2ee98416 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:18.443490 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-23869f11-544b-4353-bca6-937f2ee98416 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:18.444364 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-23869f11-544b-4353-bca6-937f2ee98416 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:18.445837 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-23869f11-544b-4353-bca6-937f2ee98416 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:18.447148 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-23869f11-544b-4353-bca6-937f2ee98416 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:18.472811 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e34b9c39-4d83-4494-a4f2-112b837da123 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:18.484678 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e34b9c39-4d83-4494-a4f2-112b837da123 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1321 microversion: 2.1 time: 0.659556 Jul 12 11:58:18.487745 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1128/2098] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:17 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1321 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:18.600288 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6a7e7a89-0af2-4be4-b797-7ba6701fc948 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:18.601079 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6a7e7a89-0af2-4be4-b797-7ba6701fc948 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:18.614246 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a7e7a89-0af2-4be4-b797-7ba6701fc948 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:18.614960 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a7e7a89-0af2-4be4-b797-7ba6701fc948 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:18.615955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a7e7a89-0af2-4be4-b797-7ba6701fc948 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:18.616574 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a7e7a89-0af2-4be4-b797-7ba6701fc948 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:18.960048 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-23869f11-544b-4353-bca6-937f2ee98416 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:19.010381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-23869f11-544b-4353-bca6-937f2ee98416 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:19.014364 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-23869f11-544b-4353-bca6-937f2ee98416 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:19.020657 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-23869f11-544b-4353-bca6-937f2ee98416 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.615380 Jul 12 11:58:19.040560 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 971/2099] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:18 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:19.045883 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d832b7fc-6b9b-44ac-a8c5-dcb6d494bb6a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:19.047757 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d832b7fc-6b9b-44ac-a8c5-dcb6d494bb6a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:19.055499 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d832b7fc-6b9b-44ac-a8c5-dcb6d494bb6a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:19.056559 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d832b7fc-6b9b-44ac-a8c5-dcb6d494bb6a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:19.058692 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d832b7fc-6b9b-44ac-a8c5-dcb6d494bb6a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:19.059486 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d832b7fc-6b9b-44ac-a8c5-dcb6d494bb6a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:19.365428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d832b7fc-6b9b-44ac-a8c5-dcb6d494bb6a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:19.379518 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d832b7fc-6b9b-44ac-a8c5-dcb6d494bb6a tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 200 len: 1314 microversion: 2.1 time: 0.337154 Jul 12 11:58:19.381446 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 972/2100] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:19 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:19.401237 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-544bbbec-dd0d-4fd8-b691-8ca720b5374f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:19.402888 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-544bbbec-dd0d-4fd8-b691-8ca720b5374f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: dec6989c-9a01-4cd9-a91b-421af9130b46] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:19.418954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-544bbbec-dd0d-4fd8-b691-8ca720b5374f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:19.419449 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-544bbbec-dd0d-4fd8-b691-8ca720b5374f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:19.420298 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-544bbbec-dd0d-4fd8-b691-8ca720b5374f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:19.420746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-544bbbec-dd0d-4fd8-b691-8ca720b5374f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:19.470138 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-544bbbec-dd0d-4fd8-b691-8ca720b5374f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] HTTP exception thrown: Instance dec6989c-9a01-4cd9-a91b-421af9130b46 could not be found. Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-544bbbec-dd0d-4fd8-b691-8ca720b5374f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Request method failure captured: Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 HTTP/1.1 Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizV_1bPlh-9DbWfpuroaFagX-wUcm8BudybeeTaxylo95Vpv4uRnVzuIBWiy9AhpsqpseLtQNBgg5QS2z6p3HoOMV5a2APzoe8yC62Oqbcf-9Tzb5r459iZaKhG_BShz49WIUXxSAcCd8UnJ3khLhulQJ5txh4YDtU2CzhtrvX3Aiij8 Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: d9393a32f934440e975f62b7d59eed32 Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-LiveMigrationTest-16318272 Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d9393a32f934440e975f62b7d59eed32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d9393a32f934440e975f62b7d59eed32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d9393a32f934440e975f62b7d59eed32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d9393a32f934440e975f62b7d59eed32", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-LiveMigrationTest-16318272 Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: d9393a32f934440e975f62b7d59eed32 Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-LiveMigrationTest-16318272 Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-LiveMigrationTest-16318272-project Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 86ca9c0d2f474f1f9c35aaf5fb9c6064 Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-LiveMigrationTest-16318272-project Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance dec6989c-9a01-4cd9-a91b-421af9130b46 could not be found. Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'dec6989c-9a01-4cd9-a91b-421af9130b46'} Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec6989c-9a01-4cd9-a91b-421af9130b46 could not be found. Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec6989c-9a01-4cd9-a91b-421af9130b46 could not be found. Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:19.473196 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:19.476845 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:19.476845 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:19.476845 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:19.476845 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:19.476845 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec6989c-9a01-4cd9-a91b-421af9130b46 could not be found. Jul 12 11:58:19.476845 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:19.477809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-544bbbec-dd0d-4fd8-b691-8ca720b5374f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Returning 404 to user: Instance dec6989c-9a01-4cd9-a91b-421af9130b46 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:19.478989 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-544bbbec-dd0d-4fd8-b691-8ca720b5374f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46" status: 404 len: 111 microversion: 2.1 time: 0.094833 Jul 12 11:58:19.479805 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 973/2101] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:19 2022] GET /compute/v2.1/servers/dec6989c-9a01-4cd9-a91b-421af9130b46 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:19.487992 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5563cf02-b71f-4342-9343-5dcb4e02ef92 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:19.489263 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5563cf02-b71f-4342-9343-5dcb4e02ef92 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:19.497778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5563cf02-b71f-4342-9343-5dcb4e02ef92 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:19.498839 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5563cf02-b71f-4342-9343-5dcb4e02ef92 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:19.500214 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5563cf02-b71f-4342-9343-5dcb4e02ef92 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:19.500919 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5563cf02-b71f-4342-9343-5dcb4e02ef92 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:19.530332 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6a7e7a89-0af2-4be4-b797-7ba6701fc948 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:19.544188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6a7e7a89-0af2-4be4-b797-7ba6701fc948 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:19.548210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6a7e7a89-0af2-4be4-b797-7ba6701fc948 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:19.550891 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6a7e7a89-0af2-4be4-b797-7ba6701fc948 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1412 microversion: 2.25 time: 0.959859 Jul 12 11:58:19.553460 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1129/2102] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:18 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1412 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:58:19.566154 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a1c95d94-778b-4eb0-9ef9-09295191e553 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '.version_select at 0x7f5e09fe4ee0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:19.629218 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a1c95d94-778b-4eb0-9ef9-09295191e553 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-332021802" status: 202 len: 0 microversion: 2.1 time: 0.074166 Jul 12 11:58:19.630126 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1130/2103] 10.222.0.50 () {58 vars in 1217 bytes} [Tue Jul 12 11:58:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-332021802 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:58:19.635744 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ad0d3c25-f84f-4bd9-ae1b-a681521f356d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:19.636420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ad0d3c25-f84f-4bd9-ae1b-a681521f356d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:19.644882 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ad0d3c25-f84f-4bd9-ae1b-a681521f356d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:19.645598 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ad0d3c25-f84f-4bd9-ae1b-a681521f356d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:19.646812 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ad0d3c25-f84f-4bd9-ae1b-a681521f356d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:19.647428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ad0d3c25-f84f-4bd9-ae1b-a681521f356d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:20.011854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5563cf02-b71f-4342-9343-5dcb4e02ef92 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:20.030748 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5563cf02-b71f-4342-9343-5dcb4e02ef92 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:20.032556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5563cf02-b71f-4342-9343-5dcb4e02ef92 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:20.035086 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5563cf02-b71f-4342-9343-5dcb4e02ef92 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1662 microversion: 2.32 time: 0.552786 Jul 12 11:58:20.038488 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 974/2104] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:19 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1662 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:20.256106 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-120255827", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "99c69b60-49d4-4fda-8c3e-6da408f5f43e"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:20.350578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] validate_networks() for [('99c69b60-49d4-4fda-8c3e-6da408f5f43e', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:58:20.434859 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ad0d3c25-f84f-4bd9-ae1b-a681521f356d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:20.448133 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ad0d3c25-f84f-4bd9-ae1b-a681521f356d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1321 microversion: 2.1 time: 0.816676 Jul 12 11:58:20.449018 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1131/2105] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:19 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1321 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:20.456956 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-1e6179d6-4056-4efd-b89a-85d4c32d01cb req-fdbee3d6-5c62-4f8f-a466-f7c23954d7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-plugged", "status": "completed", "tag": "89649079-3e25-40bb-b461-65345a57ea7f"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:20.468102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-1e6179d6-4056-4efd-b89a-85d4c32d01cb req-fdbee3d6-5c62-4f8f-a466-f7c23954d7ab service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:20.469509 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-1e6179d6-4056-4efd-b89a-85d4c32d01cb req-fdbee3d6-5c62-4f8f-a466-f7c23954d7ab service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:20.490709 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-1e6179d6-4056-4efd-b89a-85d4c32d01cb req-fdbee3d6-5c62-4f8f-a466-f7c23954d7ab service nova] Creating event network-vif-plugged:89649079-3e25-40bb-b461-65345a57ea7f for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:58:20.499439 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-1e6179d6-4056-4efd-b89a-85d4c32d01cb req-fdbee3d6-5c62-4f8f-a466-f7c23954d7ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048203 Jul 12 11:58:20.509197 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1132/2106] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:20.525190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-723ef26f-147a-4bde-90fa-a7141687cf23 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:20.529117 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-723ef26f-147a-4bde-90fa-a7141687cf23 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:20.556682 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-723ef26f-147a-4bde-90fa-a7141687cf23 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:20.564648 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-723ef26f-147a-4bde-90fa-a7141687cf23 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:20.566527 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-723ef26f-147a-4bde-90fa-a7141687cf23 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:20.567363 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-723ef26f-147a-4bde-90fa-a7141687cf23 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:20.863063 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:20.918093 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=26 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:21.211185 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-723ef26f-147a-4bde-90fa-a7141687cf23 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:21.234919 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-723ef26f-147a-4bde-90fa-a7141687cf23 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:21.236990 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-723ef26f-147a-4bde-90fa-a7141687cf23 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:21.239418 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-723ef26f-147a-4bde-90fa-a7141687cf23 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.726302 Jul 12 11:58:21.258212 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1133/2107] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:20 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:21.268964 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9140c566-e417-440d-b3e4-70d403755747 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:21.270292 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9140c566-e417-440d-b3e4-70d403755747 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:21.277702 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9140c566-e417-440d-b3e4-70d403755747 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:21.278563 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9140c566-e417-440d-b3e4-70d403755747 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:21.280890 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9140c566-e417-440d-b3e4-70d403755747 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:21.289723 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9140c566-e417-440d-b3e4-70d403755747 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:21.396856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:58:21.397917 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:58:21.398536 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:58:21.399139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:58:21.399721 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:58:21.416527 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:21.417214 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:21.418309 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:21.418888 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:21.482906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Getting quotas for project 42da3a89c71a427a86958fc632236509. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:58:21.490531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Getting quotas for user db128472531d406a9a5feb0078abc074 and project 42da3a89c71a427a86958fc632236509. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:58:21.539588 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:58:21.541970 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:58:21.649409 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.609470 Jul 12 11:58:21.662363 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 975/2108] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:58:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:58:21.698977 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-76d342fa-5190-467a-888a-2c30c13a6a2e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:21.700524 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-76d342fa-5190-467a-888a-2c30c13a6a2e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:21.710737 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76d342fa-5190-467a-888a-2c30c13a6a2e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:21.712014 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76d342fa-5190-467a-888a-2c30c13a6a2e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:21.713773 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76d342fa-5190-467a-888a-2c30c13a6a2e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:21.714455 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76d342fa-5190-467a-888a-2c30c13a6a2e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:22.000588 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-76d342fa-5190-467a-888a-2c30c13a6a2e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:22.025121 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-76d342fa-5190-467a-888a-2c30c13a6a2e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:22.031359 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-76d342fa-5190-467a-888a-2c30c13a6a2e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:22.032698 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-76d342fa-5190-467a-888a-2c30c13a6a2e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1412 microversion: 2.25 time: 0.365736 Jul 12 11:58:22.034556 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 976/2109] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:21 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1412 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:22.044694 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-43756702-a0d3-409f-ba2a-339d21b6a95c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:22.048418 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-43756702-a0d3-409f-ba2a-339d21b6a95c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:22.069670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-43756702-a0d3-409f-ba2a-339d21b6a95c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:22.073087 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-43756702-a0d3-409f-ba2a-339d21b6a95c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:22.074086 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-43756702-a0d3-409f-ba2a-339d21b6a95c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:22.078422 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-43756702-a0d3-409f-ba2a-339d21b6a95c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:22.252656 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9140c566-e417-440d-b3e4-70d403755747 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:22.284554 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9140c566-e417-440d-b3e4-70d403755747 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 200 len: 1314 microversion: 2.1 time: 1.024474 Jul 12 11:58:22.300085 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1134/2110] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:21 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 1314 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:22.338282 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0c3a18b9-c0ed-4eb0-8723-96659996b67b tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:22.342491 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0c3a18b9-c0ed-4eb0-8723-96659996b67b tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:22.382587 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0c3a18b9-c0ed-4eb0-8723-96659996b67b tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:22.384676 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0c3a18b9-c0ed-4eb0-8723-96659996b67b tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:22.389671 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0c3a18b9-c0ed-4eb0-8723-96659996b67b tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:22.392235 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0c3a18b9-c0ed-4eb0-8723-96659996b67b tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:22.476936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:22.563702 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-43756702-a0d3-409f-ba2a-339d21b6a95c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:22.588634 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-43756702-a0d3-409f-ba2a-339d21b6a95c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:22.591973 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-43756702-a0d3-409f-ba2a-339d21b6a95c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:22.594794 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-43756702-a0d3-409f-ba2a-339d21b6a95c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1709 microversion: 2.32 time: 0.558673 Jul 12 11:58:22.616711 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 977/2111] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:22 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1709 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:22.635874 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3aa67d47-5872-4555-bd70-1ec6f0689ab5 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:22.637771 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3aa67d47-5872-4555-bd70-1ec6f0689ab5 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:22.649447 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3aa67d47-5872-4555-bd70-1ec6f0689ab5 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:22.652804 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3aa67d47-5872-4555-bd70-1ec6f0689ab5 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:22.654563 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3aa67d47-5872-4555-bd70-1ec6f0689ab5 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:22.655629 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3aa67d47-5872-4555-bd70-1ec6f0689ab5 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:22.699086 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:22.861556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3aa67d47-5872-4555-bd70-1ec6f0689ab5 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:22.912778 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3aa67d47-5872-4555-bd70-1ec6f0689ab5 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1220 microversion: 2.1 time: 0.291656 Jul 12 11:58:22.932141 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 978/2112] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:22 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1220 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:22.944387 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ab4c85e8-408c-4fbe-9113-d95b55bd86c0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:22.946344 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ab4c85e8-408c-4fbe-9113-d95b55bd86c0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:22.966473 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ab4c85e8-408c-4fbe-9113-d95b55bd86c0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:22.967310 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ab4c85e8-408c-4fbe-9113-d95b55bd86c0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:22.970887 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ab4c85e8-408c-4fbe-9113-d95b55bd86c0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:22.971790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ab4c85e8-408c-4fbe-9113-d95b55bd86c0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:23.445249 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0c3a18b9-c0ed-4eb0-8723-96659996b67b tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:23.467526 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0c3a18b9-c0ed-4eb0-8723-96659996b67b tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1321 microversion: 2.1 time: 1.172939 Jul 12 11:58:23.478813 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1135/2113] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:22 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1321 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:23.486479 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-0783aa56-2c13-4116-81a3-7aa326b972db req-c026d837-41dd-47ee-ae86-3ee2b56db69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-plugged", "status": "completed", "tag": "05e9b75d-65e4-454a-9576-1b50e1900608"}, {"server_uuid": "9fcb0bf4-be39-45d1-ab06-c887502b711e", "name": "network-vif-plugged", "status": "completed", "tag": "9e38df3e-7c88-4f8c-abec-a27230d337ba"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:23.499101 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ab4c85e8-408c-4fbe-9113-d95b55bd86c0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:23.522799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ab4c85e8-408c-4fbe-9113-d95b55bd86c0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:23.527826 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-0783aa56-2c13-4116-81a3-7aa326b972db req-c026d837-41dd-47ee-ae86-3ee2b56db69b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:23.527826 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-0783aa56-2c13-4116-81a3-7aa326b972db req-c026d837-41dd-47ee-ae86-3ee2b56db69b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:23.528279 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ab4c85e8-408c-4fbe-9113-d95b55bd86c0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:23.540514 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ab4c85e8-408c-4fbe-9113-d95b55bd86c0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.601632 Jul 12 11:58:23.541226 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 979/2114] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:22 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:23.557344 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-0783aa56-2c13-4116-81a3-7aa326b972db req-c026d837-41dd-47ee-ae86-3ee2b56db69b service nova] Creating event network-vif-plugged:05e9b75d-65e4-454a-9576-1b50e1900608 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:58:23.561216 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-0783aa56-2c13-4116-81a3-7aa326b972db req-c026d837-41dd-47ee-ae86-3ee2b56db69b service nova] Creating event network-vif-plugged:9e38df3e-7c88-4f8c-abec-a27230d337ba for instance 9fcb0bf4-be39-45d1-ab06-c887502b711e on n-h1-849104-4 Jul 12 11:58:23.570852 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-66f4e4f9-3614-4dac-afe5-72c11d9c2f01 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:23.574541 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-66f4e4f9-3614-4dac-afe5-72c11d9c2f01 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:23.579049 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-0783aa56-2c13-4116-81a3-7aa326b972db req-c026d837-41dd-47ee-ae86-3ee2b56db69b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089808 Jul 12 11:58:23.580132 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1136/2115] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:23.596094 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5709f8c7-19d3-48d1-a11e-18b0054498e4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:23.606446 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5709f8c7-19d3-48d1-a11e-18b0054498e4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:23.609933 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66f4e4f9-3614-4dac-afe5-72c11d9c2f01 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:23.618640 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66f4e4f9-3614-4dac-afe5-72c11d9c2f01 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:23.619619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66f4e4f9-3614-4dac-afe5-72c11d9c2f01 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:23.620110 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-66f4e4f9-3614-4dac-afe5-72c11d9c2f01 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:23.626223 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5709f8c7-19d3-48d1-a11e-18b0054498e4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:23.627341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5709f8c7-19d3-48d1-a11e-18b0054498e4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:23.628144 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5709f8c7-19d3-48d1-a11e-18b0054498e4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:23.628782 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5709f8c7-19d3-48d1-a11e-18b0054498e4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:23.807345 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5709f8c7-19d3-48d1-a11e-18b0054498e4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:58:24.072920 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:24.083489 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5709f8c7-19d3-48d1-a11e-18b0054498e4 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 204 len: 0 microversion: 2.1 time: 0.498796 Jul 12 11:58:24.093552 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1137/2116] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:58:23 2022] DELETE /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:58:24.117439 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-de3dc8fd-0039-48db-89ac-ea3c70d2b4ea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:24.122327 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-de3dc8fd-0039-48db-89ac-ea3c70d2b4ea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:24.145322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de3dc8fd-0039-48db-89ac-ea3c70d2b4ea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:24.149545 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de3dc8fd-0039-48db-89ac-ea3c70d2b4ea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:24.150701 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de3dc8fd-0039-48db-89ac-ea3c70d2b4ea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:24.151356 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de3dc8fd-0039-48db-89ac-ea3c70d2b4ea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:24.574484 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-66f4e4f9-3614-4dac-afe5-72c11d9c2f01 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:24.589492 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-66f4e4f9-3614-4dac-afe5-72c11d9c2f01 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:24.591035 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-66f4e4f9-3614-4dac-afe5-72c11d9c2f01 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:24.598656 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-66f4e4f9-3614-4dac-afe5-72c11d9c2f01 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1412 microversion: 2.25 time: 1.046753 Jul 12 11:58:24.611112 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 980/2117] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:23 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1412 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:24.627754 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e0b9fec3-7cfc-4820-a9c3-367ab91b91a7 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:24.628711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e0b9fec3-7cfc-4820-a9c3-367ab91b91a7 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:24.647252 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0b9fec3-7cfc-4820-a9c3-367ab91b91a7 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:24.647774 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0b9fec3-7cfc-4820-a9c3-367ab91b91a7 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:24.651011 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0b9fec3-7cfc-4820-a9c3-367ab91b91a7 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:24.651590 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0b9fec3-7cfc-4820-a9c3-367ab91b91a7 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:24.968136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-de3dc8fd-0039-48db-89ac-ea3c70d2b4ea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:24.991400 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-de3dc8fd-0039-48db-89ac-ea3c70d2b4ea tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 200 len: 1314 microversion: 2.1 time: 0.895516 Jul 12 11:58:25.002083 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1138/2118] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:24 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 1314 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:25.013025 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8eb9c61e-3217-43fb-9968-c9f0c3751bc2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:25.013827 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8eb9c61e-3217-43fb-9968-c9f0c3751bc2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:25.037170 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8eb9c61e-3217-43fb-9968-c9f0c3751bc2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:25.037830 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8eb9c61e-3217-43fb-9968-c9f0c3751bc2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:25.039645 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8eb9c61e-3217-43fb-9968-c9f0c3751bc2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:25.042194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8eb9c61e-3217-43fb-9968-c9f0c3751bc2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:25.799198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8eb9c61e-3217-43fb-9968-c9f0c3751bc2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:25.811844 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8eb9c61e-3217-43fb-9968-c9f0c3751bc2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1274 microversion: 2.1 time: 0.816806 Jul 12 11:58:25.813179 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1139/2119] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:24 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1274 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:25.822454 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-34e1dfdc-8f8e-4c80-bd8c-29458b4b8d8b req-df0e6194-bb87-401f-bac0-a82682422f4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51829843-3012-41d2-a4a3-9683082906c5", "tag": "07f520e5-b458-40e0-8e7d-abfe15229eb1"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:25.846069 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-34e1dfdc-8f8e-4c80-bd8c-29458b4b8d8b req-df0e6194-bb87-401f-bac0-a82682422f4f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:25.846557 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-34e1dfdc-8f8e-4c80-bd8c-29458b4b8d8b req-df0e6194-bb87-401f-bac0-a82682422f4f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:25.871925 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-34e1dfdc-8f8e-4c80-bd8c-29458b4b8d8b req-df0e6194-bb87-401f-bac0-a82682422f4f service nova] Creating event network-changed:07f520e5-b458-40e0-8e7d-abfe15229eb1 for instance 51829843-3012-41d2-a4a3-9683082906c5 on n-h2-849104-4 Jul 12 11:58:25.885830 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-34e1dfdc-8f8e-4c80-bd8c-29458b4b8d8b req-df0e6194-bb87-401f-bac0-a82682422f4f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071247 Jul 12 11:58:25.886481 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1140/2120] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:25.902111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-64afc906-c716-4954-bca7-77c587463eb6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:25.902941 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-64afc906-c716-4954-bca7-77c587463eb6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:25.920883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-64afc906-c716-4954-bca7-77c587463eb6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:25.921499 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-64afc906-c716-4954-bca7-77c587463eb6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:25.922861 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-64afc906-c716-4954-bca7-77c587463eb6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:25.938007 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-64afc906-c716-4954-bca7-77c587463eb6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:26.139554 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e0b9fec3-7cfc-4820-a9c3-367ab91b91a7 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:26.154799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e0b9fec3-7cfc-4820-a9c3-367ab91b91a7 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:26.162024 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e0b9fec3-7cfc-4820-a9c3-367ab91b91a7 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:26.166795 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e0b9fec3-7cfc-4820-a9c3-367ab91b91a7 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1756 microversion: 2.32 time: 1.551876 Jul 12 11:58:26.168232 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 981/2121] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:24 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1756 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:26.183964 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-74288ad6-9901-4e1d-89e0-ac1d099afd74 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:26.184846 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-74288ad6-9901-4e1d-89e0-ac1d099afd74 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:26.201238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-74288ad6-9901-4e1d-89e0-ac1d099afd74 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:26.204020 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-74288ad6-9901-4e1d-89e0-ac1d099afd74 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:26.206251 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-74288ad6-9901-4e1d-89e0-ac1d099afd74 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:26.208894 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-74288ad6-9901-4e1d-89e0-ac1d099afd74 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:26.438487 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-64afc906-c716-4954-bca7-77c587463eb6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:26.450170 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-64afc906-c716-4954-bca7-77c587463eb6 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1484 microversion: 2.1 time: 0.562399 Jul 12 11:58:26.464432 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1141/2122] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:25 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1484 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:26.474815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a6741031-17f3-42d5-8c6d-4b1bc96fa161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:26.475488 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a6741031-17f3-42d5-8c6d-4b1bc96fa161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:26.485136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a6741031-17f3-42d5-8c6d-4b1bc96fa161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:26.485647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a6741031-17f3-42d5-8c6d-4b1bc96fa161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:26.486381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a6741031-17f3-42d5-8c6d-4b1bc96fa161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:26.487217 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a6741031-17f3-42d5-8c6d-4b1bc96fa161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:26.927353 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-74288ad6-9901-4e1d-89e0-ac1d099afd74 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:26.941799 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-74288ad6-9901-4e1d-89e0-ac1d099afd74 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1321 microversion: 2.1 time: 0.768039 Jul 12 11:58:26.943930 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 982/2123] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:26 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1321 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:26.956823 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-417e5129-a1a9-4062-9257-66fd30e20c5a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:26.958382 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-417e5129-a1a9-4062-9257-66fd30e20c5a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:26.973951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-417e5129-a1a9-4062-9257-66fd30e20c5a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:26.977365 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-417e5129-a1a9-4062-9257-66fd30e20c5a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:26.978707 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-417e5129-a1a9-4062-9257-66fd30e20c5a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:26.983087 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-417e5129-a1a9-4062-9257-66fd30e20c5a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:27.184616 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a6741031-17f3-42d5-8c6d-4b1bc96fa161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:27.210750 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a6741031-17f3-42d5-8c6d-4b1bc96fa161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:27.212359 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a6741031-17f3-42d5-8c6d-4b1bc96fa161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:27.217778 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a6741031-17f3-42d5-8c6d-4b1bc96fa161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.746669 Jul 12 11:58:27.221728 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1142/2124] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:26 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:27.231546 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-a6556810-6c7b-4a47-85c4-d3e6af6b6ce1 req-ea08d5b1-0740-4f68-b881-8b1439e89695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-plugged", "status": "completed", "tag": "adac38f7-95b5-450a-bafb-4f4a814fa426"}, {"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-plugged", "status": "completed", "tag": "d2014975-7c3d-4b64-a57a-e0776062c564"}, {"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-plugged", "status": "completed", "tag": "e5630fc7-2a37-4d64-8b42-4467055177db"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:27.248776 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-a6556810-6c7b-4a47-85c4-d3e6af6b6ce1 req-ea08d5b1-0740-4f68-b881-8b1439e89695 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:27.250295 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-a6556810-6c7b-4a47-85c4-d3e6af6b6ce1 req-ea08d5b1-0740-4f68-b881-8b1439e89695 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:27.281465 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-a6556810-6c7b-4a47-85c4-d3e6af6b6ce1 req-ea08d5b1-0740-4f68-b881-8b1439e89695 service nova] Creating event network-vif-plugged:adac38f7-95b5-450a-bafb-4f4a814fa426 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:58:27.282045 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-a6556810-6c7b-4a47-85c4-d3e6af6b6ce1 req-ea08d5b1-0740-4f68-b881-8b1439e89695 service nova] Creating event network-vif-plugged:d2014975-7c3d-4b64-a57a-e0776062c564 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:58:27.283344 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-a6556810-6c7b-4a47-85c4-d3e6af6b6ce1 req-ea08d5b1-0740-4f68-b881-8b1439e89695 service nova] Creating event network-vif-plugged:e5630fc7-2a37-4d64-8b42-4467055177db for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:58:27.303700 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-a6556810-6c7b-4a47-85c4-d3e6af6b6ce1 req-ea08d5b1-0740-4f68-b881-8b1439e89695 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.079026 Jul 12 11:58:27.313451 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1143/2125] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:27.350423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b1ba80b4-779e-40ae-b130-71699df9ceff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:27.351017 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b1ba80b4-779e-40ae-b130-71699df9ceff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:27.365413 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b1ba80b4-779e-40ae-b130-71699df9ceff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:27.365880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b1ba80b4-779e-40ae-b130-71699df9ceff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:27.371890 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b1ba80b4-779e-40ae-b130-71699df9ceff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:27.372396 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b1ba80b4-779e-40ae-b130-71699df9ceff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:27.790986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-417e5129-a1a9-4062-9257-66fd30e20c5a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:27.808457 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-417e5129-a1a9-4062-9257-66fd30e20c5a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:27.819881 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-417e5129-a1a9-4062-9257-66fd30e20c5a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:27.821599 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-417e5129-a1a9-4062-9257-66fd30e20c5a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1412 microversion: 2.25 time: 0.873951 Jul 12 11:58:27.825400 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 983/2126] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:26 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1412 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:27.842339 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e524f31e-a41e-4e04-be3d-fb9de2b27169 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:27.843075 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e524f31e-a41e-4e04-be3d-fb9de2b27169 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:27.861847 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e524f31e-a41e-4e04-be3d-fb9de2b27169 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:27.863357 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e524f31e-a41e-4e04-be3d-fb9de2b27169 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:27.865911 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e524f31e-a41e-4e04-be3d-fb9de2b27169 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:27.866509 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e524f31e-a41e-4e04-be3d-fb9de2b27169 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:28.293508 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b1ba80b4-779e-40ae-b130-71699df9ceff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:28.307580 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b1ba80b4-779e-40ae-b130-71699df9ceff tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 200 len: 1500 microversion: 2.1 time: 0.986757 Jul 12 11:58:28.311325 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1144/2127] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:27 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 1500 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:28.323324 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-412b12a0-3199-4746-b716-3da63d8b1cc1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:28.328758 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-412b12a0-3199-4746-b716-3da63d8b1cc1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:28.338654 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-412b12a0-3199-4746-b716-3da63d8b1cc1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:28.341295 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-412b12a0-3199-4746-b716-3da63d8b1cc1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:28.342299 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-412b12a0-3199-4746-b716-3da63d8b1cc1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:28.346206 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-412b12a0-3199-4746-b716-3da63d8b1cc1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:28.475409 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e524f31e-a41e-4e04-be3d-fb9de2b27169 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:28.503608 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e524f31e-a41e-4e04-be3d-fb9de2b27169 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1316 microversion: 2.1 time: 0.676980 Jul 12 11:58:28.519302 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 984/2128] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:27 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1316 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:28.548365 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-27266de4-7ba3-4275-9247-ff6339d0c37d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:28.549010 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-27266de4-7ba3-4275-9247-ff6339d0c37d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:28.580593 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27266de4-7ba3-4275-9247-ff6339d0c37d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:28.581455 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27266de4-7ba3-4275-9247-ff6339d0c37d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:28.585233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27266de4-7ba3-4275-9247-ff6339d0c37d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:28.585799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-27266de4-7ba3-4275-9247-ff6339d0c37d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:28.838378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-27266de4-7ba3-4275-9247-ff6339d0c37d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:28.849661 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-27266de4-7ba3-4275-9247-ff6339d0c37d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 200 len: 1281 microversion: 2.1 time: 0.329071 Jul 12 11:58:28.850511 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 985/2129] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:28 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 1281 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:28.871577 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a3e960e0-4d0e-42c0-ad37-5828130be0dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:28.872346 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a3e960e0-4d0e-42c0-ad37-5828130be0dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:28.879206 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a3e960e0-4d0e-42c0-ad37-5828130be0dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:28.879673 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a3e960e0-4d0e-42c0-ad37-5828130be0dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:28.880652 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a3e960e0-4d0e-42c0-ad37-5828130be0dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:28.884714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a3e960e0-4d0e-42c0-ad37-5828130be0dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:29.030271 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-412b12a0-3199-4746-b716-3da63d8b1cc1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:29.049657 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-412b12a0-3199-4746-b716-3da63d8b1cc1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:29.052418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-412b12a0-3199-4746-b716-3da63d8b1cc1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:29.054575 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-412b12a0-3199-4746-b716-3da63d8b1cc1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1803 microversion: 2.32 time: 0.738990 Jul 12 11:58:29.056957 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1145/2130] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:28 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1803 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:29.109514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7db7124f-6692-4a6d-87a2-443ade8c62a4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:29.111171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7db7124f-6692-4a6d-87a2-443ade8c62a4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:29.154685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7db7124f-6692-4a6d-87a2-443ade8c62a4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:29.158084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7db7124f-6692-4a6d-87a2-443ade8c62a4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:29.162948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7db7124f-6692-4a6d-87a2-443ade8c62a4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:29.166043 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7db7124f-6692-4a6d-87a2-443ade8c62a4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:29.541980 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a3e960e0-4d0e-42c0-ad37-5828130be0dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:29.551226 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a3e960e0-4d0e-42c0-ad37-5828130be0dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1321 microversion: 2.1 time: 0.699897 Jul 12 11:58:29.556590 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 986/2131] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:28 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1321 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:29.567582 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-78d07b7f-becb-4624-aa58-a5b7eb514347 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:29.568358 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-78d07b7f-becb-4624-aa58-a5b7eb514347 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:29.590731 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-78d07b7f-becb-4624-aa58-a5b7eb514347 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:29.592092 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-78d07b7f-becb-4624-aa58-a5b7eb514347 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:29.593046 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-78d07b7f-becb-4624-aa58-a5b7eb514347 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:29.593684 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-78d07b7f-becb-4624-aa58-a5b7eb514347 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:29.657935 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-78d07b7f-becb-4624-aa58-a5b7eb514347 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lazy-loading 'flavor' on Instance uuid 9fcb0bf4-be39-45d1-ab06-c887502b711e {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:58:29.670067 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7db7124f-6692-4a6d-87a2-443ade8c62a4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:29.683291 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7db7124f-6692-4a6d-87a2-443ade8c62a4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:29.686529 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7db7124f-6692-4a6d-87a2-443ade8c62a4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:29.689648 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7db7124f-6692-4a6d-87a2-443ade8c62a4 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.630873 Jul 12 11:58:29.697099 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1146/2132] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:29 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:29.702174 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-f5552686-7ec9-429d-994b-f8a4ab6c082a req-82513719-fb8c-4b02-9da0-d320094ff93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1556ea71-32c0-43d8-9a28-e364d25cc8e1", "name": "network-vif-deleted", "tag": "42102276-b5d3-4916-a3fb-5ba8439f5c7f"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:29.728490 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-f5552686-7ec9-429d-994b-f8a4ab6c082a req-82513719-fb8c-4b02-9da0-d320094ff93c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:29.732664 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-f5552686-7ec9-429d-994b-f8a4ab6c082a req-82513719-fb8c-4b02-9da0-d320094ff93c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:29.764894 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-f5552686-7ec9-429d-994b-f8a4ab6c082a req-82513719-fb8c-4b02-9da0-d320094ff93c service nova] Creating event network-vif-deleted:42102276-b5d3-4916-a3fb-5ba8439f5c7f for instance 1556ea71-32c0-43d8-9a28-e364d25cc8e1 on n-h1-849104-4 Jul 12 11:58:29.779658 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-f5552686-7ec9-429d-994b-f8a4ab6c082a req-82513719-fb8c-4b02-9da0-d320094ff93c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075170 Jul 12 11:58:29.789225 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1147/2133] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:29.795832 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-da417201-b9a6-4ce2-bc84-5d3d3023a47f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:29.797335 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-da417201-b9a6-4ce2-bc84-5d3d3023a47f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:29.817877 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da417201-b9a6-4ce2-bc84-5d3d3023a47f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:29.818652 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da417201-b9a6-4ce2-bc84-5d3d3023a47f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:29.819706 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da417201-b9a6-4ce2-bc84-5d3d3023a47f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:29.820321 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da417201-b9a6-4ce2-bc84-5d3d3023a47f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:29.870864 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-78d07b7f-becb-4624-aa58-a5b7eb514347 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "POST /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e/action" status: 202 len: 0 microversion: 2.1 time: 0.312728 Jul 12 11:58:29.874664 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 987/2134] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:58:29 2022] POST /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:58:29.889408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-eea2130f-3f0f-4325-93b9-66ecb535ab41 req-045e9680-1e28-4351-9ef1-25ce1a7cd4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-plugged", "status": "completed", "tag": "c0a4bf74-eaa2-46bb-97d3-902c76d0da52"}, {"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-plugged", "status": "completed", "tag": "f4cee665-cebb-4239-899b-d9d2a125a5c3"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:29.916907 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-eea2130f-3f0f-4325-93b9-66ecb535ab41 req-045e9680-1e28-4351-9ef1-25ce1a7cd4b6 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:29.917721 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-eea2130f-3f0f-4325-93b9-66ecb535ab41 req-045e9680-1e28-4351-9ef1-25ce1a7cd4b6 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:29.938749 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-eea2130f-3f0f-4325-93b9-66ecb535ab41 req-045e9680-1e28-4351-9ef1-25ce1a7cd4b6 service nova] Creating event network-vif-plugged:c0a4bf74-eaa2-46bb-97d3-902c76d0da52 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:58:29.939658 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-eea2130f-3f0f-4325-93b9-66ecb535ab41 req-045e9680-1e28-4351-9ef1-25ce1a7cd4b6 service nova] Creating event network-vif-plugged:f4cee665-cebb-4239-899b-d9d2a125a5c3 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:58:29.947556 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-eea2130f-3f0f-4325-93b9-66ecb535ab41 req-045e9680-1e28-4351-9ef1-25ce1a7cd4b6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070342 Jul 12 11:58:29.948856 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 988/2135] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:29.956004 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fa260864-4880-4f12-8866-d9b470a46067 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:29.957565 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fa260864-4880-4f12-8866-d9b470a46067 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:29.971015 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa260864-4880-4f12-8866-d9b470a46067 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:29.971487 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa260864-4880-4f12-8866-d9b470a46067 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:29.972315 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa260864-4880-4f12-8866-d9b470a46067 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:29.972769 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa260864-4880-4f12-8866-d9b470a46067 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:30.121131 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-da417201-b9a6-4ce2-bc84-5d3d3023a47f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:30.140746 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-da417201-b9a6-4ce2-bc84-5d3d3023a47f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:30.146083 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-da417201-b9a6-4ce2-bc84-5d3d3023a47f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:30.147622 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-da417201-b9a6-4ce2-bc84-5d3d3023a47f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1412 microversion: 2.25 time: 0.356971 Jul 12 11:58:30.163643 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1148/2136] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:29 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1412 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:30.174378 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-399a3230-4a82-4f02-a1f4-6070d91c060d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:30.176714 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-399a3230-4a82-4f02-a1f4-6070d91c060d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: 1556ea71-32c0-43d8-9a28-e364d25cc8e1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:30.190624 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-399a3230-4a82-4f02-a1f4-6070d91c060d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:30.191876 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-399a3230-4a82-4f02-a1f4-6070d91c060d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:30.195207 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-399a3230-4a82-4f02-a1f4-6070d91c060d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:30.197188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-399a3230-4a82-4f02-a1f4-6070d91c060d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:30.221057 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-399a3230-4a82-4f02-a1f4-6070d91c060d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] HTTP exception thrown: Instance 1556ea71-32c0-43d8-9a28-e364d25cc8e1 could not be found. Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-399a3230-4a82-4f02-a1f4-6070d91c060d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Request method failure captured: Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 HTTP/1.1 Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_1bPlh-9DbWfpuroaFagX-wUcm8BudybeeTaxylo95Vpv4uRnVzuIBWiy9AhpsqpseLtQNBgg5QS2z6p3HoOMV5a2APzoe8yC62Oqbcf-9Tzb5r459iZaKhG_BShz49WIUXxSAcCd8UnJ3khLhulQJ5txh4YDtU2CzhtrvX3Aiij8 Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d9393a32f934440e975f62b7d59eed32 Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-LiveMigrationTest-16318272 Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d9393a32f934440e975f62b7d59eed32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d9393a32f934440e975f62b7d59eed32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d9393a32f934440e975f62b7d59eed32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d9393a32f934440e975f62b7d59eed32", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-LiveMigrationTest-16318272 Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d9393a32f934440e975f62b7d59eed32 Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-LiveMigrationTest-16318272 Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-LiveMigrationTest-16318272-project Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 86ca9c0d2f474f1f9c35aaf5fb9c6064 Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-LiveMigrationTest-16318272-project Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 1556ea71-32c0-43d8-9a28-e364d25cc8e1 could not be found. Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '1556ea71-32c0-43d8-9a28-e364d25cc8e1'} Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1556ea71-32c0-43d8-9a28-e364d25cc8e1 could not be found. Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1556ea71-32c0-43d8-9a28-e364d25cc8e1 could not be found. Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:30.231911 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:30.236677 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:30.236677 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:30.236677 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:30.236677 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:30.236677 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1556ea71-32c0-43d8-9a28-e364d25cc8e1 could not be found. Jul 12 11:58:30.236677 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:30.236677 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-399a3230-4a82-4f02-a1f4-6070d91c060d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Returning 404 to user: Instance 1556ea71-32c0-43d8-9a28-e364d25cc8e1 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:30.236677 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-399a3230-4a82-4f02-a1f4-6070d91c060d tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1" status: 404 len: 111 microversion: 2.1 time: 0.067960 Jul 12 11:58:30.254456 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1149/2137] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:30 2022] GET /compute/v2.1/servers/1556ea71-32c0-43d8-9a28-e364d25cc8e1 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:30.261018 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0951924d-423f-4fc0-a0c4-0778cfee29ab tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:30.265987 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0951924d-423f-4fc0-a0c4-0778cfee29ab tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:30.278629 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0951924d-423f-4fc0-a0c4-0778cfee29ab tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:30.279295 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0951924d-423f-4fc0-a0c4-0778cfee29ab tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:30.280701 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0951924d-423f-4fc0-a0c4-0778cfee29ab tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:30.282064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0951924d-423f-4fc0-a0c4-0778cfee29ab tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:30.478384 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0951924d-423f-4fc0-a0c4-0778cfee29ab tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:30.487948 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0951924d-423f-4fc0-a0c4-0778cfee29ab tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 200 len: 1508 microversion: 2.1 time: 0.232016 Jul 12 11:58:30.491141 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1150/2138] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:30 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:30.502782 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-edf6a7cc-e742-4c0e-a94f-4a398e199a9c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:30.508490 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-edf6a7cc-e742-4c0e-a94f-4a398e199a9c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:30.517967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-edf6a7cc-e742-4c0e-a94f-4a398e199a9c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:30.520726 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-edf6a7cc-e742-4c0e-a94f-4a398e199a9c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:30.521692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-edf6a7cc-e742-4c0e-a94f-4a398e199a9c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:30.523220 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-edf6a7cc-e742-4c0e-a94f-4a398e199a9c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:30.589468 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fa260864-4880-4f12-8866-d9b470a46067 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:30.606981 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fa260864-4880-4f12-8866-d9b470a46067 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1316 microversion: 2.1 time: 0.656373 Jul 12 11:58:30.616520 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 989/2139] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:29 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1316 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:30.616520 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-856f4f99-cbcd-4cd6-8c09-146f658f832c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:30.616520 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-856f4f99-cbcd-4cd6-8c09-146f658f832c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:30.658172 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-856f4f99-cbcd-4cd6-8c09-146f658f832c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:30.658811 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-856f4f99-cbcd-4cd6-8c09-146f658f832c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:30.659753 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-856f4f99-cbcd-4cd6-8c09-146f658f832c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:30.666443 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-856f4f99-cbcd-4cd6-8c09-146f658f832c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:30.751879 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-856f4f99-cbcd-4cd6-8c09-146f658f832c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:58:30.950280 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-856f4f99-cbcd-4cd6-8c09-146f658f832c tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 204 len: 0 microversion: 2.1 time: 0.338879 Jul 12 11:58:30.959672 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 990/2140] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:58:30 2022] DELETE /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:58:30.965750 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d95ced39-eb54-4ef1-acc8-9c12eb91b0c3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:30.969565 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d95ced39-eb54-4ef1-acc8-9c12eb91b0c3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:30.990289 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d95ced39-eb54-4ef1-acc8-9c12eb91b0c3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:30.991107 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d95ced39-eb54-4ef1-acc8-9c12eb91b0c3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:30.992171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d95ced39-eb54-4ef1-acc8-9c12eb91b0c3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:30.992803 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d95ced39-eb54-4ef1-acc8-9c12eb91b0c3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:31.412887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-edf6a7cc-e742-4c0e-a94f-4a398e199a9c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:31.432664 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-edf6a7cc-e742-4c0e-a94f-4a398e199a9c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:31.437928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=4 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:31.445599 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-edf6a7cc-e742-4c0e-a94f-4a398e199a9c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:31.452805 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-edf6a7cc-e742-4c0e-a94f-4a398e199a9c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1803 microversion: 2.32 time: 0.956653 Jul 12 11:58:31.458696 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1151/2141] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:30 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1803 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:31.472907 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0daa8cc3-8fe7-43e9-a658-e66c901ff676 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:31.485562 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0daa8cc3-8fe7-43e9-a658-e66c901ff676 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:31.501921 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0daa8cc3-8fe7-43e9-a658-e66c901ff676 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:31.502392 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0daa8cc3-8fe7-43e9-a658-e66c901ff676 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:31.503182 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0daa8cc3-8fe7-43e9-a658-e66c901ff676 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:31.503622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0daa8cc3-8fe7-43e9-a658-e66c901ff676 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:31.519347 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=12 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:31.630916 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d95ced39-eb54-4ef1-acc8-9c12eb91b0c3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:31.649168 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d95ced39-eb54-4ef1-acc8-9c12eb91b0c3 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1321 microversion: 2.1 time: 0.687647 Jul 12 11:58:31.663421 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 991/2142] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:30 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1321 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:31.670424 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d3c45921-72a0-49d9-bcaf-cd71abc91797 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:31.672203 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d3c45921-72a0-49d9-bcaf-cd71abc91797 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:31.680583 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d3c45921-72a0-49d9-bcaf-cd71abc91797 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:31.681365 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d3c45921-72a0-49d9-bcaf-cd71abc91797 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:31.682392 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d3c45921-72a0-49d9-bcaf-cd71abc91797 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:31.683072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d3c45921-72a0-49d9-bcaf-cd71abc91797 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:31.740441 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:31.786073 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0daa8cc3-8fe7-43e9-a658-e66c901ff676 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:31.802588 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0daa8cc3-8fe7-43e9-a658-e66c901ff676 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:31.809657 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0daa8cc3-8fe7-43e9-a658-e66c901ff676 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:31.813018 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0daa8cc3-8fe7-43e9-a658-e66c901ff676 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1879 microversion: 2.42 time: 0.349924 Jul 12 11:58:31.814203 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1152/2143] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:31 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1879 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:31.819531 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-06639a2c-2dba-42c2-9fa9-421c7c6404e6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:31.820628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-06639a2c-2dba-42c2-9fa9-421c7c6404e6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:31.830189 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-06639a2c-2dba-42c2-9fa9-421c7c6404e6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:31.831094 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-06639a2c-2dba-42c2-9fa9-421c7c6404e6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:31.832446 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-06639a2c-2dba-42c2-9fa9-421c7c6404e6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:31.833193 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-06639a2c-2dba-42c2-9fa9-421c7c6404e6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:32.246881 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d3c45921-72a0-49d9-bcaf-cd71abc91797 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:32.256708 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d3c45921-72a0-49d9-bcaf-cd71abc91797 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1499 microversion: 2.1 time: 0.590974 Jul 12 11:58:32.270897 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 992/2144] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:31 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1499 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:32.275907 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8924a33e-9154-4d6b-b1b9-3e3cee1de0aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:32.282913 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8924a33e-9154-4d6b-b1b9-3e3cee1de0aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:32.300443 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8924a33e-9154-4d6b-b1b9-3e3cee1de0aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:32.301049 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8924a33e-9154-4d6b-b1b9-3e3cee1de0aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:32.301939 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8924a33e-9154-4d6b-b1b9-3e3cee1de0aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:32.302458 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8924a33e-9154-4d6b-b1b9-3e3cee1de0aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:32.689163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-06639a2c-2dba-42c2-9fa9-421c7c6404e6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:32.691678 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:32.699802 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-06639a2c-2dba-42c2-9fa9-421c7c6404e6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:32.701415 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-06639a2c-2dba-42c2-9fa9-421c7c6404e6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:32.702656 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-06639a2c-2dba-42c2-9fa9-421c7c6404e6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1412 microversion: 2.25 time: 0.887251 Jul 12 11:58:32.706554 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1153/2145] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:31 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1412 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:32.713482 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a950c442-79db-41d9-a6c2-7dbcdd37ad8f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:32.714139 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a950c442-79db-41d9-a6c2-7dbcdd37ad8f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:32.735919 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a950c442-79db-41d9-a6c2-7dbcdd37ad8f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:32.736440 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a950c442-79db-41d9-a6c2-7dbcdd37ad8f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:32.737450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a950c442-79db-41d9-a6c2-7dbcdd37ad8f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:32.737909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a950c442-79db-41d9-a6c2-7dbcdd37ad8f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:32.999404 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a950c442-79db-41d9-a6c2-7dbcdd37ad8f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:33.010888 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a950c442-79db-41d9-a6c2-7dbcdd37ad8f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1316 microversion: 2.1 time: 0.302849 Jul 12 11:58:33.012351 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1154/2146] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:32 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:33.019894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-226770b2-7176-4736-84fe-83c19db39aba req-c1f202be-0548-4bd1-bf38-df274577052d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c8209bb-e907-4347-92b9-16eee803b3f8", "tag": "d357fc65-71f4-4d90-ad38-7a1f4df8686b"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:33.031413 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-226770b2-7176-4736-84fe-83c19db39aba req-c1f202be-0548-4bd1-bf38-df274577052d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:33.032302 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-226770b2-7176-4736-84fe-83c19db39aba req-c1f202be-0548-4bd1-bf38-df274577052d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:33.045085 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-226770b2-7176-4736-84fe-83c19db39aba req-c1f202be-0548-4bd1-bf38-df274577052d service nova] Creating event network-changed:d357fc65-71f4-4d90-ad38-7a1f4df8686b for instance 7c8209bb-e907-4347-92b9-16eee803b3f8 on n-h2-849104-4 Jul 12 11:58:33.054129 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-226770b2-7176-4736-84fe-83c19db39aba req-c1f202be-0548-4bd1-bf38-df274577052d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040243 Jul 12 11:58:33.055374 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1155/2147] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:33.067293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-ee186206-9455-4e1f-b7b1-5887c89b5132 req-0e44a592-f20a-42f3-810c-c79cc0b64c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26b640d-3b19-492b-99f2-4c0cb3c10c25", "name": "network-vif-plugged", "status": "completed", "tag": "fefc048a-c90e-4ca6-908e-d9728a5304fa"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:33.081291 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-ee186206-9455-4e1f-b7b1-5887c89b5132 req-0e44a592-f20a-42f3-810c-c79cc0b64c02 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:33.082027 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-ee186206-9455-4e1f-b7b1-5887c89b5132 req-0e44a592-f20a-42f3-810c-c79cc0b64c02 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:33.115379 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-ee186206-9455-4e1f-b7b1-5887c89b5132 req-0e44a592-f20a-42f3-810c-c79cc0b64c02 service nova] Creating event network-vif-plugged:fefc048a-c90e-4ca6-908e-d9728a5304fa for instance b26b640d-3b19-492b-99f2-4c0cb3c10c25 on n-h2-849104-4 Jul 12 11:58:33.126257 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-ee186206-9455-4e1f-b7b1-5887c89b5132 req-0e44a592-f20a-42f3-810c-c79cc0b64c02 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068636 Jul 12 11:58:33.127352 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1156/2148] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:33.156835 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0a6fdb4b-ea33-49c4-a3ee-94c1f981ecc0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:33.162638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0a6fdb4b-ea33-49c4-a3ee-94c1f981ecc0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:33.199908 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a6fdb4b-ea33-49c4-a3ee-94c1f981ecc0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:33.200714 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a6fdb4b-ea33-49c4-a3ee-94c1f981ecc0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:33.202115 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a6fdb4b-ea33-49c4-a3ee-94c1f981ecc0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:33.203384 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a6fdb4b-ea33-49c4-a3ee-94c1f981ecc0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:33.793428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8924a33e-9154-4d6b-b1b9-3e3cee1de0aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:33.820508 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8924a33e-9154-4d6b-b1b9-3e3cee1de0aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 200 len: 1491 microversion: 2.1 time: 1.547887 Jul 12 11:58:33.821557 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 993/2149] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:32 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 1491 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:33.846648 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c351ab9f-6803-460c-9546-b8eca3987a2f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:33.848359 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c351ab9f-6803-460c-9546-b8eca3987a2f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:33.875908 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c351ab9f-6803-460c-9546-b8eca3987a2f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:33.880883 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c351ab9f-6803-460c-9546-b8eca3987a2f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:33.882661 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c351ab9f-6803-460c-9546-b8eca3987a2f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:33.886985 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c351ab9f-6803-460c-9546-b8eca3987a2f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:33.893095 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0a6fdb4b-ea33-49c4-a3ee-94c1f981ecc0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:33.905673 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0a6fdb4b-ea33-49c4-a3ee-94c1f981ecc0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:33.907444 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0a6fdb4b-ea33-49c4-a3ee-94c1f981ecc0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:33.908877 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0a6fdb4b-ea33-49c4-a3ee-94c1f981ecc0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1850 microversion: 2.32 time: 0.779857 Jul 12 11:58:33.910404 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1157/2150] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:33 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1850 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:33.916844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-36fe51d5-fc50-4079-a47c-01902e1f62f0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:33.917566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-36fe51d5-fc50-4079-a47c-01902e1f62f0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:33.927280 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-36fe51d5-fc50-4079-a47c-01902e1f62f0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:33.927892 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-36fe51d5-fc50-4079-a47c-01902e1f62f0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:33.928789 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-36fe51d5-fc50-4079-a47c-01902e1f62f0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:33.929300 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-36fe51d5-fc50-4079-a47c-01902e1f62f0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:34.339052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-36fe51d5-fc50-4079-a47c-01902e1f62f0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:34.350249 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-36fe51d5-fc50-4079-a47c-01902e1f62f0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:34.352759 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-36fe51d5-fc50-4079-a47c-01902e1f62f0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:34.354259 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-36fe51d5-fc50-4079-a47c-01902e1f62f0 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 2837 microversion: 2.42 time: 0.442740 Jul 12 11:58:34.356318 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1158/2151] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:33 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 2837 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:34.362335 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-033cb5f7-c81d-4ab5-b8fa-085a4fa4a902 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:34.363279 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-033cb5f7-c81d-4ab5-b8fa-085a4fa4a902 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:34.403084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-033cb5f7-c81d-4ab5-b8fa-085a4fa4a902 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:34.409829 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-033cb5f7-c81d-4ab5-b8fa-085a4fa4a902 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:34.411120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-033cb5f7-c81d-4ab5-b8fa-085a4fa4a902 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:34.412003 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-033cb5f7-c81d-4ab5-b8fa-085a4fa4a902 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:34.625047 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-033cb5f7-c81d-4ab5-b8fa-085a4fa4a902 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:34.661109 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-033cb5f7-c81d-4ab5-b8fa-085a4fa4a902 tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1457 microversion: 2.1 time: 0.302593 Jul 12 11:58:34.662308 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1159/2152] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:34 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1457 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:34.694996 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-15602bfd-07e1-45f0-b27b-79e7142c3776 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:34.696251 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-15602bfd-07e1-45f0-b27b-79e7142c3776 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:34.709016 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-15602bfd-07e1-45f0-b27b-79e7142c3776 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:34.709482 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-15602bfd-07e1-45f0-b27b-79e7142c3776 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:34.711825 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-15602bfd-07e1-45f0-b27b-79e7142c3776 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:34.712399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-15602bfd-07e1-45f0-b27b-79e7142c3776 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:34.753137 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c351ab9f-6803-460c-9546-b8eca3987a2f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:34.775803 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c351ab9f-6803-460c-9546-b8eca3987a2f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1321 microversion: 2.1 time: 0.948114 Jul 12 11:58:34.777500 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 994/2153] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:33 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1321 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:34.802393 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e4c80fde-59b5-490e-82a0-d43d0a03e22e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:34.803125 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e4c80fde-59b5-490e-82a0-d43d0a03e22e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:34.825014 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4c80fde-59b5-490e-82a0-d43d0a03e22e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:34.826353 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4c80fde-59b5-490e-82a0-d43d0a03e22e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:34.828623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4c80fde-59b5-490e-82a0-d43d0a03e22e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:34.829615 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e4c80fde-59b5-490e-82a0-d43d0a03e22e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:34.905815 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e4c80fde-59b5-490e-82a0-d43d0a03e22e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:58:35.115364 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:35.129395 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e4c80fde-59b5-490e-82a0-d43d0a03e22e tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 204 len: 0 microversion: 2.1 time: 0.349107 Jul 12 11:58:35.137391 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 995/2154] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:58:34 2022] DELETE /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:58:35.140720 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-15602bfd-07e1-45f0-b27b-79e7142c3776 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:35.143740 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9ed0ab03-5f61-42ce-b68b-decf4fe0ad06 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:35.144600 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9ed0ab03-5f61-42ce-b68b-decf4fe0ad06 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:35.154031 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ed0ab03-5f61-42ce-b68b-decf4fe0ad06 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:35.154929 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ed0ab03-5f61-42ce-b68b-decf4fe0ad06 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:35.156805 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ed0ab03-5f61-42ce-b68b-decf4fe0ad06 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:35.157348 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ed0ab03-5f61-42ce-b68b-decf4fe0ad06 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:35.165322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-15602bfd-07e1-45f0-b27b-79e7142c3776 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:35.170272 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-15602bfd-07e1-45f0-b27b-79e7142c3776 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:35.185744 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-15602bfd-07e1-45f0-b27b-79e7142c3776 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1412 microversion: 2.25 time: 0.509208 Jul 12 11:58:35.187788 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1160/2155] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:34 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1412 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:35.370014 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2814e014-47aa-4755-960d-a5d1a28cbc69 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Action: 'create', calling method: .version_select at 0x7f5e09d3dca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-135692674", "description": "tempest-description-1545775867"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:35.503109 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9ed0ab03-5f61-42ce-b68b-decf4fe0ad06 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:35.518105 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9ed0ab03-5f61-42ce-b68b-decf4fe0ad06 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1316 microversion: 2.1 time: 0.379156 Jul 12 11:58:35.520161 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 996/2156] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:35 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:35.525482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3152c8f6-ead6-4c5e-adab-14194f3f6d97 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:35.526328 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3152c8f6-ead6-4c5e-adab-14194f3f6d97 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:35.554894 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3152c8f6-ead6-4c5e-adab-14194f3f6d97 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:35.555362 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3152c8f6-ead6-4c5e-adab-14194f3f6d97 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:35.556252 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3152c8f6-ead6-4c5e-adab-14194f3f6d97 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:35.556712 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3152c8f6-ead6-4c5e-adab-14194f3f6d97 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:35.708454 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2814e014-47aa-4755-960d-a5d1a28cbc69 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.517606 Jul 12 11:58:35.709815 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1161/2157] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:58:35 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:35.715886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3acb7396-6191-4830-83d9-cbcb5ee419ba tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:35.716662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3acb7396-6191-4830-83d9-cbcb5ee419ba tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:35.725563 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3acb7396-6191-4830-83d9-cbcb5ee419ba tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:35.726031 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3acb7396-6191-4830-83d9-cbcb5ee419ba tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:35.726842 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3acb7396-6191-4830-83d9-cbcb5ee419ba tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:35.727295 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3acb7396-6191-4830-83d9-cbcb5ee419ba tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:35.746753 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3152c8f6-ead6-4c5e-adab-14194f3f6d97 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.223667 Jul 12 11:58:35.747859 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 997/2158] 10.222.0.50 () {60 vars in 1315 bytes} [Tue Jul 12 11:58:35 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725/os-interface => generated 1831 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:35.769771 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-29898bd6-c61e-4c39-a8ce-ec8b5bd235d8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:35.771111 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-29898bd6-c61e-4c39-a8ce-ec8b5bd235d8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:35.779542 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-29898bd6-c61e-4c39-a8ce-ec8b5bd235d8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:35.780214 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-29898bd6-c61e-4c39-a8ce-ec8b5bd235d8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:35.781343 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-29898bd6-c61e-4c39-a8ce-ec8b5bd235d8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:35.783195 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-29898bd6-c61e-4c39-a8ce-ec8b5bd235d8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:36.049424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3acb7396-6191-4830-83d9-cbcb5ee419ba tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:36.070221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3acb7396-6191-4830-83d9-cbcb5ee419ba tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:36.078323 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3acb7396-6191-4830-83d9-cbcb5ee419ba tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:36.079823 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3acb7396-6191-4830-83d9-cbcb5ee419ba tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1850 microversion: 2.32 time: 0.368913 Jul 12 11:58:36.080920 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1162/2159] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:35 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1850 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:36.086815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-43a0b503-45e1-4c64-ae90-18f090c53a88 req-fe98010a-11bf-43df-84ce-9e80aa1ef43a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51829843-3012-41d2-a4a3-9683082906c5", "name": "network-vif-plugged", "status": "completed", "tag": "07f520e5-b458-40e0-8e7d-abfe15229eb1"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:36.099801 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-43a0b503-45e1-4c64-ae90-18f090c53a88 req-fe98010a-11bf-43df-84ce-9e80aa1ef43a service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:36.100642 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-43a0b503-45e1-4c64-ae90-18f090c53a88 req-fe98010a-11bf-43df-84ce-9e80aa1ef43a service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:36.125768 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-43a0b503-45e1-4c64-ae90-18f090c53a88 req-fe98010a-11bf-43df-84ce-9e80aa1ef43a service nova] Creating event network-vif-plugged:07f520e5-b458-40e0-8e7d-abfe15229eb1 for instance 51829843-3012-41d2-a4a3-9683082906c5 on n-h2-849104-4 Jul 12 11:58:36.135110 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-43a0b503-45e1-4c64-ae90-18f090c53a88 req-fe98010a-11bf-43df-84ce-9e80aa1ef43a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052527 Jul 12 11:58:36.142869 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1163/2160] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:36.151305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-049effb1-1a7c-4593-9c4c-6bd9c602214f req-09ceb781-623c-43f3-b155-14b5b5825f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3975f6-39e7-4b52-abe1-975c4215f167", "name": "network-vif-deleted", "tag": "0722db67-d841-4498-a390-6a19339383b3"}, {"name": "network-changed", "server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "tag": "a0d155ae-ac1b-49ea-b8e9-248ed51e6471"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:36.216856 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-049effb1-1a7c-4593-9c4c-6bd9c602214f req-09ceb781-623c-43f3-b155-14b5b5825f94 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:36.219415 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-049effb1-1a7c-4593-9c4c-6bd9c602214f req-09ceb781-623c-43f3-b155-14b5b5825f94 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:36.260862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-29898bd6-c61e-4c39-a8ce-ec8b5bd235d8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:36.274909 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-29898bd6-c61e-4c39-a8ce-ec8b5bd235d8 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 200 len: 1497 microversion: 2.1 time: 0.510991 Jul 12 11:58:36.275923 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 998/2161] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:35 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 1497 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:36.287811 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-80812e83-2ff7-4171-b031-a21cf3435cdc tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:36.290429 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-80812e83-2ff7-4171-b031-a21cf3435cdc tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:36.309845 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-049effb1-1a7c-4593-9c4c-6bd9c602214f req-09ceb781-623c-43f3-b155-14b5b5825f94 service nova] Creating event network-vif-deleted:0722db67-d841-4498-a390-6a19339383b3 for instance ae3975f6-39e7-4b52-abe1-975c4215f167 on n-h1-849104-4 Jul 12 11:58:36.310811 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-049effb1-1a7c-4593-9c4c-6bd9c602214f req-09ceb781-623c-43f3-b155-14b5b5825f94 service nova] Creating event network-changed:a0d155ae-ac1b-49ea-b8e9-248ed51e6471 for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 11:58:36.311062 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80812e83-2ff7-4171-b031-a21cf3435cdc tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:36.311637 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80812e83-2ff7-4171-b031-a21cf3435cdc tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:36.313644 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80812e83-2ff7-4171-b031-a21cf3435cdc tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:36.323148 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80812e83-2ff7-4171-b031-a21cf3435cdc tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:36.324938 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-049effb1-1a7c-4593-9c4c-6bd9c602214f req-09ceb781-623c-43f3-b155-14b5b5825f94 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.179749 Jul 12 11:58:36.329116 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1164/2162] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:36.337553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fccebfcd-a8ea-4b95-b6a2-4e6a0b546fe4 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Action: 'create', calling method: .version_select at 0x7f5e09d3d040>, body: {"security_group_rule": {"parent_group_id": "452ff220-9866-4513-ad88-6f80cc927be5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:36.492177 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80812e83-2ff7-4171-b031-a21cf3435cdc tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:36.492711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80812e83-2ff7-4171-b031-a21cf3435cdc tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:36.497637 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-80812e83-2ff7-4171-b031-a21cf3435cdc tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lazy-loading 'fault' on Instance uuid ae3975f6-39e7-4b52-abe1-975c4215f167 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:58:36.607402 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-80812e83-2ff7-4171-b031-a21cf3435cdc tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ca9c0d2f474f1f9c35aaf5fb9c6064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9393a32f934440e975f62b7d59eed32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:36.620812 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-80812e83-2ff7-4171-b031-a21cf3435cdc tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 200 len: 1300 microversion: 2.1 time: 0.342911 Jul 12 11:58:36.621677 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 999/2163] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:36 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 1300 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:36.634375 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e1223223-31c6-42ca-a46d-1a444a491c04 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:36.635080 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e1223223-31c6-42ca-a46d-1a444a491c04 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:36.654155 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1223223-31c6-42ca-a46d-1a444a491c04 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:36.655509 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1223223-31c6-42ca-a46d-1a444a491c04 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:36.657381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1223223-31c6-42ca-a46d-1a444a491c04 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:36.657957 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1223223-31c6-42ca-a46d-1a444a491c04 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:37.052000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e1223223-31c6-42ca-a46d-1a444a491c04 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:37.065664 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e1223223-31c6-42ca-a46d-1a444a491c04 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1321 microversion: 2.1 time: 0.434579 Jul 12 11:58:37.080610 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1000/2164] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:36 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:37.089812 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0dcbcde2-7ae8-494d-9d22-6db7f7ba0ecd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:37.090914 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0dcbcde2-7ae8-494d-9d22-6db7f7ba0ecd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:37.100896 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0dcbcde2-7ae8-494d-9d22-6db7f7ba0ecd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:37.101764 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0dcbcde2-7ae8-494d-9d22-6db7f7ba0ecd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:37.102814 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0dcbcde2-7ae8-494d-9d22-6db7f7ba0ecd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:37.104011 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0dcbcde2-7ae8-494d-9d22-6db7f7ba0ecd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:37.165419 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fccebfcd-a8ea-4b95-b6a2-4e6a0b546fe4 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.833923 Jul 12 11:58:37.173628 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1165/2165] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Jul 12 11:58:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:37.179027 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-68e2b108-8958-4338-aabf-eff9af5f2d40 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:37.180011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-68e2b108-8958-4338-aabf-eff9af5f2d40 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:37.202992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-68e2b108-8958-4338-aabf-eff9af5f2d40 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:37.203776 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-68e2b108-8958-4338-aabf-eff9af5f2d40 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:37.204786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-68e2b108-8958-4338-aabf-eff9af5f2d40 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:37.205228 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-68e2b108-8958-4338-aabf-eff9af5f2d40 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:37.570927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-68e2b108-8958-4338-aabf-eff9af5f2d40 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:37.590237 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-68e2b108-8958-4338-aabf-eff9af5f2d40 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1316 microversion: 2.1 time: 0.415053 Jul 12 11:58:37.595316 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1166/2166] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:37 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:37.612796 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b1152c9d-792b-4555-a24d-1c0a08466158 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:37.613760 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b1152c9d-792b-4555-a24d-1c0a08466158 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:37.637792 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b1152c9d-792b-4555-a24d-1c0a08466158 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:37.642522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b1152c9d-792b-4555-a24d-1c0a08466158 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:37.647558 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b1152c9d-792b-4555-a24d-1c0a08466158 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:37.651350 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b1152c9d-792b-4555-a24d-1c0a08466158 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:38.149234 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b1152c9d-792b-4555-a24d-1c0a08466158 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:38.165104 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b1152c9d-792b-4555-a24d-1c0a08466158 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:38.166654 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b1152c9d-792b-4555-a24d-1c0a08466158 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:38.167896 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b1152c9d-792b-4555-a24d-1c0a08466158 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1871 microversion: 2.32 time: 0.571230 Jul 12 11:58:38.168447 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1167/2167] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:37 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1871 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:38.188206 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-32fc0999-bd4a-4022-8aea-a4f1e7983d16 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Action: 'create', calling method: .version_select at 0x7f5e099bb3a0>, body: {"security_group_rule": {"parent_group_id": "452ff220-9866-4513-ad88-6f80cc927be5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:38.293203 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-32fc0999-bd4a-4022-8aea-a4f1e7983d16 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] HTTP exception thrown: This rule already exists in group 452ff220-9866-4513-ad88-6f80cc927be5 Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-32fc0999-bd4a-4022-8aea-a4f1e7983d16 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Request method failure captured: Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 138 Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWHpMMaYKW5V_GfH4nD01V1xFoZBdG_Pbezbp3zrnfhZwyxp5v9R00puEGHLgDf0oREYfl2vJh6HN-mgo9si7h9Q--HF336fE06aaaPEo6pW0ifhphVQwcpHIBUmvKwj7Car0bNNObjNy9Jl6ED_5LjMrHR4Zp_11g3mlGKwZxUfF74 Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3422ba4464014faeba969ec61faa775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3422ba4464014faeba969ec61faa775a", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: cbf4c2fa63904403a6261a9d3cd6def2 Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: {"security_group_rule": {"parent_group_id": "452ff220-9866-4513-ad88-6f80cc927be5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: exception: This rule already exists in group 452ff220-9866-4513-ad88-6f80cc927be5 Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'body': {'security_group_rule': {'parent_group_id': '452ff220-9866-4513-ad88-6f80cc927be5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 452ff220-9866-4513-ad88-6f80cc927be5 Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 452ff220-9866-4513-ad88-6f80cc927be5 Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:38.294924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:38.300782 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:38.300782 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:38.300782 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 452ff220-9866-4513-ad88-6f80cc927be5 Jul 12 11:58:38.300782 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:38.300782 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-32fc0999-bd4a-4022-8aea-a4f1e7983d16 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Returning 400 to user: This rule already exists in group 452ff220-9866-4513-ad88-6f80cc927be5 {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:38.300782 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-32fc0999-bd4a-4022-8aea-a4f1e7983d16 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.121103 Jul 12 11:58:38.300782 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1168/2168] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Jul 12 11:58:38 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:58:38.305529 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-187ff896-345f-42a3-a35d-61d0b3d5c704 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:38.306153 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-187ff896-345f-42a3-a35d-61d0b3d5c704 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:38.320384 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-187ff896-345f-42a3-a35d-61d0b3d5c704 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:38.320850 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-187ff896-345f-42a3-a35d-61d0b3d5c704 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:38.322710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-187ff896-345f-42a3-a35d-61d0b3d5c704 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:38.323163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-187ff896-345f-42a3-a35d-61d0b3d5c704 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:38.400522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-187ff896-345f-42a3-a35d-61d0b3d5c704 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:38.403731 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-187ff896-345f-42a3-a35d-61d0b3d5c704 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:38.404321 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-187ff896-345f-42a3-a35d-61d0b3d5c704 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lazy-loading 'fault' on Instance uuid 9fcb0bf4-be39-45d1-ab06-c887502b711e {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:58:38.486908 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-187ff896-345f-42a3-a35d-61d0b3d5c704 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c93078ac6044bf6b62ca073b3850016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acea80b1e154ffcb3e657056d6e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:38.495053 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-187ff896-345f-42a3-a35d-61d0b3d5c704 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 200 len: 1304 microversion: 2.1 time: 0.193256 Jul 12 11:58:38.500712 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1169/2169] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:38 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 1304 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:38.506245 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ecd80eef-9bfd-4118-8b4b-f0251319f15f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:38.510442 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ecd80eef-9bfd-4118-8b4b-f0251319f15f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] [instance: ae3975f6-39e7-4b52-abe1-975c4215f167] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:38.526270 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ecd80eef-9bfd-4118-8b4b-f0251319f15f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:38.528424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ecd80eef-9bfd-4118-8b4b-f0251319f15f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:38.533833 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ecd80eef-9bfd-4118-8b4b-f0251319f15f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:38.534676 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ecd80eef-9bfd-4118-8b4b-f0251319f15f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:38.543680 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0dcbcde2-7ae8-494d-9d22-6db7f7ba0ecd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:38.557164 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0dcbcde2-7ae8-494d-9d22-6db7f7ba0ecd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:38.568511 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0dcbcde2-7ae8-494d-9d22-6db7f7ba0ecd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:38.570121 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0dcbcde2-7ae8-494d-9d22-6db7f7ba0ecd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1609 microversion: 2.25 time: 1.487683 Jul 12 11:58:38.570878 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1001/2170] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:37 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1609 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:38.575881 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-47fd101e-923d-43ca-9e8a-ac5aacf767c4 req-117e62ba-d9e2-4b1e-8575-96aced125081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fcb0bf4-be39-45d1-ab06-c887502b711e", "name": "network-vif-deleted", "tag": "9e38df3e-7c88-4f8c-abec-a27230d337ba"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:38.577927 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-ecd80eef-9bfd-4118-8b4b-f0251319f15f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] HTTP exception thrown: Instance ae3975f6-39e7-4b52-abe1-975c4215f167 could not be found. Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ecd80eef-9bfd-4118-8b4b-f0251319f15f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Request method failure captured: Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 HTTP/1.1 Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizV_1bPlh-9DbWfpuroaFagX-wUcm8BudybeeTaxylo95Vpv4uRnVzuIBWiy9AhpsqpseLtQNBgg5QS2z6p3HoOMV5a2APzoe8yC62Oqbcf-9Tzb5r459iZaKhG_BShz49WIUXxSAcCd8UnJ3khLhulQJ5txh4YDtU2CzhtrvX3Aiij8 Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: d9393a32f934440e975f62b7d59eed32 Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-LiveMigrationTest-16318272 Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d9393a32f934440e975f62b7d59eed32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d9393a32f934440e975f62b7d59eed32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d9393a32f934440e975f62b7d59eed32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d9393a32f934440e975f62b7d59eed32", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-LiveMigrationTest-16318272 Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: d9393a32f934440e975f62b7d59eed32 Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-LiveMigrationTest-16318272 Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-LiveMigrationTest-16318272-project Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 86ca9c0d2f474f1f9c35aaf5fb9c6064 Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-LiveMigrationTest-16318272-project Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance ae3975f6-39e7-4b52-abe1-975c4215f167 could not be found. Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'ae3975f6-39e7-4b52-abe1-975c4215f167'} Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae3975f6-39e7-4b52-abe1-975c4215f167 could not be found. Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae3975f6-39e7-4b52-abe1-975c4215f167 could not be found. Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:38.579687 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:38.583093 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:38.583093 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:38.583093 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:38.583093 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:38.583093 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae3975f6-39e7-4b52-abe1-975c4215f167 could not be found. Jul 12 11:58:38.583093 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:38.588424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ecd80eef-9bfd-4118-8b4b-f0251319f15f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] Returning 404 to user: Instance ae3975f6-39e7-4b52-abe1-975c4215f167 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:38.589607 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ecd80eef-9bfd-4118-8b4b-f0251319f15f tempest-LiveMigrationTest-16318272 tempest-LiveMigrationTest-16318272-project] 10.222.0.50 "GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167" status: 404 len: 111 microversion: 2.1 time: 0.087791 Jul 12 11:58:38.590373 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1170/2171] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:38 2022] GET /compute/v2.1/servers/ae3975f6-39e7-4b52-abe1-975c4215f167 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:38.610232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a7916ef4-ab19-4ede-b57c-c1f40f8631d8 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:38.614194 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-47fd101e-923d-43ca-9e8a-ac5aacf767c4 req-117e62ba-d9e2-4b1e-8575-96aced125081 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:38.617790 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a7916ef4-ab19-4ede-b57c-c1f40f8631d8 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:38.620623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-47fd101e-923d-43ca-9e8a-ac5aacf767c4 req-117e62ba-d9e2-4b1e-8575-96aced125081 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:38.639304 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7916ef4-ab19-4ede-b57c-c1f40f8631d8 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:38.643656 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7916ef4-ab19-4ede-b57c-c1f40f8631d8 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:38.644855 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7916ef4-ab19-4ede-b57c-c1f40f8631d8 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:38.649870 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7916ef4-ab19-4ede-b57c-c1f40f8631d8 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:38.663710 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-47fd101e-923d-43ca-9e8a-ac5aacf767c4 req-117e62ba-d9e2-4b1e-8575-96aced125081 service nova] Creating event network-vif-deleted:9e38df3e-7c88-4f8c-abec-a27230d337ba for instance 9fcb0bf4-be39-45d1-ab06-c887502b711e on n-h1-849104-4 Jul 12 11:58:38.678683 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-47fd101e-923d-43ca-9e8a-ac5aacf767c4 req-117e62ba-d9e2-4b1e-8575-96aced125081 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106251 Jul 12 11:58:38.692024 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1002/2172] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:38.699374 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4ab2dc0a-69f8-4bca-8a37-cd25b2c1137d tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Calling method '.version_select at 0x7f5e13a0b820>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:39.103962 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a7916ef4-ab19-4ede-b57c-c1f40f8631d8 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:39.120245 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a7916ef4-ab19-4ede-b57c-c1f40f8631d8 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1321 microversion: 2.1 time: 0.523337 Jul 12 11:58:39.122664 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1171/2173] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:38 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1321 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:39.148471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-16291d76-608f-4206-8789-5be23b6cfb82 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:39.153127 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-16291d76-608f-4206-8789-5be23b6cfb82 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:39.168287 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-16291d76-608f-4206-8789-5be23b6cfb82 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:39.170855 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-16291d76-608f-4206-8789-5be23b6cfb82 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:39.171950 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-16291d76-608f-4206-8789-5be23b6cfb82 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:39.175081 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-16291d76-608f-4206-8789-5be23b6cfb82 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:39.369305 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-16291d76-608f-4206-8789-5be23b6cfb82 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.244964 Jul 12 11:58:39.378478 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1172/2174] 10.222.0.50 () {60 vars in 1315 bytes} [Tue Jul 12 11:58:39 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-interface => generated 285 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:58:39.378913 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-248deeb4-e978-4287-b6bf-444ef081c151 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:39.379674 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-248deeb4-e978-4287-b6bf-444ef081c151 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:39.392950 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-248deeb4-e978-4287-b6bf-444ef081c151 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:39.397870 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-248deeb4-e978-4287-b6bf-444ef081c151 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:39.399399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-248deeb4-e978-4287-b6bf-444ef081c151 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:39.400833 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-248deeb4-e978-4287-b6bf-444ef081c151 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:39.831814 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-248deeb4-e978-4287-b6bf-444ef081c151 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:39.863221 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-248deeb4-e978-4287-b6bf-444ef081c151 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1316 microversion: 2.1 time: 0.491429 Jul 12 11:58:39.863830 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1173/2175] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:39 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:39.878507 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0a2ad69d-57e6-471b-936b-6f5aabe0d82b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:39.879131 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0a2ad69d-57e6-471b-936b-6f5aabe0d82b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:39.896005 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a2ad69d-57e6-471b-936b-6f5aabe0d82b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:39.896545 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a2ad69d-57e6-471b-936b-6f5aabe0d82b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:39.897443 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a2ad69d-57e6-471b-936b-6f5aabe0d82b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:39.897979 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a2ad69d-57e6-471b-936b-6f5aabe0d82b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:39.940685 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4ab2dc0a-69f8-4bca-8a37-cd25b2c1137d tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/a8f460ef-bbd4-483c-b195-8b1b588425b7" status: 202 len: 0 microversion: 2.1 time: 1.246660 Jul 12 11:58:39.941096 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1003/2176] 10.222.0.50 () {58 vars in 1286 bytes} [Tue Jul 12 11:58:38 2022] DELETE /compute/v2.1/os-security-group-rules/a8f460ef-bbd4-483c-b195-8b1b588425b7 => generated 0 bytes in 1248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:58:39.950221 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-33b0a702-b3dd-4e01-8cb9-9890ebb4e331 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:39.950984 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-33b0a702-b3dd-4e01-8cb9-9890ebb4e331 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:39.981438 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-33b0a702-b3dd-4e01-8cb9-9890ebb4e331 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:39.981882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-33b0a702-b3dd-4e01-8cb9-9890ebb4e331 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:39.982685 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-33b0a702-b3dd-4e01-8cb9-9890ebb4e331 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:39.983123 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-33b0a702-b3dd-4e01-8cb9-9890ebb4e331 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:40.027203 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-33b0a702-b3dd-4e01-8cb9-9890ebb4e331 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-33b0a702-b3dd-4e01-8cb9-9890ebb4e331 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e HTTP/1.1 Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '9fcb0bf4-be39-45d1-ab06-c887502b711e'} Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:40.029209 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:40.033575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:40.033575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:40.033575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:40.033575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:40.033575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:40.033575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:40.033575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:40.033575 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-33b0a702-b3dd-4e01-8cb9-9890ebb4e331 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:40.033575 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-33b0a702-b3dd-4e01-8cb9-9890ebb4e331 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 404 len: 111 microversion: 2.1 time: 0.084367 Jul 12 11:58:40.033575 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1004/2177] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:39 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:40.041065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-a8fafccd-903f-443d-94bb-6b79a62ada21 req-9788e1ea-d229-47e1-9512-2ed9d8f02a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "tag": "05e9b75d-65e4-454a-9576-1b50e1900608"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:40.062727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-a8fafccd-903f-443d-94bb-6b79a62ada21 req-9788e1ea-d229-47e1-9512-2ed9d8f02a12 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:40.063413 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-a8fafccd-903f-443d-94bb-6b79a62ada21 req-9788e1ea-d229-47e1-9512-2ed9d8f02a12 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:40.089856 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-a8fafccd-903f-443d-94bb-6b79a62ada21 req-9788e1ea-d229-47e1-9512-2ed9d8f02a12 service nova] Creating event network-changed:05e9b75d-65e4-454a-9576-1b50e1900608 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 11:58:40.097693 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-a8fafccd-903f-443d-94bb-6b79a62ada21 req-9788e1ea-d229-47e1-9512-2ed9d8f02a12 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064152 Jul 12 11:58:40.098875 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1005/2178] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:40.113444 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ff1af28f-b53e-4316-826c-1b169157c741 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Action: 'create', calling method: .version_select at 0x7f5e09f4ca60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1574929218", "description": "tempest-description-573567076"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:40.892939 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0a2ad69d-57e6-471b-936b-6f5aabe0d82b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:40.903199 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0a2ad69d-57e6-471b-936b-6f5aabe0d82b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:40.914057 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0a2ad69d-57e6-471b-936b-6f5aabe0d82b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:40.921129 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0a2ad69d-57e6-471b-936b-6f5aabe0d82b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1871 microversion: 2.32 time: 1.055858 Jul 12 11:58:40.930260 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1174/2179] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:39 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1871 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:40.939560 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-56f0f25b-29ad-462e-9054-e25c02e2a8e0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:40.944410 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-56f0f25b-29ad-462e-9054-e25c02e2a8e0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:40.955178 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-56f0f25b-29ad-462e-9054-e25c02e2a8e0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:40.957811 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-56f0f25b-29ad-462e-9054-e25c02e2a8e0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:40.963615 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-56f0f25b-29ad-462e-9054-e25c02e2a8e0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:40.964708 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-56f0f25b-29ad-462e-9054-e25c02e2a8e0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:40.977235 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ff1af28f-b53e-4316-826c-1b169157c741 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.874567 Jul 12 11:58:40.978813 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1006/2180] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:58:40 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:40.993170 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-56f0f25b-29ad-462e-9054-e25c02e2a8e0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-56f0f25b-29ad-462e-9054-e25c02e2a8e0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e HTTP/1.1 Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '9fcb0bf4-be39-45d1-ab06-c887502b711e'} Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:40.995219 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:40.998357 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:40.998357 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:40.998357 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:40.998357 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:40.998357 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:40.998357 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:40.998357 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:40.998357 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:40.998357 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:40.998357 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:40.998357 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:41.000086 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-56f0f25b-29ad-462e-9054-e25c02e2a8e0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:41.001056 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-56f0f25b-29ad-462e-9054-e25c02e2a8e0 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 404 len: 111 microversion: 2.1 time: 0.069730 Jul 12 11:58:41.002817 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1175/2181] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:58:40 2022] DELETE /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:41.014127 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2301bd35-eb15-429e-878b-ada9e327bc0f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:41.015784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2301bd35-eb15-429e-878b-ada9e327bc0f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:41.018155 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-567283f2-a7d8-4243-9887-3bb1f0239bb0 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:41.020547 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-567283f2-a7d8-4243-9887-3bb1f0239bb0 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:41.025918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2301bd35-eb15-429e-878b-ada9e327bc0f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:41.028576 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2301bd35-eb15-429e-878b-ada9e327bc0f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:41.030729 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2301bd35-eb15-429e-878b-ada9e327bc0f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:41.032968 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-567283f2-a7d8-4243-9887-3bb1f0239bb0 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:41.033610 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2301bd35-eb15-429e-878b-ada9e327bc0f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:41.037248 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-567283f2-a7d8-4243-9887-3bb1f0239bb0 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:41.038308 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-567283f2-a7d8-4243-9887-3bb1f0239bb0 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:41.039445 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-567283f2-a7d8-4243-9887-3bb1f0239bb0 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:41.386637 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-567283f2-a7d8-4243-9887-3bb1f0239bb0 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:41.398399 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-567283f2-a7d8-4243-9887-3bb1f0239bb0 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1471 microversion: 2.1 time: 0.417336 Jul 12 11:58:41.401621 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1007/2182] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:40 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1471 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:41.416616 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-48253f01-d454-4c80-862b-eac09c9a1fa7 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Action: 'create', calling method: .version_select at 0x7f5e09f4ca60>, body: {"security_group_rule": {"parent_group_id": "f4655c4f-0780-47eb-aac5-74e0ba8739b2", "ip_protocol": "tcp", "from_port": 964035331, "to_port": 22}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:41.535362 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-48253f01-d454-4c80-862b-eac09c9a1fa7 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] HTTP exception thrown: Invalid port range 964035331:22. Former value cannot be greater than the later Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-48253f01-d454-4c80-862b-eac09c9a1fa7 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Request method failure captured: Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 145 Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWHpMMaYKW5V_GfH4nD01V1xFoZBdG_Pbezbp3zrnfhZwyxp5v9R00puEGHLgDf0oREYfl2vJh6HN-mgo9si7h9Q--HF336fE06aaaPEo6pW0ifhphVQwcpHIBUmvKwj7Car0bNNObjNy9Jl6ED_5LjMrHR4Zp_11g3mlGKwZxUfF74 Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3422ba4464014faeba969ec61faa775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3422ba4464014faeba969ec61faa775a", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: cbf4c2fa63904403a6261a9d3cd6def2 Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: {"security_group_rule": {"parent_group_id": "f4655c4f-0780-47eb-aac5-74e0ba8739b2", "ip_protocol": "tcp", "from_port": 964035331, "to_port": 22}} Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: exception: Invalid port range 964035331:22. Former value cannot be greater than the later Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f4655c4f-0780-47eb-aac5-74e0ba8739b2', 'ip_protocol': 'tcp', 'from_port': 964035331, 'to_port': 22}}} Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 964035331:22. Former value cannot be greater than the later Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 964035331:22. Former value cannot be greater than the later Jul 12 11:58:41.537061 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:41.540152 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:41.540152 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:41.540152 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:41.540152 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:41.540152 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:41.540152 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:41.540152 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:41.540152 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 964035331:22. Former value cannot be greater than the later Jul 12 11:58:41.540152 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:41.540152 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-48253f01-d454-4c80-862b-eac09c9a1fa7 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Returning 400 to user: Invalid port range 964035331:22. Former value cannot be greater than the later {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:41.540152 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-48253f01-d454-4c80-862b-eac09c9a1fa7 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.135760 Jul 12 11:58:41.546302 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1008/2183] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Jul 12 11:58:41 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:58:41.565062 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-130e9380-fbc8-4561-8eb6-90bae0ec0374 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:41.567123 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-130e9380-fbc8-4561-8eb6-90bae0ec0374 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9fcb0bf4-be39-45d1-ab06-c887502b711e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:41.598541 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-130e9380-fbc8-4561-8eb6-90bae0ec0374 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:41.599072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-130e9380-fbc8-4561-8eb6-90bae0ec0374 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:41.604923 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-130e9380-fbc8-4561-8eb6-90bae0ec0374 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:41.605395 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-130e9380-fbc8-4561-8eb6-90bae0ec0374 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:41.655390 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-130e9380-fbc8-4561-8eb6-90bae0ec0374 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-130e9380-fbc8-4561-8eb6-90bae0ec0374 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e HTTP/1.1 Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '9fcb0bf4-be39-45d1-ab06-c887502b711e'} Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:41.657850 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:41.661423 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:41.661423 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:41.661423 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:41.661423 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:41.661423 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:41.661423 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. Jul 12 11:58:41.661423 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:41.664968 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-130e9380-fbc8-4561-8eb6-90bae0ec0374 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 9fcb0bf4-be39-45d1-ab06-c887502b711e could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:41.668995 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-130e9380-fbc8-4561-8eb6-90bae0ec0374 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e" status: 404 len: 111 microversion: 2.1 time: 0.120538 Jul 12 11:58:41.670777 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1009/2184] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:41 2022] GET /compute/v2.1/servers/9fcb0bf4-be39-45d1-ab06-c887502b711e => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:41.683950 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6804d424-d624-4120-8a91-5ecb6edc6d9e tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:41.686056 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6804d424-d624-4120-8a91-5ecb6edc6d9e tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:41.703975 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6804d424-d624-4120-8a91-5ecb6edc6d9e tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:41.704788 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6804d424-d624-4120-8a91-5ecb6edc6d9e tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:41.706851 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6804d424-d624-4120-8a91-5ecb6edc6d9e tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:41.708572 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6804d424-d624-4120-8a91-5ecb6edc6d9e tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:41.775368 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-6804d424-d624-4120-8a91-5ecb6edc6d9e tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lazy-loading 'flavor' on Instance uuid 51829843-3012-41d2-a4a3-9683082906c5 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:58:41.970151 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6804d424-d624-4120-8a91-5ecb6edc6d9e tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5/action" status: 202 len: 0 microversion: 2.1 time: 0.296247 Jul 12 11:58:41.974519 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1010/2185] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:58:41 2022] POST /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:58:42.003848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-894cf6eb-949c-42f5-98ba-0a5362d87be7 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Action: 'create', calling method: .version_select at 0x7f5e13a333a0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1623211608", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:42.017188 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-894cf6eb-949c-42f5-98ba-0a5362d87be7 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] HTTP exception thrown: Security group id should be uuid Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-894cf6eb-949c-42f5-98ba-0a5362d87be7 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Request method failure captured: Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 131 Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWHpMMaYKW5V_GfH4nD01V1xFoZBdG_Pbezbp3zrnfhZwyxp5v9R00puEGHLgDf0oREYfl2vJh6HN-mgo9si7h9Q--HF336fE06aaaPEo6pW0ifhphVQwcpHIBUmvKwj7Car0bNNObjNy9Jl6ED_5LjMrHR4Zp_11g3mlGKwZxUfF74 Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3422ba4464014faeba969ec61faa775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3422ba4464014faeba969ec61faa775a", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: cbf4c2fa63904403a6261a9d3cd6def2 Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1623211608", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: exception: Security group id should be uuid Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1623211608', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:42.021719 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:42.033242 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 12 11:58:42.033242 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:42.038589 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-894cf6eb-949c-42f5-98ba-0a5362d87be7 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Returning 400 to user: Security group id should be uuid {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:42.040581 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-894cf6eb-949c-42f5-98ba-0a5362d87be7 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.063016 Jul 12 11:58:42.041932 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1011/2186] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Jul 12 11:58:41 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 12 11:58:42.052350 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ae40b1a7-2ca2-4622-ad18-9470da9d2dad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:42.055932 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ae40b1a7-2ca2-4622-ad18-9470da9d2dad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:42.078326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae40b1a7-2ca2-4622-ad18-9470da9d2dad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:42.083028 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae40b1a7-2ca2-4622-ad18-9470da9d2dad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:42.088108 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae40b1a7-2ca2-4622-ad18-9470da9d2dad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:42.093390 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae40b1a7-2ca2-4622-ad18-9470da9d2dad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:42.166469 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-ae40b1a7-2ca2-4622-ad18-9470da9d2dad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ae40b1a7-2ca2-4622-ad18-9470da9d2dad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c HTTP/1.1 Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'cd6a507e-64a6-490c-8dbd-bf23feec571c'} Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:42.176421 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:42.181898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:42.181898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:42.181898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:42.181898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:42.181898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:42.181898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:42.181898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:42.181898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:42.181898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:42.181898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:42.181898 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:42.181898 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ae40b1a7-2ca2-4622-ad18-9470da9d2dad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:42.181898 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ae40b1a7-2ca2-4622-ad18-9470da9d2dad tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 404 len: 111 microversion: 2.1 time: 0.134510 Jul 12 11:58:42.181898 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1012/2187] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:58:42 2022] DELETE /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:42.191302 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-161d68ed-5fe6-42f3-a057-66d3140dabd0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:42.194525 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-161d68ed-5fe6-42f3-a057-66d3140dabd0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:42.231485 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-161d68ed-5fe6-42f3-a057-66d3140dabd0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:42.232514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-161d68ed-5fe6-42f3-a057-66d3140dabd0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:42.238833 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-161d68ed-5fe6-42f3-a057-66d3140dabd0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:42.240415 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-161d68ed-5fe6-42f3-a057-66d3140dabd0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:42.259057 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:42.436610 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2301bd35-eb15-429e-878b-ada9e327bc0f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:42.528822 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2301bd35-eb15-429e-878b-ada9e327bc0f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1316 microversion: 2.1 time: 1.524257 Jul 12 11:58:42.536004 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1176/2188] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:41 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1316 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:42.555183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c53d08d8-8d5b-45c6-85c4-ce280e99458d tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:42.557414 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c53d08d8-8d5b-45c6-85c4-ce280e99458d tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:42.606287 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c53d08d8-8d5b-45c6-85c4-ce280e99458d tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:42.610441 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c53d08d8-8d5b-45c6-85c4-ce280e99458d tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:42.615531 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c53d08d8-8d5b-45c6-85c4-ce280e99458d tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:42.616664 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c53d08d8-8d5b-45c6-85c4-ce280e99458d tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:42.732457 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:43.250673 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-161d68ed-5fe6-42f3-a057-66d3140dabd0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:43.284547 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-161d68ed-5fe6-42f3-a057-66d3140dabd0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:43.296672 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-161d68ed-5fe6-42f3-a057-66d3140dabd0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:43.298829 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-161d68ed-5fe6-42f3-a057-66d3140dabd0 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1892 microversion: 2.32 time: 1.118420 Jul 12 11:58:43.300247 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1013/2189] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:42 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1892 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:43.311000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a4082491-c912-44f1-a467-1a326f898042 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Action: 'create', calling method: .version_select at 0x7f5e13a2ce50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-825782747", "description": "tempest-description-901144503"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:43.725398 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a4082491-c912-44f1-a467-1a326f898042 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.423717 Jul 12 11:58:43.726508 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1014/2190] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:58:43 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:43.731577 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e5f888ab-913c-4324-b6d4-5bfeb51132c9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:43.732531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e5f888ab-913c-4324-b6d4-5bfeb51132c9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: cd6a507e-64a6-490c-8dbd-bf23feec571c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:43.750847 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e5f888ab-913c-4324-b6d4-5bfeb51132c9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:43.751544 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e5f888ab-913c-4324-b6d4-5bfeb51132c9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:43.758136 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e5f888ab-913c-4324-b6d4-5bfeb51132c9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:43.760245 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e5f888ab-913c-4324-b6d4-5bfeb51132c9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:43.798949 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-e5f888ab-913c-4324-b6d4-5bfeb51132c9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e5f888ab-913c-4324-b6d4-5bfeb51132c9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c HTTP/1.1 Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'cd6a507e-64a6-490c-8dbd-bf23feec571c'} Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:43.800819 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:43.804614 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:43.804614 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:43.804614 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:43.804614 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:43.804614 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:43.804614 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. Jul 12 11:58:43.804614 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:43.809407 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e5f888ab-913c-4324-b6d4-5bfeb51132c9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance cd6a507e-64a6-490c-8dbd-bf23feec571c could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:43.816582 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e5f888ab-913c-4324-b6d4-5bfeb51132c9 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c" status: 404 len: 111 microversion: 2.1 time: 0.085394 Jul 12 11:58:43.826250 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1015/2191] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:43 2022] GET /compute/v2.1/servers/cd6a507e-64a6-490c-8dbd-bf23feec571c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:43.831284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-faf8e6d4-60c9-48fc-a9bc-379ab0f4a68b req-9a0eaf50-1bc6-4d14-8aff-25ab7b67b8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "tag": "62d08446-a99d-4f41-bebb-6117d86305fb"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:43.851499 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-faf8e6d4-60c9-48fc-a9bc-379ab0f4a68b req-9a0eaf50-1bc6-4d14-8aff-25ab7b67b8d1 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:43.851940 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-faf8e6d4-60c9-48fc-a9bc-379ab0f4a68b req-9a0eaf50-1bc6-4d14-8aff-25ab7b67b8d1 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:43.883829 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-faf8e6d4-60c9-48fc-a9bc-379ab0f4a68b req-9a0eaf50-1bc6-4d14-8aff-25ab7b67b8d1 service nova] Creating event network-changed:62d08446-a99d-4f41-bebb-6117d86305fb for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 11:58:43.893363 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-faf8e6d4-60c9-48fc-a9bc-379ab0f4a68b req-9a0eaf50-1bc6-4d14-8aff-25ab7b67b8d1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064613 Jul 12 11:58:43.895141 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1016/2192] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:43.904804 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-11da402c-870d-44d9-b145-991ff4ac4cdc req-41d0addb-702b-406e-ab7e-28b1f2a5b807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8209bb-e907-4347-92b9-16eee803b3f8", "name": "network-vif-plugged", "status": "completed", "tag": "d357fc65-71f4-4d90-ad38-7a1f4df8686b"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:43.920883 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-11da402c-870d-44d9-b145-991ff4ac4cdc req-41d0addb-702b-406e-ab7e-28b1f2a5b807 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:43.922627 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-11da402c-870d-44d9-b145-991ff4ac4cdc req-41d0addb-702b-406e-ab7e-28b1f2a5b807 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:43.942094 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-11da402c-870d-44d9-b145-991ff4ac4cdc req-41d0addb-702b-406e-ab7e-28b1f2a5b807 service nova] Creating event network-vif-plugged:d357fc65-71f4-4d90-ad38-7a1f4df8686b for instance 7c8209bb-e907-4347-92b9-16eee803b3f8 on n-h2-849104-4 Jul 12 11:58:43.948571 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-11da402c-870d-44d9-b145-991ff4ac4cdc req-41d0addb-702b-406e-ab7e-28b1f2a5b807 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051112 Jul 12 11:58:43.949708 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1017/2193] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:43.958196 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-dedec863-8844-48b6-9f3d-6308fffa23e2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:43.959157 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-dedec863-8844-48b6-9f3d-6308fffa23e2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:43.966802 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dedec863-8844-48b6-9f3d-6308fffa23e2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:43.967718 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dedec863-8844-48b6-9f3d-6308fffa23e2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:43.969217 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dedec863-8844-48b6-9f3d-6308fffa23e2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:43.969851 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dedec863-8844-48b6-9f3d-6308fffa23e2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:44.389756 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c53d08d8-8d5b-45c6-85c4-ce280e99458d tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1630 microversion: 2.1 time: 1.851875 Jul 12 11:58:44.392468 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1177/2194] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:42 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1630 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:44.401244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-eb6e3f15-4cc8-4105-9e29-e8faa0f15460 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Action: 'create', calling method: .version_select at 0x7f5e09f8eca0>, body: {"security_group_rule": {"parent_group_id": "0e94529a-664e-460b-b153-8b61f86da233", "ip_protocol": "tempest-999-756986924", "from_port": 22, "to_port": 22}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:44.633570 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-eb6e3f15-4cc8-4105-9e29-e8faa0f15460 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] HTTP exception thrown: Invalid IP protocol tempest-999-756986924. Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-eb6e3f15-4cc8-4105-9e29-e8faa0f15460 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Request method failure captured: Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 156 Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWHpMMaYKW5V_GfH4nD01V1xFoZBdG_Pbezbp3zrnfhZwyxp5v9R00puEGHLgDf0oREYfl2vJh6HN-mgo9si7h9Q--HF336fE06aaaPEo6pW0ifhphVQwcpHIBUmvKwj7Car0bNNObjNy9Jl6ED_5LjMrHR4Zp_11g3mlGKwZxUfF74 Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3422ba4464014faeba969ec61faa775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3422ba4464014faeba969ec61faa775a", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: cbf4c2fa63904403a6261a9d3cd6def2 Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: {"security_group_rule": {"parent_group_id": "0e94529a-664e-460b-b153-8b61f86da233", "ip_protocol": "tempest-999-756986924", "from_port": 22, "to_port": 22}} Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: exception: Invalid IP protocol tempest-999-756986924. Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0e94529a-664e-460b-b153-8b61f86da233', 'ip_protocol': 'tempest-999-756986924', 'from_port': 22, 'to_port': 22}}} Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-756986924. Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-756986924. Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:44.636779 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:44.640699 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:44.640699 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:44.640699 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:44.640699 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:44.640699 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:44.640699 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:44.640699 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-756986924. Jul 12 11:58:44.640699 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:44.644406 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-eb6e3f15-4cc8-4105-9e29-e8faa0f15460 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Returning 400 to user: Invalid IP protocol tempest-999-756986924. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:44.645578 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-eb6e3f15-4cc8-4105-9e29-e8faa0f15460 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.251316 Jul 12 11:58:44.647516 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1178/2195] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Jul 12 11:58:44 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 12 11:58:44.658256 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3813db5f-4a88-446e-b350-e0c54a33b668 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:44.660961 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3813db5f-4a88-446e-b350-e0c54a33b668 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:44.671980 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3813db5f-4a88-446e-b350-e0c54a33b668 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:44.677006 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3813db5f-4a88-446e-b350-e0c54a33b668 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:44.678243 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3813db5f-4a88-446e-b350-e0c54a33b668 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:44.678914 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3813db5f-4a88-446e-b350-e0c54a33b668 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:44.698838 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-dedec863-8844-48b6-9f3d-6308fffa23e2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:44.712786 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-dedec863-8844-48b6-9f3d-6308fffa23e2 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1316 microversion: 2.1 time: 0.760730 Jul 12 11:58:44.717279 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1018/2196] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:43 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1316 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:44.726928 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-3813db5f-4a88-446e-b350-e0c54a33b668 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3813db5f-4a88-446e-b350-e0c54a33b668 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 HTTP/1.1 Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'e416e34a-0097-4379-aa3d-6193730a9304'} Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:44.729750 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:44.732889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:58:44.732889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:44.732889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:44.732889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:44.732889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:44.732889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:44.732889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:44.732889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:44.732889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:44.732889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:58:44.732889 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:44.732889 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3813db5f-4a88-446e-b350-e0c54a33b668 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:44.732889 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3813db5f-4a88-446e-b350-e0c54a33b668 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 404 len: 111 microversion: 2.1 time: 0.082400 Jul 12 11:58:44.732889 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1179/2197] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:58:44 2022] DELETE /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:44.738421 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c6ddde39-67e2-4bde-86ff-d3d53888ce2c tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Action: 'create', calling method: .version_select at 0x7f5e09f8e3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-829408223", "description": "tempest-description-184414420"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:44.755218 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ce711c2a-9533-4f62-9cc0-c883c2f9783c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:44.756221 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ce711c2a-9533-4f62-9cc0-c883c2f9783c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:44.763610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce711c2a-9533-4f62-9cc0-c883c2f9783c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:44.764518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce711c2a-9533-4f62-9cc0-c883c2f9783c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:44.766084 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce711c2a-9533-4f62-9cc0-c883c2f9783c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:44.766734 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ce711c2a-9533-4f62-9cc0-c883c2f9783c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:45.409467 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c6ddde39-67e2-4bde-86ff-d3d53888ce2c tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.676475 Jul 12 11:58:45.411594 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1180/2198] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:58:44 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:45.431124 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ce0f0b48-5d1b-4ea1-8123-6ca44ec3a5bd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:45.432680 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ce0f0b48-5d1b-4ea1-8123-6ca44ec3a5bd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: e416e34a-0097-4379-aa3d-6193730a9304] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:45.443981 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ce711c2a-9533-4f62-9cc0-c883c2f9783c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:45.487551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ce0f0b48-5d1b-4ea1-8123-6ca44ec3a5bd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:45.489151 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ce0f0b48-5d1b-4ea1-8123-6ca44ec3a5bd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:45.498536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ce0f0b48-5d1b-4ea1-8123-6ca44ec3a5bd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:45.500091 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ce0f0b48-5d1b-4ea1-8123-6ca44ec3a5bd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:45.501113 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ce711c2a-9533-4f62-9cc0-c883c2f9783c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:45.508951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ce711c2a-9533-4f62-9cc0-c883c2f9783c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:45.516312 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ce711c2a-9533-4f62-9cc0-c883c2f9783c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1892 microversion: 2.32 time: 0.786498 Jul 12 11:58:45.519648 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1019/2199] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:44 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1892 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:45.531729 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-6ef2c678-07fd-442b-aac5-c208c211b3d2 req-b8453218-a817-46ae-9dd9-5a581d53c5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26b640d-3b19-492b-99f2-4c0cb3c10c25", "tag": "fefc048a-c90e-4ca6-908e-d9728a5304fa"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:45.557630 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-ce0f0b48-5d1b-4ea1-8123-6ca44ec3a5bd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ce0f0b48-5d1b-4ea1-8123-6ca44ec3a5bd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 HTTP/1.1 Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'e416e34a-0097-4379-aa3d-6193730a9304'} Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:45.561157 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.567683 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:45.567683 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:45.567683 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:45.567683 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:45.567683 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:45.567683 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. Jul 12 11:58:45.567683 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.574926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ce0f0b48-5d1b-4ea1-8123-6ca44ec3a5bd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance e416e34a-0097-4379-aa3d-6193730a9304 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:45.576489 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ce0f0b48-5d1b-4ea1-8123-6ca44ec3a5bd tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304" status: 404 len: 111 microversion: 2.1 time: 0.163450 Jul 12 11:58:45.577058 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-6ef2c678-07fd-442b-aac5-c208c211b3d2 req-b8453218-a817-46ae-9dd9-5a581d53c5c3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:45.579212 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-6ef2c678-07fd-442b-aac5-c208c211b3d2 req-b8453218-a817-46ae-9dd9-5a581d53c5c3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:45.580558 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1181/2200] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:45 2022] GET /compute/v2.1/servers/e416e34a-0097-4379-aa3d-6193730a9304 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:45.591872 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c6a4c00e-c9eb-4354-b123-5cc6e5a9099a tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:45.595155 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c6a4c00e-c9eb-4354-b123-5cc6e5a9099a tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:45.625775 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c6a4c00e-c9eb-4354-b123-5cc6e5a9099a tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:45.630518 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-6ef2c678-07fd-442b-aac5-c208c211b3d2 req-b8453218-a817-46ae-9dd9-5a581d53c5c3 service nova] Creating event network-changed:fefc048a-c90e-4ca6-908e-d9728a5304fa for instance b26b640d-3b19-492b-99f2-4c0cb3c10c25 on n-h2-849104-4 Jul 12 11:58:45.633255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c6a4c00e-c9eb-4354-b123-5cc6e5a9099a tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:45.636929 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c6a4c00e-c9eb-4354-b123-5cc6e5a9099a tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:45.637984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c6a4c00e-c9eb-4354-b123-5cc6e5a9099a tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:45.659975 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-6ef2c678-07fd-442b-aac5-c208c211b3d2 req-b8453218-a817-46ae-9dd9-5a581d53c5c3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135997 Jul 12 11:58:45.664171 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1020/2201] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:45.688813 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f137a477-b96c-4d20-85fc-e2059b326f09 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Action: 'create', calling method: .version_select at 0x7f5e139f38b0>, body: {"security_group_rule": {"parent_group_id": "b2d3a169-ac5b-4c72-b054-64ea8b0bc564", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:45.863546 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-f137a477-b96c-4d20-85fc-e2059b326f09 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f137a477-b96c-4d20-85fc-e2059b326f09 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Request method failure captured: Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 138 Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWHpMMaYKW5V_GfH4nD01V1xFoZBdG_Pbezbp3zrnfhZwyxp5v9R00puEGHLgDf0oREYfl2vJh6HN-mgo9si7h9Q--HF336fE06aaaPEo6pW0ifhphVQwcpHIBUmvKwj7Car0bNNObjNy9Jl6ED_5LjMrHR4Zp_11g3mlGKwZxUfF74 Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3422ba4464014faeba969ec61faa775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3422ba4464014faeba969ec61faa775a", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: cbf4c2fa63904403a6261a9d3cd6def2 Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: {"security_group_rule": {"parent_group_id": "b2d3a169-ac5b-4c72-b054-64ea8b0bc564", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b2d3a169-ac5b-4c72-b054-64ea8b0bc564', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 12 11:58:45.866189 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.870465 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:45.870465 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.870465 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:45.870465 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:45.870465 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:45.870465 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:45.870465 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:45.870465 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 12 11:58:45.870465 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.871982 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f137a477-b96c-4d20-85fc-e2059b326f09 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:45.874460 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f137a477-b96c-4d20-85fc-e2059b326f09 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.207856 Jul 12 11:58:45.875599 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1021/2202] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Jul 12 11:58:45 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 211 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:58:45.883810 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c1d64475-df59-4c57-80d0-f6c88248f674 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:45.886226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c1d64475-df59-4c57-80d0-f6c88248f674 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:45.903885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c1d64475-df59-4c57-80d0-f6c88248f674 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:45.913718 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c1d64475-df59-4c57-80d0-f6c88248f674 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:45.915317 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c1d64475-df59-4c57-80d0-f6c88248f674 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:45.916295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c1d64475-df59-4c57-80d0-f6c88248f674 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:45.950951 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-c1d64475-df59-4c57-80d0-f6c88248f674 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c1d64475-df59-4c57-80d0-f6c88248f674 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 HTTP/1.1 Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '407593f6-2750-41da-94d7-2f786fa41200'} Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:45.955251 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:45.958575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:58:45.958575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.958575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:45.958575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.958575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:45.958575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:45.958575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:45.958575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:45.958575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:45.958575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:58:45.958575 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:45.958575 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c1d64475-df59-4c57-80d0-f6c88248f674 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:45.961070 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c1d64475-df59-4c57-80d0-f6c88248f674 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 404 len: 111 microversion: 2.1 time: 0.083955 Jul 12 11:58:45.965053 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1022/2203] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:58:45 2022] DELETE /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:45.980133 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-dff68c0d-43eb-46dc-b407-af0f6cb46688 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:45.981080 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-dff68c0d-43eb-46dc-b407-af0f6cb46688 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:46.003106 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dff68c0d-43eb-46dc-b407-af0f6cb46688 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:46.003894 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dff68c0d-43eb-46dc-b407-af0f6cb46688 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:46.005345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dff68c0d-43eb-46dc-b407-af0f6cb46688 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:46.005494 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dff68c0d-43eb-46dc-b407-af0f6cb46688 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:46.449222 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c6a4c00e-c9eb-4354-b123-5cc6e5a9099a tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1613 microversion: 2.1 time: 0.864523 Jul 12 11:58:46.452190 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1182/2204] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:45 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1613 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:46.466518 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6d4d03e1-577a-494a-8f41-cbffd8f38bad tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Action: 'create', calling method: .version_select at 0x7f5e09d2c310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1107701050", "description": "tempest-description-157691439"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:46.760081 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-dff68c0d-43eb-46dc-b407-af0f6cb46688 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:46.778360 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-dff68c0d-43eb-46dc-b407-af0f6cb46688 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1316 microversion: 2.1 time: 0.807044 Jul 12 11:58:46.779734 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1023/2205] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:45 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1316 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:46.786498 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1cc05232-d62b-452d-828a-0c0cd929d7c4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:46.795927 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1cc05232-d62b-452d-828a-0c0cd929d7c4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 407593f6-2750-41da-94d7-2f786fa41200] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:46.809704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1cc05232-d62b-452d-828a-0c0cd929d7c4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:46.810408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1cc05232-d62b-452d-828a-0c0cd929d7c4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:46.811700 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1cc05232-d62b-452d-828a-0c0cd929d7c4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:46.812415 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1cc05232-d62b-452d-828a-0c0cd929d7c4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:46.869698 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-1cc05232-d62b-452d-828a-0c0cd929d7c4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1cc05232-d62b-452d-828a-0c0cd929d7c4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 HTTP/1.1 Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '407593f6-2750-41da-94d7-2f786fa41200'} Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:46.878173 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:46.881862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:46.881862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:46.881862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:46.881862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:46.881862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:46.881862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. Jul 12 11:58:46.881862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:46.881862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1cc05232-d62b-452d-828a-0c0cd929d7c4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 407593f6-2750-41da-94d7-2f786fa41200 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:46.881862 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1cc05232-d62b-452d-828a-0c0cd929d7c4 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200" status: 404 len: 111 microversion: 2.1 time: 0.099211 Jul 12 11:58:46.883634 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1024/2206] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:46 2022] GET /compute/v2.1/servers/407593f6-2750-41da-94d7-2f786fa41200 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:46.901805 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-75143411-feb0-4726-a64b-a7de2b7ff986 req-4916aa9f-dfa8-4f93-808a-18c956803909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "tag": "65251375-ff74-4521-a4d6-cec51c2c3fa2"}, {"name": "network-changed", "server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "tag": "6ade7ded-bc94-401b-9a37-8c94c0fbf2c7"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:46.935080 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6d4d03e1-577a-494a-8f41-cbffd8f38bad tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.478968 Jul 12 11:58:46.935727 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1183/2207] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Jul 12 11:58:46 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:46.942108 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a034a79c-112c-45f2-825d-aaff47980891 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:46.942857 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a034a79c-112c-45f2-825d-aaff47980891 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:46.959350 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-75143411-feb0-4726-a64b-a7de2b7ff986 req-4916aa9f-dfa8-4f93-808a-18c956803909 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:46.960159 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-75143411-feb0-4726-a64b-a7de2b7ff986 req-4916aa9f-dfa8-4f93-808a-18c956803909 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:46.962438 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a034a79c-112c-45f2-825d-aaff47980891 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:46.962968 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a034a79c-112c-45f2-825d-aaff47980891 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:46.963950 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a034a79c-112c-45f2-825d-aaff47980891 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:46.964426 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a034a79c-112c-45f2-825d-aaff47980891 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:46.977223 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-75143411-feb0-4726-a64b-a7de2b7ff986 req-4916aa9f-dfa8-4f93-808a-18c956803909 service nova] Creating event network-changed:65251375-ff74-4521-a4d6-cec51c2c3fa2 for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 11:58:46.978008 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-75143411-feb0-4726-a64b-a7de2b7ff986 req-4916aa9f-dfa8-4f93-808a-18c956803909 service nova] Creating event network-changed:6ade7ded-bc94-401b-9a37-8c94c0fbf2c7 for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 11:58:46.992440 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-75143411-feb0-4726-a64b-a7de2b7ff986 req-4916aa9f-dfa8-4f93-808a-18c956803909 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.107176 Jul 12 11:58:46.993717 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1025/2208] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:47.002139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2a30415d-f5b3-4e24-8abc-1c8b42c9b7df tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:47.003346 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2a30415d-f5b3-4e24-8abc-1c8b42c9b7df tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:47.028556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2a30415d-f5b3-4e24-8abc-1c8b42c9b7df tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:47.029475 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2a30415d-f5b3-4e24-8abc-1c8b42c9b7df tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:47.030505 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2a30415d-f5b3-4e24-8abc-1c8b42c9b7df tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:47.031923 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2a30415d-f5b3-4e24-8abc-1c8b42c9b7df tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:47.079250 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-a034a79c-112c-45f2-825d-aaff47980891 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] HTTP exception thrown: Cannot 'migrate' instance 51829843-3012-41d2-a4a3-9683082906c5 while it is in vm_state suspended Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a034a79c-112c-45f2-825d-aaff47980891 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Request method failure captured: Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5/action HTTP/1.1 Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 15 Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWG5YM8fKXuS8srU_HZEWXknqKn7VwtugR1GVJaI3S3DfzzqtloJALDsOMk26lQMY-lrE_w9Ph_UMVK2lL4nwV6VvrhqLTkC3qUIiizwrL35j4yIz_zH0c8GVbeEyqYkjXZ-pWw8OhHtFbIccSoFARnyZEJH76d7-ZFBeue4PBXOeg4 Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: c60203ad156c4a698f2cbe2898564feb Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c60203ad156c4a698f2cbe2898564feb", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: c60203ad156c4a698f2cbe2898564feb Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersAdminNegativeTestJSON-1964131451-project-admin Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0e9f351c3767449eafed6bc16fd7cc00 Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1964131451-project-admin Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: {"migrate": {}} Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: exception: Cannot 'migrate' instance 51829843-3012-41d2-a4a3-9683082906c5 while it is in vm_state suspended Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '51829843-3012-41d2-a4a3-9683082906c5', 'body': {'migrate': {}}} Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 51829843-3012-41d2-a4a3-9683082906c5 in vm_state suspended. Cannot resize while the instance is in this state. Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:47.085964 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 51829843-3012-41d2-a4a3-9683082906c5 while it is in vm_state suspended Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 51829843-3012-41d2-a4a3-9683082906c5 while it is in vm_state suspended Jul 12 11:58:47.089384 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.096248 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a034a79c-112c-45f2-825d-aaff47980891 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Returning 409 to user: Cannot 'migrate' instance 51829843-3012-41d2-a4a3-9683082906c5 while it is in vm_state suspended {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:47.097505 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a034a79c-112c-45f2-825d-aaff47980891 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5/action" status: 409 len: 148 microversion: 2.1 time: 0.160626 Jul 12 11:58:47.098453 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1184/2209] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:58:46 2022] POST /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5/action => generated 148 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:58:47.120992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c9cfa8db-f2a9-4d9a-a599-1157980c2960 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:47.122449 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c9cfa8db-f2a9-4d9a-a599-1157980c2960 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9f2d49ee-0d10-42e9-80db-c8530c914843] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:47.136406 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c9cfa8db-f2a9-4d9a-a599-1157980c2960 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:47.142854 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c9cfa8db-f2a9-4d9a-a599-1157980c2960 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:47.144203 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c9cfa8db-f2a9-4d9a-a599-1157980c2960 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:47.144995 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c9cfa8db-f2a9-4d9a-a599-1157980c2960 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:47.173259 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-c9cfa8db-f2a9-4d9a-a599-1157980c2960 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c9cfa8db-f2a9-4d9a-a599-1157980c2960 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/servers/9f2d49ee-0d10-42e9-80db-c8530c914843 HTTP/1.1 Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '9f2d49ee-0d10-42e9-80db-c8530c914843'} Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:47.177173 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:47.180472 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:58:47.180472 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.180472 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.180472 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.180472 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.180472 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:47.180472 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:47.180472 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:47.180472 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:47.180472 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:58:47.180472 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.184466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c9cfa8db-f2a9-4d9a-a599-1157980c2960 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:47.188738 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c9cfa8db-f2a9-4d9a-a599-1157980c2960 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9f2d49ee-0d10-42e9-80db-c8530c914843" status: 404 len: 111 microversion: 2.1 time: 0.081903 Jul 12 11:58:47.195445 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1185/2210] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:58:47 2022] DELETE /compute/v2.1/servers/9f2d49ee-0d10-42e9-80db-c8530c914843 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:47.200879 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-187bf5e5-c2f8-4b2b-a35d-f5efa7b625d2 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Action: 'create', calling method: .version_select at 0x7f5e0994d790>, body: {"security_group_rule": {"parent_group_id": "5543b0b9-0925-46ce-9bbd-f68341b466b3", "ip_protocol": "tcp", "from_port": 22, "to_port": 1752944828}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:47.430981 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-187bf5e5-c2f8-4b2b-a35d-f5efa7b625d2 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] HTTP exception thrown: Invalid port range 22:1752944828. Valid TCP ports should be between 1-65535 Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-187bf5e5-c2f8-4b2b-a35d-f5efa7b625d2 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Request method failure captured: Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 146 Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWHpMMaYKW5V_GfH4nD01V1xFoZBdG_Pbezbp3zrnfhZwyxp5v9R00puEGHLgDf0oREYfl2vJh6HN-mgo9si7h9Q--HF336fE06aaaPEo6pW0ifhphVQwcpHIBUmvKwj7Car0bNNObjNy9Jl6ED_5LjMrHR4Zp_11g3mlGKwZxUfF74 Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3422ba4464014faeba969ec61faa775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3422ba4464014faeba969ec61faa775a", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: cbf4c2fa63904403a6261a9d3cd6def2 Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: {"security_group_rule": {"parent_group_id": "5543b0b9-0925-46ce-9bbd-f68341b466b3", "ip_protocol": "tcp", "from_port": 22, "to_port": 1752944828}} Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: exception: Invalid port range 22:1752944828. Valid TCP ports should be between 1-65535 Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5543b0b9-0925-46ce-9bbd-f68341b466b3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1752944828}}} Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1752944828. Valid TCP ports should be between 1-65535 Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1752944828. Valid TCP ports should be between 1-65535 Jul 12 11:58:47.433424 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.438428 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.438428 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.438428 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.438428 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:47.438428 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:47.438428 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:47.438428 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:47.438428 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1752944828. Valid TCP ports should be between 1-65535 Jul 12 11:58:47.438428 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.438428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-187bf5e5-c2f8-4b2b-a35d-f5efa7b625d2 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Returning 400 to user: Invalid port range 22:1752944828. Valid TCP ports should be between 1-65535 {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:47.438428 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-187bf5e5-c2f8-4b2b-a35d-f5efa7b625d2 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.238191 Jul 12 11:58:47.438428 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1186/2211] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Jul 12 11:58:47 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 240 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:58:47.442624 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f77f5039-9bd0-4f7c-87a9-c8defba67b6e tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f77f5039-9bd0-4f7c-87a9-c8defba67b6e tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Request method failure captured: Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198/action HTTP/1.1 Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 39 Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWG5YM8fKXuS8srU_HZEWXknqKn7VwtugR1GVJaI3S3DfzzqtloJALDsOMk26lQMY-lrE_w9Ph_UMVK2lL4nwV6VvrhqLTkC3qUIiizwrL35j4yIz_zH0c8GVbeEyqYkjXZ-pWw8OhHtFbIccSoFARnyZEJH76d7-ZFBeue4PBXOeg4 Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: c60203ad156c4a698f2cbe2898564feb Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c60203ad156c4a698f2cbe2898564feb", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: c60203ad156c4a698f2cbe2898564feb Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersAdminNegativeTestJSON-1964131451-project-admin Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0e9f351c3767449eafed6bc16fd7cc00 Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1964131451-project-admin Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: {"os-resetState": {"state": "invalid"}} Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '2f7a3be4-ad42-48af-ad94-1eb23cb5a198', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise error Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 'invalid' Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 11:58:47.453345 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 11:58:47.459560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 12 11:58:47.459560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.459560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.459560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.459560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.459560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:47.459560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:47.459560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 11:58:47.459560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 11:58:47.459560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 12 11:58:47.459560 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.459560 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f77f5039-9bd0-4f7c-87a9-c8defba67b6e tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:47.459560 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f77f5039-9bd0-4f7c-87a9-c8defba67b6e tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198/action" status: 400 len: 144 microversion: 2.1 time: 0.016709 Jul 12 11:58:47.481604 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1187/2212] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:58:47 2022] POST /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198/action => generated 144 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:58:47.487355 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-61bbb4d7-18c6-40d2-ac5f-5d16a53c9d76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:47.488394 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-61bbb4d7-18c6-40d2-ac5f-5d16a53c9d76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 9f2d49ee-0d10-42e9-80db-c8530c914843] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:47.514752 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61bbb4d7-18c6-40d2-ac5f-5d16a53c9d76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:47.516600 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61bbb4d7-18c6-40d2-ac5f-5d16a53c9d76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:47.518880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61bbb4d7-18c6-40d2-ac5f-5d16a53c9d76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:47.520271 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61bbb4d7-18c6-40d2-ac5f-5d16a53c9d76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:47.561091 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-61bbb4d7-18c6-40d2-ac5f-5d16a53c9d76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-61bbb4d7-18c6-40d2-ac5f-5d16a53c9d76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/9f2d49ee-0d10-42e9-80db-c8530c914843 HTTP/1.1 Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '9f2d49ee-0d10-42e9-80db-c8530c914843'} Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.563520 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.568127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.568127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:47.568127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:47.568127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:47.568127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:47.568127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. Jul 12 11:58:47.568127 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.570957 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-61bbb4d7-18c6-40d2-ac5f-5d16a53c9d76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 9f2d49ee-0d10-42e9-80db-c8530c914843 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:47.571981 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-61bbb4d7-18c6-40d2-ac5f-5d16a53c9d76 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/9f2d49ee-0d10-42e9-80db-c8530c914843" status: 404 len: 111 microversion: 2.1 time: 0.088920 Jul 12 11:58:47.578960 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1188/2213] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:47 2022] GET /compute/v2.1/servers/9f2d49ee-0d10-42e9-80db-c8530c914843 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:47.592467 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8fa77703-2110-40d2-a859-9446cc67b529 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Action: 'create', calling method: .version_select at 0x7f5e09b29040>, body: {"security_group_rule": {"parent_group_id": "72bd1d69-bae2-4635-8bda-27d64df47650", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:47.797027 n-d-849104-4 devstack@n-api.service[125984]: DEBUG neutronclient.v2_0.client [None req-8fa77703-2110-40d2-a859-9446cc67b529 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 72bd1d69-bae2-4635-8bda-27d64df47650 does not exist", "detail": ""}} {{(pid=125984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 12 11:58:47.798095 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.security_group_api [None req-8fa77703-2110-40d2-a859-9446cc67b529 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Neutron security group 72bd1d69-bae2-4635-8bda-27d64df47650 not found {{(pid=125984) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 12 11:58:47.798835 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-8fa77703-2110-40d2-a859-9446cc67b529 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] HTTP exception thrown: Security group 72bd1d69-bae2-4635-8bda-27d64df47650 does not exist Jul 12 11:58:47.798835 n-d-849104-4 devstack@n-api.service[125984]: Neutron server returns request_ids: ['req-1ac0d53f-1855-41e1-8693-a5094f9528d7'] Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8fa77703-2110-40d2-a859-9446cc67b529 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Request method failure captured: Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 138 Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWHpMMaYKW5V_GfH4nD01V1xFoZBdG_Pbezbp3zrnfhZwyxp5v9R00puEGHLgDf0oREYfl2vJh6HN-mgo9si7h9Q--HF336fE06aaaPEo6pW0ifhphVQwcpHIBUmvKwj7Car0bNNObjNy9Jl6ED_5LjMrHR4Zp_11g3mlGKwZxUfF74 Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3422ba4464014faeba969ec61faa775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3422ba4464014faeba969ec61faa775a", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: cbf4c2fa63904403a6261a9d3cd6def2 Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: {"security_group_rule": {"parent_group_id": "72bd1d69-bae2-4635-8bda-27d64df47650", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: exception: Security group 72bd1d69-bae2-4635-8bda-27d64df47650 does not exist Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: Neutron server returns request_ids: ['req-1ac0d53f-1855-41e1-8693-a5094f9528d7'] Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'body': {'security_group_rule': {'parent_group_id': '72bd1d69-bae2-4635-8bda-27d64df47650', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 12 11:58:47.801413 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 72bd1d69-bae2-4635-8bda-27d64df47650 does not exist Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ac0d53f-1855-41e1-8693-a5094f9528d7'] Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 72bd1d69-bae2-4635-8bda-27d64df47650 does not exist Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ac0d53f-1855-41e1-8693-a5094f9528d7'] Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 72bd1d69-bae2-4635-8bda-27d64df47650 does not exist Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ac0d53f-1855-41e1-8693-a5094f9528d7'] Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 72bd1d69-bae2-4635-8bda-27d64df47650 does not exist Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ac0d53f-1855-41e1-8693-a5094f9528d7'] Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8fa77703-2110-40d2-a859-9446cc67b529 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Returning 404 to user: Security group 72bd1d69-bae2-4635-8bda-27d64df47650 does not exist Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: Neutron server returns request_ids: ['req-1ac0d53f-1855-41e1-8693-a5094f9528d7'] {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:47.805260 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8fa77703-2110-40d2-a859-9446cc67b529 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.222928 Jul 12 11:58:47.811078 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1189/2214] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Jul 12 11:58:47 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:47.822862 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-98e27b85-3584-4596-a94d-6a9911fce642 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-98e27b85-3584-4596-a94d-6a9911fce642 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Request method failure captured: Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198/action HTTP/1.1 Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 31 Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWG5YM8fKXuS8srU_HZEWXknqKn7VwtugR1GVJaI3S3DfzzqtloJALDsOMk26lQMY-lrE_w9Ph_UMVK2lL4nwV6VvrhqLTkC3qUIiizwrL35j4yIz_zH0c8GVbeEyqYkjXZ-pWw8OhHtFbIccSoFARnyZEJH76d7-ZFBeue4PBXOeg4 Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: c60203ad156c4a698f2cbe2898564feb Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c60203ad156c4a698f2cbe2898564feb", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: c60203ad156c4a698f2cbe2898564feb Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersAdminNegativeTestJSON-1964131451-project-admin Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0e9f351c3767449eafed6bc16fd7cc00 Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1964131451-project-admin Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: {"os-resetState": {"state": 1}} Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '2f7a3be4-ad42-48af-ad94-1eb23cb5a198', 'body': {'os-resetState': {'state': 1}}} Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise error Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi 1 Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 12 11:58:47.829232 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.835239 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:47.835239 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.835239 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:47.835239 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:47.835239 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:47.835239 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 11:58:47.835239 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 11:58:47.835239 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 12 11:58:47.835239 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:47.835239 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-98e27b85-3584-4596-a94d-6a9911fce642 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:47.835239 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-98e27b85-3584-4596-a94d-6a9911fce642 tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198/action" status: 400 len: 120 microversion: 2.1 time: 0.018409 Jul 12 11:58:47.846256 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1190/2215] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:58:47 2022] POST /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198/action => generated 120 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:58:47.860001 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d9e14e61-1ae2-4b85-9ff0-2561a41d00e6 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:47.860672 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d9e14e61-1ae2-4b85-9ff0-2561a41d00e6 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:47.882335 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9e14e61-1ae2-4b85-9ff0-2561a41d00e6 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:47.882837 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9e14e61-1ae2-4b85-9ff0-2561a41d00e6 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:47.883671 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9e14e61-1ae2-4b85-9ff0-2561a41d00e6 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:47.884138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d9e14e61-1ae2-4b85-9ff0-2561a41d00e6 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:48.437344 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d9e14e61-1ae2-4b85-9ff0-2561a41d00e6 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:48.452421 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d9e14e61-1ae2-4b85-9ff0-2561a41d00e6 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1506 microversion: 2.1 time: 0.604501 Jul 12 11:58:48.454726 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1191/2216] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:47 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1506 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:48.465377 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-df019a8f-b62e-428f-ae4b-7936a921a3ca tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Calling method '.version_select at 0x7f5e09fa4dc0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:48.501607 n-d-849104-4 devstack@n-api.service[125984]: DEBUG neutronclient.v2_0.client [None req-df019a8f-b62e-428f-ae4b-7936a921a3ca tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 07222e0f-7b81-43c6-85e2-0fae4bac417c does not exist", "detail": ""}} {{(pid=125984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 12 11:58:48.503525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.security_group_api [None req-df019a8f-b62e-428f-ae4b-7936a921a3ca tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Neutron security group rule 07222e0f-7b81-43c6-85e2-0fae4bac417c not found {{(pid=125984) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 12 11:58:48.504606 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-df019a8f-b62e-428f-ae4b-7936a921a3ca tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] HTTP exception thrown: Security group rule 07222e0f-7b81-43c6-85e2-0fae4bac417c does not exist Jul 12 11:58:48.504606 n-d-849104-4 devstack@n-api.service[125984]: Neutron server returns request_ids: ['req-2297668b-2b3f-447e-9009-eac6ae74ee29'] Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-df019a8f-b62e-428f-ae4b-7936a921a3ca tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Request method failure captured: Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/os-security-group-rules/07222e0f-7b81-43c6-85e2-0fae4bac417c HTTP/1.1 Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWHpMMaYKW5V_GfH4nD01V1xFoZBdG_Pbezbp3zrnfhZwyxp5v9R00puEGHLgDf0oREYfl2vJh6HN-mgo9si7h9Q--HF336fE06aaaPEo6pW0ifhphVQwcpHIBUmvKwj7Car0bNNObjNy9Jl6ED_5LjMrHR4Zp_11g3mlGKwZxUfF74 Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3422ba4464014faeba969ec61faa775a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3422ba4464014faeba969ec61faa775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3422ba4464014faeba969ec61faa775a", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 3422ba4464014faeba969ec61faa775a Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708 Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: cbf4c2fa63904403a6261a9d3cd6def2 Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910397708-project Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: exception: Security group rule 07222e0f-7b81-43c6-85e2-0fae4bac417c does not exist Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: Neutron server returns request_ids: ['req-2297668b-2b3f-447e-9009-eac6ae74ee29'] Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '07222e0f-7b81-43c6-85e2-0fae4bac417c'} Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 12 11:58:48.506758 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 07222e0f-7b81-43c6-85e2-0fae4bac417c does not exist Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2297668b-2b3f-447e-9009-eac6ae74ee29'] Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 07222e0f-7b81-43c6-85e2-0fae4bac417c does not exist Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2297668b-2b3f-447e-9009-eac6ae74ee29'] Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 07222e0f-7b81-43c6-85e2-0fae4bac417c does not exist Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2297668b-2b3f-447e-9009-eac6ae74ee29'] Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 07222e0f-7b81-43c6-85e2-0fae4bac417c does not exist Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2297668b-2b3f-447e-9009-eac6ae74ee29'] Jul 12 11:58:48.510600 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:48.517003 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-df019a8f-b62e-428f-ae4b-7936a921a3ca tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Returning 404 to user: Security group rule 07222e0f-7b81-43c6-85e2-0fae4bac417c does not exist Jul 12 11:58:48.517003 n-d-849104-4 devstack@n-api.service[125984]: Neutron server returns request_ids: ['req-2297668b-2b3f-447e-9009-eac6ae74ee29'] {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:48.519138 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-df019a8f-b62e-428f-ae4b-7936a921a3ca tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/07222e0f-7b81-43c6-85e2-0fae4bac417c" status: 404 len: 199 microversion: 2.1 time: 0.060681 Jul 12 11:58:48.520301 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1192/2217] 10.222.0.50 () {58 vars in 1286 bytes} [Tue Jul 12 11:58:48 2022] DELETE /compute/v2.1/os-security-group-rules/07222e0f-7b81-43c6-85e2-0fae4bac417c => generated 199 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:48.526330 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2a30415d-f5b3-4e24-8abc-1c8b42c9b7df tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:48.530474 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-00521c70-6439-4e29-b79d-51cce93e6c6d tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:48.537158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-00521c70-6439-4e29-b79d-51cce93e6c6d tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Failed to fetch instance by id 999 {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 12 11:58:48.542219 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-00521c70-6439-4e29-b79d-51cce93e6c6d tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-00521c70-6439-4e29-b79d-51cce93e6c6d tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Request method failure captured: Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 37 Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWG5YM8fKXuS8srU_HZEWXknqKn7VwtugR1GVJaI3S3DfzzqtloJALDsOMk26lQMY-lrE_w9Ph_UMVK2lL4nwV6VvrhqLTkC3qUIiizwrL35j4yIz_zH0c8GVbeEyqYkjXZ-pWw8OhHtFbIccSoFARnyZEJH76d7-ZFBeue4PBXOeg4 Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: c60203ad156c4a698f2cbe2898564feb Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Role: admin,reader,member Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: admin,reader,member Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c60203ad156c4a698f2cbe2898564feb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c60203ad156c4a698f2cbe2898564feb", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: c60203ad156c4a698f2cbe2898564feb Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1964131451 Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersAdminNegativeTestJSON-1964131451-project-admin Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 0e9f351c3767449eafed6bc16fd7cc00 Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1964131451-project-admin Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: {"os-resetState": {"state": "error"}} Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 999 could not be found. Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:48.550604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:48.554178 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:48.554178 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 12 11:58:48.554178 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:48.555526 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-00521c70-6439-4e29-b79d-51cce93e6c6d tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:48.556727 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-00521c70-6439-4e29-b79d-51cce93e6c6d tempest-ServersAdminNegativeTestJSON-1964131451 tempest-ServersAdminNegativeTestJSON-1964131451-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.035256 Jul 12 11:58:48.557512 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1193/2218] 10.222.0.50 () {60 vars in 1178 bytes} [Tue Jul 12 11:58:48 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:58:48.566138 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2a30415d-f5b3-4e24-8abc-1c8b42c9b7df tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:48.572595 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-29d2aded-4fe1-419c-9daf-ba23fb32c11f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:48.573936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-29d2aded-4fe1-419c-9daf-ba23fb32c11f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:48.595642 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2a30415d-f5b3-4e24-8abc-1c8b42c9b7df tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:48.600083 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-29d2aded-4fe1-419c-9daf-ba23fb32c11f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:48.603364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-29d2aded-4fe1-419c-9daf-ba23fb32c11f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:48.604466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-29d2aded-4fe1-419c-9daf-ba23fb32c11f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:48.605111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-29d2aded-4fe1-419c-9daf-ba23fb32c11f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:48.610958 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2a30415d-f5b3-4e24-8abc-1c8b42c9b7df tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1892 microversion: 2.32 time: 1.615198 Jul 12 11:58:48.638761 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1026/2219] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:46 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1892 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:48.651576 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-afcbbdc7-d727-4d9c-bdea-6168504843bf tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Calling method '.version_select at 0x7f5e139f34c0>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:48.689058 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-29d2aded-4fe1-419c-9daf-ba23fb32c11f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:48.690447 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-29d2aded-4fe1-419c-9daf-ba23fb32c11f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8/os-instance-actions/req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b" status: 200 len: 313 microversion: 2.1 time: 0.129876 Jul 12 11:58:48.691665 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1194/2220] 10.222.0.50 () {58 vars in 1418 bytes} [Tue Jul 12 11:58:48 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8/os-instance-actions/req-7a3ea5b7-0480-4e80-9a83-f57ef027d68b => generated 313 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:48.700161 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e975c35d-7978-44fe-ad93-984e431cdffb tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:48.701178 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e975c35d-7978-44fe-ad93-984e431cdffb tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:48.714796 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e975c35d-7978-44fe-ad93-984e431cdffb tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:48.715486 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e975c35d-7978-44fe-ad93-984e431cdffb tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:48.716466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e975c35d-7978-44fe-ad93-984e431cdffb tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:48.717063 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e975c35d-7978-44fe-ad93-984e431cdffb tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:48.768592 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e975c35d-7978-44fe-ad93-984e431cdffb tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:58:48.942446 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:48.988365 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e975c35d-7978-44fe-ad93-984e431cdffb tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "DELETE /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 204 len: 0 microversion: 2.1 time: 0.294811 Jul 12 11:58:48.988956 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1195/2221] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:58:48 2022] DELETE /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:58:48.996419 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-38a3cd89-1c59-45d3-9e87-1c241ba17fbc tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:48.997749 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-38a3cd89-1c59-45d3-9e87-1c241ba17fbc tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:49.008105 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-38a3cd89-1c59-45d3-9e87-1c241ba17fbc tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:49.009489 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-38a3cd89-1c59-45d3-9e87-1c241ba17fbc tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:49.011127 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-38a3cd89-1c59-45d3-9e87-1c241ba17fbc tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:49.012510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-38a3cd89-1c59-45d3-9e87-1c241ba17fbc tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:49.310903 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-38a3cd89-1c59-45d3-9e87-1c241ba17fbc tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "POST /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8/action" status: 202 len: 0 microversion: 2.1 time: 0.301392 Jul 12 11:58:49.313894 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1196/2222] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 11:58:48 2022] POST /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:58:49.343871 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1d42f4a0-d4e9-49e9-99ef-ad9dac237d3f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:49.345360 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1d42f4a0-d4e9-49e9-99ef-ad9dac237d3f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:49.382807 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1d42f4a0-d4e9-49e9-99ef-ad9dac237d3f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:49.396781 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1d42f4a0-d4e9-49e9-99ef-ad9dac237d3f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:49.398073 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1d42f4a0-d4e9-49e9-99ef-ad9dac237d3f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:49.398711 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1d42f4a0-d4e9-49e9-99ef-ad9dac237d3f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:49.520999 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-afcbbdc7-d727-4d9c-bdea-6168504843bf tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/5543b0b9-0925-46ce-9bbd-f68341b466b3" status: 202 len: 0 microversion: 2.1 time: 0.880810 Jul 12 11:58:49.521617 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1027/2223] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:58:48 2022] DELETE /compute/v2.1/os-security-groups/5543b0b9-0925-46ce-9bbd-f68341b466b3 => generated 0 bytes in 882 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:58:49.528023 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-77f6ab9e-933b-40aa-80f9-63fe91ed2180 req-b1ae15bc-6ff4-4dc6-99d9-1d58f3acf065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "tag": "6e06bf3e-6215-4546-a454-04123539ab53"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:49.562840 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-77f6ab9e-933b-40aa-80f9-63fe91ed2180 req-b1ae15bc-6ff4-4dc6-99d9-1d58f3acf065 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:49.563927 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-77f6ab9e-933b-40aa-80f9-63fe91ed2180 req-b1ae15bc-6ff4-4dc6-99d9-1d58f3acf065 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:49.576397 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-77f6ab9e-933b-40aa-80f9-63fe91ed2180 req-b1ae15bc-6ff4-4dc6-99d9-1d58f3acf065 service nova] Creating event network-changed:6e06bf3e-6215-4546-a454-04123539ab53 for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 11:58:49.584152 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-77f6ab9e-933b-40aa-80f9-63fe91ed2180 req-b1ae15bc-6ff4-4dc6-99d9-1d58f3acf065 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060576 Jul 12 11:58:49.585450 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1028/2224] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:49.597079 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b4af6549-af17-430c-85a1-2e208ed6fcd0 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:49.598073 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b4af6549-af17-430c-85a1-2e208ed6fcd0 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:49.605669 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b4af6549-af17-430c-85a1-2e208ed6fcd0 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:49.606437 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b4af6549-af17-430c-85a1-2e208ed6fcd0 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:49.607417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b4af6549-af17-430c-85a1-2e208ed6fcd0 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:49.608087 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b4af6549-af17-430c-85a1-2e208ed6fcd0 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:49.870859 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1d42f4a0-d4e9-49e9-99ef-ad9dac237d3f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:49.890990 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1d42f4a0-d4e9-49e9-99ef-ad9dac237d3f tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1468 microversion: 2.1 time: 0.571296 Jul 12 11:58:49.923795 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1197/2225] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:49 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1468 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:49.923795 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-62056dd2-b91b-4d35-bd3f-73b14d1daa41 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Calling method '.version_select at 0x7f5e099cdee0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:50.182541 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b4af6549-af17-430c-85a1-2e208ed6fcd0 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:50.213355 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b4af6549-af17-430c-85a1-2e208ed6fcd0 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1508 microversion: 2.1 time: 0.626182 Jul 12 11:58:50.214906 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1029/2226] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:49 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1508 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:50.233706 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7268e809-cbd4-4eaf-91f1-bf88b78b8079 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:50.240202 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7268e809-cbd4-4eaf-91f1-bf88b78b8079 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:50.261000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7268e809-cbd4-4eaf-91f1-bf88b78b8079 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:50.261867 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7268e809-cbd4-4eaf-91f1-bf88b78b8079 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:50.263284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7268e809-cbd4-4eaf-91f1-bf88b78b8079 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:50.269380 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7268e809-cbd4-4eaf-91f1-bf88b78b8079 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:50.648103 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-62056dd2-b91b-4d35-bd3f-73b14d1daa41 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/b2d3a169-ac5b-4c72-b054-64ea8b0bc564" status: 202 len: 0 microversion: 2.1 time: 0.739455 Jul 12 11:58:50.650049 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1198/2227] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:58:49 2022] DELETE /compute/v2.1/os-security-groups/b2d3a169-ac5b-4c72-b054-64ea8b0bc564 => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:58:50.662227 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5d3db50a-a68b-4d76-87c1-06379516cbfa tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Calling method '.version_select at 0x7f5e09d2c280>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:50.935067 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7268e809-cbd4-4eaf-91f1-bf88b78b8079 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:51.003584 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7268e809-cbd4-4eaf-91f1-bf88b78b8079 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:51.014979 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7268e809-cbd4-4eaf-91f1-bf88b78b8079 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:51.026784 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7268e809-cbd4-4eaf-91f1-bf88b78b8079 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.802274 Jul 12 11:58:51.028983 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1030/2228] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:50 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:51.053808 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a4dc66c2-3a76-4674-b152-721a143cdb20 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:51.056905 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a4dc66c2-3a76-4674-b152-721a143cdb20 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:51.106967 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4dc66c2-3a76-4674-b152-721a143cdb20 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:51.108503 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4dc66c2-3a76-4674-b152-721a143cdb20 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:51.112154 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4dc66c2-3a76-4674-b152-721a143cdb20 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:51.125225 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a4dc66c2-3a76-4674-b152-721a143cdb20 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:51.600913 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5d3db50a-a68b-4d76-87c1-06379516cbfa tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/0e94529a-664e-460b-b153-8b61f86da233" status: 202 len: 0 microversion: 2.1 time: 0.944735 Jul 12 11:58:51.602569 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1199/2229] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:58:50 2022] DELETE /compute/v2.1/os-security-groups/0e94529a-664e-460b-b153-8b61f86da233 => generated 0 bytes in 949 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 11:58:51.608468 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5f549515-c369-4d36-b80a-25fcd1127af8 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:51.609361 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5f549515-c369-4d36-b80a-25fcd1127af8 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:51.633804 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f549515-c369-4d36-b80a-25fcd1127af8 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:51.634607 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f549515-c369-4d36-b80a-25fcd1127af8 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:51.636646 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f549515-c369-4d36-b80a-25fcd1127af8 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:51.637737 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f549515-c369-4d36-b80a-25fcd1127af8 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:52.042085 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a4dc66c2-3a76-4674-b152-721a143cdb20 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:52.061078 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a4dc66c2-3a76-4674-b152-721a143cdb20 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1468 microversion: 2.1 time: 1.030105 Jul 12 11:58:52.079101 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1031/2230] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:51 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1468 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:52.093902 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-461dfb87-336e-4123-bc93-2674c1d90d37 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Calling method '.version_select at 0x7f5e09f60310>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:52.135720 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5f549515-c369-4d36-b80a-25fcd1127af8 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:52.157880 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5f549515-c369-4d36-b80a-25fcd1127af8 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1508 microversion: 2.1 time: 0.552685 Jul 12 11:58:52.172756 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1200/2231] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:51 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1508 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:52.188329 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-428e096a-4293-4bec-81b1-09f98e2f09af req-c0c75b73-5db3-4129-be3b-2ded103a9676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "tag": "7735c15f-29a4-4440-9e1b-3a9b16dafddb"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:52.199751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-428e096a-4293-4bec-81b1-09f98e2f09af req-c0c75b73-5db3-4129-be3b-2ded103a9676 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:52.200488 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-428e096a-4293-4bec-81b1-09f98e2f09af req-c0c75b73-5db3-4129-be3b-2ded103a9676 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:52.222225 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-428e096a-4293-4bec-81b1-09f98e2f09af req-c0c75b73-5db3-4129-be3b-2ded103a9676 service nova] Creating event network-changed:7735c15f-29a4-4440-9e1b-3a9b16dafddb for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 11:58:52.229293 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-428e096a-4293-4bec-81b1-09f98e2f09af req-c0c75b73-5db3-4129-be3b-2ded103a9676 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054790 Jul 12 11:58:52.230666 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1201/2232] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:52.238140 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-31d8c801-c599-4667-90ef-12132edc0654 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:52.239210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-31d8c801-c599-4667-90ef-12132edc0654 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:52.246287 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31d8c801-c599-4667-90ef-12132edc0654 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:52.247238 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31d8c801-c599-4667-90ef-12132edc0654 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:52.248225 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31d8c801-c599-4667-90ef-12132edc0654 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:52.248820 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31d8c801-c599-4667-90ef-12132edc0654 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:52.745529 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-31d8c801-c599-4667-90ef-12132edc0654 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:52.765408 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-31d8c801-c599-4667-90ef-12132edc0654 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:52.767081 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-31d8c801-c599-4667-90ef-12132edc0654 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:52.768379 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-31d8c801-c599-4667-90ef-12132edc0654 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.535706 Jul 12 11:58:52.770267 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1202/2233] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:52 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:53.097158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-19405542-7bf8-4393-805e-0c0f0d077c6a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:53.099486 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-19405542-7bf8-4393-805e-0c0f0d077c6a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:53.121960 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-19405542-7bf8-4393-805e-0c0f0d077c6a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:53.124857 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-19405542-7bf8-4393-805e-0c0f0d077c6a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:53.126297 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-19405542-7bf8-4393-805e-0c0f0d077c6a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:53.129609 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-19405542-7bf8-4393-805e-0c0f0d077c6a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:53.539609 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-461dfb87-336e-4123-bc93-2674c1d90d37 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/f4655c4f-0780-47eb-aac5-74e0ba8739b2" status: 202 len: 0 microversion: 2.1 time: 1.458390 Jul 12 11:58:53.544290 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1032/2234] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:58:52 2022] DELETE /compute/v2.1/os-security-groups/f4655c4f-0780-47eb-aac5-74e0ba8739b2 => generated 0 bytes in 1464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:58:53.551181 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-424277af-2920-4462-ac7e-2d62d50a1e23 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:53.555023 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-424277af-2920-4462-ac7e-2d62d50a1e23 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:53.569863 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-424277af-2920-4462-ac7e-2d62d50a1e23 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:53.571122 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-424277af-2920-4462-ac7e-2d62d50a1e23 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:53.572889 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-424277af-2920-4462-ac7e-2d62d50a1e23 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:53.574155 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-424277af-2920-4462-ac7e-2d62d50a1e23 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:53.576317 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-19405542-7bf8-4393-805e-0c0f0d077c6a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:53.593798 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-19405542-7bf8-4393-805e-0c0f0d077c6a tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1468 microversion: 2.1 time: 0.503858 Jul 12 11:58:53.594719 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1203/2235] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:53 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1468 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:53.620361 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b881a6fe-a4b3-491d-a194-d3bfd26cce81 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:53.623257 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b881a6fe-a4b3-491d-a194-d3bfd26cce81 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:53.633289 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b881a6fe-a4b3-491d-a194-d3bfd26cce81 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:53.637895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b881a6fe-a4b3-491d-a194-d3bfd26cce81 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:53.642905 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b881a6fe-a4b3-491d-a194-d3bfd26cce81 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:53.643664 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b881a6fe-a4b3-491d-a194-d3bfd26cce81 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:53.669404 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-b881a6fe-a4b3-491d-a194-d3bfd26cce81 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b881a6fe-a4b3-491d-a194-d3bfd26cce81 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 HTTP/1.1 Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '6be284e8-364a-45aa-97d4-944bfb60fc64'} Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:53.683689 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:53.691541 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:58:53.691541 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:53.691541 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:53.691541 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:53.691541 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:53.691541 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:53.691541 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:53.691541 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:53.691541 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:53.691541 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:58:53.691541 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:53.691541 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b881a6fe-a4b3-491d-a194-d3bfd26cce81 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:53.691541 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b881a6fe-a4b3-491d-a194-d3bfd26cce81 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 404 len: 111 microversion: 2.1 time: 0.070534 Jul 12 11:58:53.691541 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1204/2236] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:58:53 2022] DELETE /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:53.692602 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9a738c8c-1354-4b09-a677-290d201a5902 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] Calling method '.version_select at 0x7f5e09ae2790>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:54.358929 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9a738c8c-1354-4b09-a677-290d201a5902 tempest-SecurityGroupRulesNegativeTestJSON-910397708 tempest-SecurityGroupRulesNegativeTestJSON-910397708-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/452ff220-9866-4513-ad88-6f80cc927be5" status: 202 len: 0 microversion: 2.1 time: 0.670740 Jul 12 11:58:54.362231 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1205/2237] 10.222.0.50 () {58 vars in 1271 bytes} [Tue Jul 12 11:58:53 2022] DELETE /compute/v2.1/os-security-groups/452ff220-9866-4513-ad88-6f80cc927be5 => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 11:58:54.368994 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-518d85fa-a3b7-437c-a4e1-8ef7b3419145 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:54.371482 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-518d85fa-a3b7-437c-a4e1-8ef7b3419145 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 6be284e8-364a-45aa-97d4-944bfb60fc64] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:54.391760 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-518d85fa-a3b7-437c-a4e1-8ef7b3419145 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:54.392635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-518d85fa-a3b7-437c-a4e1-8ef7b3419145 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:54.393875 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-518d85fa-a3b7-437c-a4e1-8ef7b3419145 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:54.394666 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-518d85fa-a3b7-437c-a4e1-8ef7b3419145 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:54.424787 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-424277af-2920-4462-ac7e-2d62d50a1e23 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:54.438776 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-424277af-2920-4462-ac7e-2d62d50a1e23 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1506 microversion: 2.1 time: 0.890804 Jul 12 11:58:54.442079 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1033/2238] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:53 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1506 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:54.447398 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a21fb2e2-9109-4a68-b48c-951b02a70f1e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:54.450544 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a21fb2e2-9109-4a68-b48c-951b02a70f1e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:54.451805 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-518d85fa-a3b7-437c-a4e1-8ef7b3419145 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-518d85fa-a3b7-437c-a4e1-8ef7b3419145 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 HTTP/1.1 Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '6be284e8-364a-45aa-97d4-944bfb60fc64'} Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:54.454159 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:54.457572 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:54.457572 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:54.457572 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:54.457572 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:54.457572 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:54.457572 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. Jul 12 11:58:54.457572 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:54.461686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-518d85fa-a3b7-437c-a4e1-8ef7b3419145 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 6be284e8-364a-45aa-97d4-944bfb60fc64 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:54.463056 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-518d85fa-a3b7-437c-a4e1-8ef7b3419145 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64" status: 404 len: 111 microversion: 2.1 time: 0.099608 Jul 12 11:58:54.467934 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1206/2239] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:54 2022] GET /compute/v2.1/servers/6be284e8-364a-45aa-97d4-944bfb60fc64 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:54.481803 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ebe684f0-e107-498a-946b-540fc5c3fd80 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '.version_select at 0x7f5e0a6fdd30>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:54.483068 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a21fb2e2-9109-4a68-b48c-951b02a70f1e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:54.487882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a21fb2e2-9109-4a68-b48c-951b02a70f1e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:54.489539 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a21fb2e2-9109-4a68-b48c-951b02a70f1e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:54.490008 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a21fb2e2-9109-4a68-b48c-951b02a70f1e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:54.491106 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ebe684f0-e107-498a-946b-540fc5c3fd80 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:54.513448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ebe684f0-e107-498a-946b-540fc5c3fd80 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:54.513918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ebe684f0-e107-498a-946b-540fc5c3fd80 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:54.514742 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ebe684f0-e107-498a-946b-540fc5c3fd80 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:54.515771 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ebe684f0-e107-498a-946b-540fc5c3fd80 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:54.662588 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ebe684f0-e107-498a-946b-540fc5c3fd80 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.191122 Jul 12 11:58:54.663714 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1207/2240] 10.222.0.50 () {58 vars in 1295 bytes} [Tue Jul 12 11:58:54 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8/os-instance-actions => generated 611 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:54.671796 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-70d57fdf-1642-43eb-b387-e925e65d06aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:54.673236 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-70d57fdf-1642-43eb-b387-e925e65d06aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:54.691311 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-70d57fdf-1642-43eb-b387-e925e65d06aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:54.692644 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-70d57fdf-1642-43eb-b387-e925e65d06aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:54.694334 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-70d57fdf-1642-43eb-b387-e925e65d06aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:54.695055 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-70d57fdf-1642-43eb-b387-e925e65d06aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:54.746283 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-70d57fdf-1642-43eb-b387-e925e65d06aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-70d57fdf-1642-43eb-b387-e925e65d06aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e HTTP/1.1 Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '07a2e514-796f-4ddf-87f3-72e6ca31659e'} Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:54.747974 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:54.756556 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:58:54.756556 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:54.756556 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:54.756556 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:54.756556 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:54.756556 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:54.756556 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:54.756556 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:54.756556 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:54.756556 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:58:54.756556 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:54.756556 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-70d57fdf-1642-43eb-b387-e925e65d06aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:54.762861 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-70d57fdf-1642-43eb-b387-e925e65d06aa tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 404 len: 111 microversion: 2.1 time: 0.097210 Jul 12 11:58:54.763854 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1208/2241] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:58:54 2022] DELETE /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:54.775465 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5e2b0029-9cd6-4085-bd97-cbf9a510e348 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:54.776398 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5e2b0029-9cd6-4085-bd97-cbf9a510e348 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:54.817564 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5e2b0029-9cd6-4085-bd97-cbf9a510e348 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:54.820799 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5e2b0029-9cd6-4085-bd97-cbf9a510e348 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:54.832006 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5e2b0029-9cd6-4085-bd97-cbf9a510e348 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:54.836315 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5e2b0029-9cd6-4085-bd97-cbf9a510e348 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:54.879337 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:55.186539 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a21fb2e2-9109-4a68-b48c-951b02a70f1e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:55.189678 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5e2b0029-9cd6-4085-bd97-cbf9a510e348 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:55.213626 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5e2b0029-9cd6-4085-bd97-cbf9a510e348 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1297 microversion: 2.1 time: 0.445990 Jul 12 11:58:55.215145 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1209/2242] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:54 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1297 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:55.218773 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a21fb2e2-9109-4a68-b48c-951b02a70f1e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:55.223010 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a21fb2e2-9109-4a68-b48c-951b02a70f1e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:55.223285 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-937e22f4-4ac5-4fbc-8112-702d691c3b26 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:55.223874 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-937e22f4-4ac5-4fbc-8112-702d691c3b26 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:55.228864 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a21fb2e2-9109-4a68-b48c-951b02a70f1e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.782663 Jul 12 11:58:55.232273 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1034/2243] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:54 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:55.246191 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e609c2a1-4479-4fd2-b340-8e350aac5ab5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:55.250162 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e609c2a1-4479-4fd2-b340-8e350aac5ab5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] [instance: 07a2e514-796f-4ddf-87f3-72e6ca31659e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:55.255816 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-937e22f4-4ac5-4fbc-8112-702d691c3b26 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:55.256949 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-937e22f4-4ac5-4fbc-8112-702d691c3b26 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:55.258787 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-937e22f4-4ac5-4fbc-8112-702d691c3b26 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:55.259533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-937e22f4-4ac5-4fbc-8112-702d691c3b26 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:55.291884 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e609c2a1-4479-4fd2-b340-8e350aac5ab5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:55.295603 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e609c2a1-4479-4fd2-b340-8e350aac5ab5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:55.297282 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e609c2a1-4479-4fd2-b340-8e350aac5ab5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:55.297770 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e609c2a1-4479-4fd2-b340-8e350aac5ab5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:55.306310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-937e22f4-4ac5-4fbc-8112-702d691c3b26 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:58:55.329817 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-e609c2a1-4479-4fd2-b340-8e350aac5ab5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] HTTP exception thrown: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e609c2a1-4479-4fd2-b340-8e350aac5ab5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Request method failure captured: Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e HTTP/1.1 Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWCiQaTwfO4srgM8zOc4unzxMBccZ6mgUCRYLqTSlEB5yX46SmAfqx_mCcpUlX9vlVT-k2SVJH7Rr2_1iwLmonJBfuk5NbPNFxmGpv8Rszu-9VIdgEfw1mxhm4g2_YGJCI4weBURAI-pmDq9cMpplAHs3tE1voJia89zsNIeLJfd4PQ Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acea80b1e154ffcb3e657056d6e8dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acea80b1e154ffcb3e657056d6e8dbc", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 6acea80b1e154ffcb3e657056d6e8dbc Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-DeleteServersTestJSON-1974007589 Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 4c93078ac6044bf6b62ca073b3850016 Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-DeleteServersTestJSON-1974007589-project Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '07a2e514-796f-4ddf-87f3-72e6ca31659e'} Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:55.331824 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:55.335968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:55.335968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:55.335968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:55.335968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:55.335968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:55.335968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. Jul 12 11:58:55.335968 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 11:58:55.338242 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e609c2a1-4479-4fd2-b340-8e350aac5ab5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] Returning 404 to user: Instance 07a2e514-796f-4ddf-87f3-72e6ca31659e could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:55.339553 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e609c2a1-4479-4fd2-b340-8e350aac5ab5 tempest-DeleteServersTestJSON-1974007589 tempest-DeleteServersTestJSON-1974007589-project] 10.222.0.50 "GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e" status: 404 len: 111 microversion: 2.1 time: 0.105387 Jul 12 11:58:55.344434 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1035/2244] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:55 2022] GET /compute/v2.1/servers/07a2e514-796f-4ddf-87f3-72e6ca31659e => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:55.356770 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-cc07f6f0-9dbb-419c-98c9-7fa54b83ab34 req-4bb10b5c-60bb-4f6c-bb66-f8fe4f3523ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51829843-3012-41d2-a4a3-9683082906c5", "name": "network-vif-deleted", "tag": "07f520e5-b458-40e0-8e7d-abfe15229eb1"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:55.369743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-cc07f6f0-9dbb-419c-98c9-7fa54b83ab34 req-4bb10b5c-60bb-4f6c-bb66-f8fe4f3523ac service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:55.370455 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-cc07f6f0-9dbb-419c-98c9-7fa54b83ab34 req-4bb10b5c-60bb-4f6c-bb66-f8fe4f3523ac service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:55.397494 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-cc07f6f0-9dbb-419c-98c9-7fa54b83ab34 req-4bb10b5c-60bb-4f6c-bb66-f8fe4f3523ac service nova] Creating event network-vif-deleted:07f520e5-b458-40e0-8e7d-abfe15229eb1 for instance 51829843-3012-41d2-a4a3-9683082906c5 on n-h2-849104-4 Jul 12 11:58:55.411892 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-cc07f6f0-9dbb-419c-98c9-7fa54b83ab34 req-4bb10b5c-60bb-4f6c-bb66-f8fe4f3523ac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059005 Jul 12 11:58:55.416504 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1036/2245] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:55.502065 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-937e22f4-4ac5-4fbc-8112-702d691c3b26 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 204 len: 0 microversion: 2.1 time: 0.282504 Jul 12 11:58:55.505836 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1210/2246] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:58:55 2022] DELETE /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:58:55.517333 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-68c63cfb-a511-48cf-a09d-08cafd330d4f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:55.519964 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-68c63cfb-a511-48cf-a09d-08cafd330d4f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:55.541137 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-68c63cfb-a511-48cf-a09d-08cafd330d4f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:55.541689 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-68c63cfb-a511-48cf-a09d-08cafd330d4f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:55.542419 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-68c63cfb-a511-48cf-a09d-08cafd330d4f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:55.542865 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-68c63cfb-a511-48cf-a09d-08cafd330d4f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:56.195068 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-68c63cfb-a511-48cf-a09d-08cafd330d4f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:56.211122 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-68c63cfb-a511-48cf-a09d-08cafd330d4f tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1512 microversion: 2.1 time: 0.701025 Jul 12 11:58:56.213119 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1037/2247] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:55 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1512 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:56.237182 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-28e0d333-820c-4fbb-9db0-7c93aff9b49c tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:56.238966 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-28e0d333-820c-4fbb-9db0-7c93aff9b49c tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:56.250740 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-28e0d333-820c-4fbb-9db0-7c93aff9b49c tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:56.251210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-28e0d333-820c-4fbb-9db0-7c93aff9b49c tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:56.252068 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-28e0d333-820c-4fbb-9db0-7c93aff9b49c tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:56.252982 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-28e0d333-820c-4fbb-9db0-7c93aff9b49c tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:56.265770 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3553cab3-8572-4a14-b824-0764a02cb560 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:56.279195 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3553cab3-8572-4a14-b824-0764a02cb560 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:56.298548 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3553cab3-8572-4a14-b824-0764a02cb560 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:56.299727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3553cab3-8572-4a14-b824-0764a02cb560 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:56.301719 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3553cab3-8572-4a14-b824-0764a02cb560 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:56.302986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3553cab3-8572-4a14-b824-0764a02cb560 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:56.321764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-28e0d333-820c-4fbb-9db0-7c93aff9b49c tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:56.322237 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-28e0d333-820c-4fbb-9db0-7c93aff9b49c tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:56.322720 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-28e0d333-820c-4fbb-9db0-7c93aff9b49c tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lazy-loading 'fault' on Instance uuid 51829843-3012-41d2-a4a3-9683082906c5 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:58:56.417718 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-28e0d333-820c-4fbb-9db0-7c93aff9b49c tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:56.436348 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-28e0d333-820c-4fbb-9db0-7c93aff9b49c tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1311 microversion: 2.1 time: 0.207437 Jul 12 11:58:56.455743 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1211/2248] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:56 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1311 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:56.897525 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3553cab3-8572-4a14-b824-0764a02cb560 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:56.923233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3553cab3-8572-4a14-b824-0764a02cb560 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:56.925810 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3553cab3-8572-4a14-b824-0764a02cb560 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:56.928375 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3553cab3-8572-4a14-b824-0764a02cb560 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.669559 Jul 12 11:58:56.930614 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1038/2249] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:56 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:57.238513 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ea0fe01c-429b-4b89-9c3e-69f613c01d9b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:57.239744 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ea0fe01c-429b-4b89-9c3e-69f613c01d9b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:57.247086 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ea0fe01c-429b-4b89-9c3e-69f613c01d9b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:57.247720 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ea0fe01c-429b-4b89-9c3e-69f613c01d9b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:57.248540 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ea0fe01c-429b-4b89-9c3e-69f613c01d9b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:57.249132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ea0fe01c-429b-4b89-9c3e-69f613c01d9b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:57.461665 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1f265a1e-03e4-49f3-bef1-7aec392c8914 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:57.464379 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1f265a1e-03e4-49f3-bef1-7aec392c8914 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:57.478279 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f265a1e-03e4-49f3-bef1-7aec392c8914 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:57.479345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f265a1e-03e4-49f3-bef1-7aec392c8914 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:57.480663 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f265a1e-03e4-49f3-bef1-7aec392c8914 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:57.481664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f265a1e-03e4-49f3-bef1-7aec392c8914 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:57.560467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f265a1e-03e4-49f3-bef1-7aec392c8914 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:57.561480 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f265a1e-03e4-49f3-bef1-7aec392c8914 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:57.562509 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-1f265a1e-03e4-49f3-bef1-7aec392c8914 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lazy-loading 'fault' on Instance uuid 51829843-3012-41d2-a4a3-9683082906c5 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:58:57.736588 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ea0fe01c-429b-4b89-9c3e-69f613c01d9b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:57.761415 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ea0fe01c-429b-4b89-9c3e-69f613c01d9b tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1512 microversion: 2.1 time: 0.526846 Jul 12 11:58:57.784664 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1212/2250] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:57 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1512 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:58:57.798357 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1f265a1e-03e4-49f3-bef1-7aec392c8914 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:57.813821 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1f265a1e-03e4-49f3-bef1-7aec392c8914 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 200 len: 1311 microversion: 2.1 time: 0.354753 Jul 12 11:58:57.815648 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1039/2251] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:57 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 1311 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:57.833466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-655e16ba-28c1-411d-9163-4b877d1c1f07 req-a25b7e34-42f4-4c01-b7c9-ef13c5237be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "tag": "4b024111-c5ba-43ca-a440-579a6738d07e"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:58:57.856449 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-655e16ba-28c1-411d-9163-4b877d1c1f07 req-a25b7e34-42f4-4c01-b7c9-ef13c5237be4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:57.857233 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-655e16ba-28c1-411d-9163-4b877d1c1f07 req-a25b7e34-42f4-4c01-b7c9-ef13c5237be4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:57.881797 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-655e16ba-28c1-411d-9163-4b877d1c1f07 req-a25b7e34-42f4-4c01-b7c9-ef13c5237be4 service nova] Creating event network-changed:4b024111-c5ba-43ca-a440-579a6738d07e for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 11:58:57.890626 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-655e16ba-28c1-411d-9163-4b877d1c1f07 req-a25b7e34-42f4-4c01-b7c9-ef13c5237be4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104283 Jul 12 11:58:57.892456 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1213/2252] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:58:57.962215 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8c102f9d-cabf-49d0-86c4-8eac655083ce tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:57.964770 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8c102f9d-cabf-49d0-86c4-8eac655083ce tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:57.973177 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c102f9d-cabf-49d0-86c4-8eac655083ce tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:57.974125 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c102f9d-cabf-49d0-86c4-8eac655083ce tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:57.975747 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c102f9d-cabf-49d0-86c4-8eac655083ce tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:57.976670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c102f9d-cabf-49d0-86c4-8eac655083ce tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:57.986111 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:58:58.791594 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8b2eee35-e140-4153-8d01-a3e931ed8c1e tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:58.793048 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8b2eee35-e140-4153-8d01-a3e931ed8c1e tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:58.805478 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b2eee35-e140-4153-8d01-a3e931ed8c1e tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:58.806592 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b2eee35-e140-4153-8d01-a3e931ed8c1e tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:58.808293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b2eee35-e140-4153-8d01-a3e931ed8c1e tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:58.809264 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b2eee35-e140-4153-8d01-a3e931ed8c1e tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:59.160128 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8b2eee35-e140-4153-8d01-a3e931ed8c1e tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:59.172366 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8b2eee35-e140-4153-8d01-a3e931ed8c1e tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1512 microversion: 2.1 time: 0.385499 Jul 12 11:58:59.172366 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1214/2253] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:58 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:58:59.179075 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3dabe2ff-bbb6-4041-88e8-be28886dd894 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:59.179694 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3dabe2ff-bbb6-4041-88e8-be28886dd894 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 51829843-3012-41d2-a4a3-9683082906c5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:59.194540 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3dabe2ff-bbb6-4041-88e8-be28886dd894 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:59.195004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3dabe2ff-bbb6-4041-88e8-be28886dd894 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:59.195810 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3dabe2ff-bbb6-4041-88e8-be28886dd894 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:59.196369 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3dabe2ff-bbb6-4041-88e8-be28886dd894 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:59.229065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8c102f9d-cabf-49d0-86c4-8eac655083ce tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:59.229962 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-3dabe2ff-bbb6-4041-88e8-be28886dd894 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] HTTP exception thrown: Instance 51829843-3012-41d2-a4a3-9683082906c5 could not be found. Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3dabe2ff-bbb6-4041-88e8-be28886dd894 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Request method failure captured: Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 HTTP/1.1 Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWG4Ej07fsIYT0xzd6cSE66Hw7Lvc6Xdv9BJ2lX9UwDjKZVPzJCPZM0beX8pr_2qaFkPYPTrjZE7iwAe-YYkGOCIVA-mD0ZGcr0HLylf5ODuD8FJ9UlN9y2LIwbDE_gEEc_5SyolWdgWpxgCImDHucn2VS1oHfiNBW7rhBTAsCFkmek Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 9846c91b05b54476a049745bed4d5528 Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1417667033 Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9846c91b05b54476a049745bed4d5528"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9846c91b05b54476a049745bed4d5528"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9846c91b05b54476a049745bed4d5528"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9846c91b05b54476a049745bed4d5528", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1417667033 Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 9846c91b05b54476a049745bed4d5528 Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1417667033 Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersAdminNegativeTestJSON-1417667033-project Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: bfe83c08467e4c5a9809b6f92e159761 Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1417667033-project Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 51829843-3012-41d2-a4a3-9683082906c5 could not be found. Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '51829843-3012-41d2-a4a3-9683082906c5'} Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51829843-3012-41d2-a4a3-9683082906c5 could not be found. Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51829843-3012-41d2-a4a3-9683082906c5 could not be found. Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:59.232881 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:58:59.236619 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:59.236619 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:58:59.236619 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:58:59.236619 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:58:59.236619 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:58:59.236619 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:58:59.236619 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51829843-3012-41d2-a4a3-9683082906c5 could not be found. Jul 12 11:58:59.236619 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:58:59.238355 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3dabe2ff-bbb6-4041-88e8-be28886dd894 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Returning 404 to user: Instance 51829843-3012-41d2-a4a3-9683082906c5 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:58:59.239725 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3dabe2ff-bbb6-4041-88e8-be28886dd894 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5" status: 404 len: 111 microversion: 2.1 time: 0.066362 Jul 12 11:58:59.241010 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1215/2254] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:59 2022] GET /compute/v2.1/servers/51829843-3012-41d2-a4a3-9683082906c5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:58:59.252337 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d72d2986-3f2a-4c4c-8969-31c402c70c98 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:59.253211 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d72d2986-3f2a-4c4c-8969-31c402c70c98 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:59.260264 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d72d2986-3f2a-4c4c-8969-31c402c70c98 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:59.261118 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d72d2986-3f2a-4c4c-8969-31c402c70c98 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:59.262544 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d72d2986-3f2a-4c4c-8969-31c402c70c98 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:59.262976 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8c102f9d-cabf-49d0-86c4-8eac655083ce tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:59.263781 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d72d2986-3f2a-4c4c-8969-31c402c70c98 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:59.264623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8c102f9d-cabf-49d0-86c4-8eac655083ce tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:58:59.266396 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8c102f9d-cabf-49d0-86c4-8eac655083ce tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.314111 Jul 12 11:58:59.281877 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1040/2255] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:58:57 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:58:59.309405 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d72d2986-3f2a-4c4c-8969-31c402c70c98 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 11:58:59.521981 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d72d2986-3f2a-4c4c-8969-31c402c70c98 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 204 len: 0 microversion: 2.1 time: 0.272488 Jul 12 11:58:59.526497 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1216/2256] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 11:58:59 2022] DELETE /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 11:58:59.539417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-63567e31-b3df-40d4-a0c0-51e0621ce39d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:58:59.540428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-63567e31-b3df-40d4-a0c0-51e0621ce39d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:58:59.567102 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-63567e31-b3df-40d4-a0c0-51e0621ce39d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:59.570020 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-63567e31-b3df-40d4-a0c0-51e0621ce39d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:58:59.570986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-63567e31-b3df-40d4-a0c0-51e0621ce39d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:58:59.571449 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-63567e31-b3df-40d4-a0c0-51e0621ce39d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:00.173361 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-63567e31-b3df-40d4-a0c0-51e0621ce39d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:00.195216 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-63567e31-b3df-40d4-a0c0-51e0621ce39d tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 200 len: 1478 microversion: 2.1 time: 0.665297 Jul 12 11:59:00.196479 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1041/2257] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:58:59 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 1478 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:59:00.211237 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8a0eed75-2262-40a9-9024-b50b70075b3d tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:00.212519 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8a0eed75-2262-40a9-9024-b50b70075b3d tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:00.220263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a0eed75-2262-40a9-9024-b50b70075b3d tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:00.221009 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a0eed75-2262-40a9-9024-b50b70075b3d tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:00.221984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a0eed75-2262-40a9-9024-b50b70075b3d tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:00.222598 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a0eed75-2262-40a9-9024-b50b70075b3d tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:00.298020 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5e62f528-276d-4503-9b0f-0eddbd809edd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:00.299365 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5e62f528-276d-4503-9b0f-0eddbd809edd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:00.306335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5e62f528-276d-4503-9b0f-0eddbd809edd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:00.307160 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5e62f528-276d-4503-9b0f-0eddbd809edd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:00.308192 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5e62f528-276d-4503-9b0f-0eddbd809edd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:00.308861 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5e62f528-276d-4503-9b0f-0eddbd809edd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:00.634434 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8a0eed75-2262-40a9-9024-b50b70075b3d tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:00.645942 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8a0eed75-2262-40a9-9024-b50b70075b3d tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1512 microversion: 2.1 time: 0.451888 Jul 12 11:59:00.647795 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1217/2258] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:00 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1512 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:01.006794 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5e62f528-276d-4503-9b0f-0eddbd809edd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:01.055054 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5e62f528-276d-4503-9b0f-0eddbd809edd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:01.061006 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5e62f528-276d-4503-9b0f-0eddbd809edd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:01.064154 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5e62f528-276d-4503-9b0f-0eddbd809edd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.772527 Jul 12 11:59:01.066540 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1042/2259] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:00 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:59:01.214291 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e68824e7-c88a-4816-b36b-dae0b640aef9 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:01.214876 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e68824e7-c88a-4816-b36b-dae0b640aef9 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:01.238324 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e68824e7-c88a-4816-b36b-dae0b640aef9 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:01.257213 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-7e08d165-7c75-471e-8eea-c076c5f4f056 req-7f2a3ea6-6930-4480-8868-aac35810fa93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8209bb-e907-4347-92b9-16eee803b3f8", "name": "network-vif-deleted", "tag": "d357fc65-71f4-4d90-ad38-7a1f4df8686b"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:01.257783 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e68824e7-c88a-4816-b36b-dae0b640aef9 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:01.259540 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e68824e7-c88a-4816-b36b-dae0b640aef9 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:01.259997 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e68824e7-c88a-4816-b36b-dae0b640aef9 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:01.274749 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-7e08d165-7c75-471e-8eea-c076c5f4f056 req-7f2a3ea6-6930-4480-8868-aac35810fa93 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:01.275698 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-7e08d165-7c75-471e-8eea-c076c5f4f056 req-7f2a3ea6-6930-4480-8868-aac35810fa93 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:01.301044 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-7e08d165-7c75-471e-8eea-c076c5f4f056 req-7f2a3ea6-6930-4480-8868-aac35810fa93 service nova] Creating event network-vif-deleted:d357fc65-71f4-4d90-ad38-7a1f4df8686b for instance 7c8209bb-e907-4347-92b9-16eee803b3f8 on n-h2-849104-4 Jul 12 11:59:01.308498 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-7e08d165-7c75-471e-8eea-c076c5f4f056 req-7f2a3ea6-6930-4480-8868-aac35810fa93 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061898 Jul 12 11:59:01.309716 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1043/2260] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:59:01.676555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ae1a64bd-7a30-48a6-b063-c599b6cc2563 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:01.677449 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ae1a64bd-7a30-48a6-b063-c599b6cc2563 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:01.694449 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae1a64bd-7a30-48a6-b063-c599b6cc2563 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:01.695532 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae1a64bd-7a30-48a6-b063-c599b6cc2563 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:01.696809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae1a64bd-7a30-48a6-b063-c599b6cc2563 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:01.698032 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae1a64bd-7a30-48a6-b063-c599b6cc2563 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:01.812602 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae1a64bd-7a30-48a6-b063-c599b6cc2563 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:01.813532 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae1a64bd-7a30-48a6-b063-c599b6cc2563 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:01.815002 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-ae1a64bd-7a30-48a6-b063-c599b6cc2563 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lazy-loading 'fault' on Instance uuid 7c8209bb-e907-4347-92b9-16eee803b3f8 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:59:01.822862 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e68824e7-c88a-4816-b36b-dae0b640aef9 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:01.889639 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e68824e7-c88a-4816-b36b-dae0b640aef9 tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 200 len: 1478 microversion: 2.1 time: 0.679655 Jul 12 11:59:01.897626 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1218/2261] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:01 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 1478 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:02.086559 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-004453bf-17de-44f3-9324-36ef576034bf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:02.087390 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-004453bf-17de-44f3-9324-36ef576034bf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:02.098600 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-004453bf-17de-44f3-9324-36ef576034bf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:02.099354 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-004453bf-17de-44f3-9324-36ef576034bf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:02.100450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-004453bf-17de-44f3-9324-36ef576034bf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:02.100450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-004453bf-17de-44f3-9324-36ef576034bf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:02.523393 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-004453bf-17de-44f3-9324-36ef576034bf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:02.537501 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-004453bf-17de-44f3-9324-36ef576034bf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:02.539346 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-004453bf-17de-44f3-9324-36ef576034bf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:02.540873 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-004453bf-17de-44f3-9324-36ef576034bf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.460685 Jul 12 11:59:02.553557 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1219/2262] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:02 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:59:02.677775 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ae1a64bd-7a30-48a6-b063-c599b6cc2563 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db128472531d406a9a5feb0078abc074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42da3a89c71a427a86958fc632236509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:02.690601 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ae1a64bd-7a30-48a6-b063-c599b6cc2563 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 200 len: 1306 microversion: 2.1 time: 1.017344 Jul 12 11:59:02.693628 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1044/2263] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:01 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 1306 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:59:02.924312 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-84add0e9-2b70-4184-b081-0d953706b6dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:02.925732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-84add0e9-2b70-4184-b081-0d953706b6dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:02.936314 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84add0e9-2b70-4184-b081-0d953706b6dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:02.940502 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84add0e9-2b70-4184-b081-0d953706b6dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:02.952276 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84add0e9-2b70-4184-b081-0d953706b6dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:02.954064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84add0e9-2b70-4184-b081-0d953706b6dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:03.347377 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-84add0e9-2b70-4184-b081-0d953706b6dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:03.364162 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-84add0e9-2b70-4184-b081-0d953706b6dc tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 200 len: 1478 microversion: 2.1 time: 0.444957 Jul 12 11:59:03.365715 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1220/2264] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:02 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 1478 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:03.562822 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-58457a06-84c0-4f7f-bcab-db7d919d17bb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:03.563765 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-58457a06-84c0-4f7f-bcab-db7d919d17bb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:03.576675 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-58457a06-84c0-4f7f-bcab-db7d919d17bb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:03.577547 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-58457a06-84c0-4f7f-bcab-db7d919d17bb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:03.578938 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-58457a06-84c0-4f7f-bcab-db7d919d17bb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:03.580290 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-58457a06-84c0-4f7f-bcab-db7d919d17bb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:03.725448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5f6b19f6-4584-4215-8578-196d8ae7e229 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:03.727027 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5f6b19f6-4584-4215-8578-196d8ae7e229 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] [instance: 7c8209bb-e907-4347-92b9-16eee803b3f8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:03.736235 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f6b19f6-4584-4215-8578-196d8ae7e229 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:03.738342 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f6b19f6-4584-4215-8578-196d8ae7e229 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:03.740323 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f6b19f6-4584-4215-8578-196d8ae7e229 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:03.741010 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f6b19f6-4584-4215-8578-196d8ae7e229 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:03.763649 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-5f6b19f6-4584-4215-8578-196d8ae7e229 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] HTTP exception thrown: Instance 7c8209bb-e907-4347-92b9-16eee803b3f8 could not be found. Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5f6b19f6-4584-4215-8578-196d8ae7e229 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Request method failure captured: Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 HTTP/1.1 Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWHbqxGGGb3HgMfFYCPlMgFE9rI9CvWKsspacpcHC07LcfBShEvqI1rMJ61LmG1eSLTpGJSDFRapmGklIx4xiJuv-RrnIojAE0t6xbbcJ-dIwP8hVB5tV1YsBfov_ZjS_H4tWb7ipYGBtuHH7QgxrDOtUtat4WBUsrVwtFuZjD58A6M Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 42da3a89c71a427a86958fc632236509 Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-InstanceActionsTestJSON-1000921732 Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/42da3a89c71a427a86958fc632236509"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/42da3a89c71a427a86958fc632236509"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/42da3a89c71a427a86958fc632236509"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_42da3a89c71a427a86958fc632236509", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-InstanceActionsTestJSON-1000921732 Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 42da3a89c71a427a86958fc632236509 Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1000921732 Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-InstanceActionsTestJSON-1000921732-project Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: db128472531d406a9a5feb0078abc074 Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-InstanceActionsTestJSON-1000921732-project Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 7c8209bb-e907-4347-92b9-16eee803b3f8 could not be found. Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '7c8209bb-e907-4347-92b9-16eee803b3f8'} Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8209bb-e907-4347-92b9-16eee803b3f8 could not be found. Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8209bb-e907-4347-92b9-16eee803b3f8 could not be found. Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:59:03.765913 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:03.771876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:03.771876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:59:03.771876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:59:03.771876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:59:03.771876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:59:03.771876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8209bb-e907-4347-92b9-16eee803b3f8 could not be found. Jul 12 11:59:03.771876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:03.775339 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5f6b19f6-4584-4215-8578-196d8ae7e229 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] Returning 404 to user: Instance 7c8209bb-e907-4347-92b9-16eee803b3f8 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:59:03.776649 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5f6b19f6-4584-4215-8578-196d8ae7e229 tempest-InstanceActionsTestJSON-1000921732 tempest-InstanceActionsTestJSON-1000921732-project] 10.222.0.50 "GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8" status: 404 len: 111 microversion: 2.1 time: 0.055842 Jul 12 11:59:03.777816 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1221/2265] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:03 2022] GET /compute/v2.1/servers/7c8209bb-e907-4347-92b9-16eee803b3f8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:59:04.319948 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-58457a06-84c0-4f7f-bcab-db7d919d17bb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:04.332758 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-58457a06-84c0-4f7f-bcab-db7d919d17bb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:04.334302 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-58457a06-84c0-4f7f-bcab-db7d919d17bb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:04.335535 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-58457a06-84c0-4f7f-bcab-db7d919d17bb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.777578 Jul 12 11:59:04.342873 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1045/2266] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:03 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:04.384307 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dbc6b039-fe0f-4488-bf29-02493de5d77e tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:04.385327 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dbc6b039-fe0f-4488-bf29-02493de5d77e tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:04.400394 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbc6b039-fe0f-4488-bf29-02493de5d77e tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:04.400860 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbc6b039-fe0f-4488-bf29-02493de5d77e tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:04.401670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbc6b039-fe0f-4488-bf29-02493de5d77e tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:04.402293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dbc6b039-fe0f-4488-bf29-02493de5d77e tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:04.417590 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-23e564f2-0479-4909-a27c-14aa995a7132 req-a87a84e3-be0a-4d31-a73c-9f9e0ac0d0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7a3be4-ad42-48af-ad94-1eb23cb5a198", "name": "network-vif-deleted", "tag": "405808ec-8898-4789-89b7-b93f71cb824d"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:04.440570 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-23e564f2-0479-4909-a27c-14aa995a7132 req-a87a84e3-be0a-4d31-a73c-9f9e0ac0d0d3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:04.444839 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-23e564f2-0479-4909-a27c-14aa995a7132 req-a87a84e3-be0a-4d31-a73c-9f9e0ac0d0d3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:04.483021 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-23e564f2-0479-4909-a27c-14aa995a7132 req-a87a84e3-be0a-4d31-a73c-9f9e0ac0d0d3 service nova] Creating event network-vif-deleted:405808ec-8898-4789-89b7-b93f71cb824d for instance 2f7a3be4-ad42-48af-ad94-1eb23cb5a198 on n-h1-849104-4 Jul 12 11:59:04.503563 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-23e564f2-0479-4909-a27c-14aa995a7132 req-a87a84e3-be0a-4d31-a73c-9f9e0ac0d0d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089748 Jul 12 11:59:04.505874 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1046/2267] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:59:05.295485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dbc6b039-fe0f-4488-bf29-02493de5d77e tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfe83c08467e4c5a9809b6f92e159761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9846c91b05b54476a049745bed4d5528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:05.310905 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dbc6b039-fe0f-4488-bf29-02493de5d77e tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 200 len: 1436 microversion: 2.1 time: 0.931057 Jul 12 11:59:05.312549 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1222/2268] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:04 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 1436 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:59:05.387878 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b09abfc5-ee17-4aad-8493-9d625685d924 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:05.389870 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b09abfc5-ee17-4aad-8493-9d625685d924 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:05.395122 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=94 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:05.408949 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b09abfc5-ee17-4aad-8493-9d625685d924 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:05.409578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b09abfc5-ee17-4aad-8493-9d625685d924 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:05.415280 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b09abfc5-ee17-4aad-8493-9d625685d924 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:05.416074 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b09abfc5-ee17-4aad-8493-9d625685d924 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:06.170609 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b09abfc5-ee17-4aad-8493-9d625685d924 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:06.184138 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b09abfc5-ee17-4aad-8493-9d625685d924 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:06.186085 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b09abfc5-ee17-4aad-8493-9d625685d924 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:06.187570 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b09abfc5-ee17-4aad-8493-9d625685d924 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.826988 Jul 12 11:59:06.188731 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1047/2269] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:05 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:06.332898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dd42c4b7-03fb-41f5-9108-f292dc021aca tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:06.334229 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dd42c4b7-03fb-41f5-9108-f292dc021aca tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] [instance: 2f7a3be4-ad42-48af-ad94-1eb23cb5a198] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:06.343927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dd42c4b7-03fb-41f5-9108-f292dc021aca tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:06.345003 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dd42c4b7-03fb-41f5-9108-f292dc021aca tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:06.346427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dd42c4b7-03fb-41f5-9108-f292dc021aca tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:06.347039 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dd42c4b7-03fb-41f5-9108-f292dc021aca tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:06.396860 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-dd42c4b7-03fb-41f5-9108-f292dc021aca tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] HTTP exception thrown: Instance 2f7a3be4-ad42-48af-ad94-1eb23cb5a198 could not be found. Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dd42c4b7-03fb-41f5-9108-f292dc021aca tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Request method failure captured: Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 HTTP/1.1 Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWG4Ej07fsIYT0xzd6cSE66Hw7Lvc6Xdv9BJ2lX9UwDjKZVPzJCPZM0beX8pr_2qaFkPYPTrjZE7iwAe-YYkGOCIVA-mD0ZGcr0HLylf5ODuD8FJ9UlN9y2LIwbDE_gEEc_5SyolWdgWpxgCImDHucn2VS1oHfiNBW7rhBTAsCFkmek Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 9846c91b05b54476a049745bed4d5528 Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1417667033 Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9846c91b05b54476a049745bed4d5528"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9846c91b05b54476a049745bed4d5528"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9846c91b05b54476a049745bed4d5528"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9846c91b05b54476a049745bed4d5528", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1417667033 Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 9846c91b05b54476a049745bed4d5528 Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1417667033 Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServersAdminNegativeTestJSON-1417667033-project Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: bfe83c08467e4c5a9809b6f92e159761 Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1417667033-project Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 2f7a3be4-ad42-48af-ad94-1eb23cb5a198 could not be found. Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '2f7a3be4-ad42-48af-ad94-1eb23cb5a198'} Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7a3be4-ad42-48af-ad94-1eb23cb5a198 could not be found. Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7a3be4-ad42-48af-ad94-1eb23cb5a198 could not be found. Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:06.398836 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:59:06.404116 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:06.404116 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:06.404116 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:59:06.404116 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:59:06.404116 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:59:06.404116 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:59:06.404116 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7a3be4-ad42-48af-ad94-1eb23cb5a198 could not be found. Jul 12 11:59:06.404116 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:06.409601 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dd42c4b7-03fb-41f5-9108-f292dc021aca tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] Returning 404 to user: Instance 2f7a3be4-ad42-48af-ad94-1eb23cb5a198 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:59:06.411345 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dd42c4b7-03fb-41f5-9108-f292dc021aca tempest-ServersAdminNegativeTestJSON-1417667033 tempest-ServersAdminNegativeTestJSON-1417667033-project] 10.222.0.50 "GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198" status: 404 len: 111 microversion: 2.1 time: 0.084321 Jul 12 11:59:06.413135 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1223/2270] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:06 2022] GET /compute/v2.1/servers/2f7a3be4-ad42-48af-ad94-1eb23cb5a198 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:59:07.208697 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-73d848b2-d876-4fcf-8bdd-b84ecb495d43 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:07.210072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-73d848b2-d876-4fcf-8bdd-b84ecb495d43 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:07.233800 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-73d848b2-d876-4fcf-8bdd-b84ecb495d43 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:07.234613 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-73d848b2-d876-4fcf-8bdd-b84ecb495d43 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:07.235947 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-73d848b2-d876-4fcf-8bdd-b84ecb495d43 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:07.236576 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-73d848b2-d876-4fcf-8bdd-b84ecb495d43 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:08.239900 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1726329593", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "8983cc54-9edf-4d81-9ef4-1ceabb18bb92"}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:08.379790 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] validate_networks() for [('8983cc54-9edf-4d81-9ef4-1ceabb18bb92', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:59:08.809142 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-73d848b2-d876-4fcf-8bdd-b84ecb495d43 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:08.832803 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-73d848b2-d876-4fcf-8bdd-b84ecb495d43 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:08.841741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-73d848b2-d876-4fcf-8bdd-b84ecb495d43 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:08.848585 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-73d848b2-d876-4fcf-8bdd-b84ecb495d43 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.643335 Jul 12 11:59:08.865475 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1048/2271] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:07 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:09.636097 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-30197e43-6ee7-4129-b8fd-88504bfc80c8 tempest-NetworksTest-626154882 tempest-NetworksTest-626154882-project-admin] Calling method '.version_select at 0x7f5e09f36550>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:10.035157 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-30197e43-6ee7-4129-b8fd-88504bfc80c8 tempest-NetworksTest-626154882 tempest-NetworksTest-626154882-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks" status: 200 len: 10124 microversion: 2.1 time: 0.703736 Jul 12 11:59:10.049595 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1049/2272] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:59:09 2022] GET /compute/v2.1/os-networks => generated 10124 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:59:10.071023 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-93eb62e7-9fa8-43a4-8c78-d2cbc44a2a88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:10.083763 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-93eb62e7-9fa8-43a4-8c78-d2cbc44a2a88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:10.116958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93eb62e7-9fa8-43a4-8c78-d2cbc44a2a88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:10.117761 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93eb62e7-9fa8-43a4-8c78-d2cbc44a2a88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:10.122805 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93eb62e7-9fa8-43a4-8c78-d2cbc44a2a88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:10.123893 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93eb62e7-9fa8-43a4-8c78-d2cbc44a2a88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:10.386367 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:59:10.391042 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:59:10.392390 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:59:10.394118 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:59:10.395693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:59:10.423455 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:10.424684 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:10.428308 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:10.430060 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:10.512331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Getting quotas for project 56c52b6ceeb64ea4a313ee77b0161dde. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:59:10.537125 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Getting quotas for user 1094ce20b0b14bd5883a82846c482842 and project 56c52b6ceeb64ea4a313ee77b0161dde. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:59:10.568918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:59:10.571932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:59:10.693233 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fad83377-bd8f-45fd-a482-684022ddfae2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.774462 Jul 12 11:59:10.711647 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1224/2273] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:59:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 11:59:10.717827 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d763951c-f5be-4974-903d-07699d0b1035 tempest-NetworksTest-626154882 tempest-NetworksTest-626154882-project-admin] Calling method '.version_select at 0x7f5e0a6fd550>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:10.943144 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-93eb62e7-9fa8-43a4-8c78-d2cbc44a2a88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:10.969467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-93eb62e7-9fa8-43a4-8c78-d2cbc44a2a88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:10.976880 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-93eb62e7-9fa8-43a4-8c78-d2cbc44a2a88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:10.984639 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-93eb62e7-9fa8-43a4-8c78-d2cbc44a2a88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.929238 Jul 12 11:59:10.986269 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1050/2274] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:10 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:11.166023 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1421002092", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "8983cc54-9edf-4d81-9ef4-1ceabb18bb92"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:11.302021 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d763951c-f5be-4974-903d-07699d0b1035 tempest-NetworksTest-626154882 tempest-NetworksTest-626154882-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks/7d0e3ae9-b292-41f0-83d1-452494d583da" status: 200 len: 652 microversion: 2.1 time: 0.588486 Jul 12 11:59:11.302612 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1225/2275] 10.222.0.50 () {58 vars in 1247 bytes} [Tue Jul 12 11:59:10 2022] GET /compute/v2.1/os-networks/7d0e3ae9-b292-41f0-83d1-452494d583da => generated 652 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:59:11.316522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bc114e34-23f6-4338-b51c-30dd441f801f tempest-NetworksTest-626154882 tempest-NetworksTest-626154882-project-admin] Calling method '.version_select at 0x7f5e09843040>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:11.332018 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] validate_networks() for [('8983cc54-9edf-4d81-9ef4-1ceabb18bb92', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:59:12.332181 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:59:12.332788 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:59:12.333079 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:59:12.333495 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:59:12.333975 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:59:12.352201 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:12.352647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:12.353700 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:12.359373 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:12.400877 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Getting quotas for project 56c52b6ceeb64ea4a313ee77b0161dde. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:59:12.411480 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Getting quotas for user 1094ce20b0b14bd5883a82846c482842 and project 56c52b6ceeb64ea4a313ee77b0161dde. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:59:12.431628 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:59:12.435582 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:59:12.465404 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bc114e34-23f6-4338-b51c-30dd441f801f tempest-NetworksTest-626154882 tempest-NetworksTest-626154882-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks" status: 200 len: 10124 microversion: 2.1 time: 1.154068 Jul 12 11:59:12.466632 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1226/2276] 10.222.0.50 () {58 vars in 1136 bytes} [Tue Jul 12 11:59:11 2022] GET /compute/v2.1/os-networks => generated 10124 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:59:12.474423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5c17b35c-6298-4e8e-98d2-f8fc4ccc7e94 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:12.476408 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5c17b35c-6298-4e8e-98d2-f8fc4ccc7e94 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:12.498276 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5c17b35c-6298-4e8e-98d2-f8fc4ccc7e94 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:12.500380 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5c17b35c-6298-4e8e-98d2-f8fc4ccc7e94 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:12.501464 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5c17b35c-6298-4e8e-98d2-f8fc4ccc7e94 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:12.503944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5c17b35c-6298-4e8e-98d2-f8fc4ccc7e94 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:12.554627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:12.560942 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-de691b60-aca7-4b85-821b-e03119d7b494 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400234 Jul 12 11:59:12.572542 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1051/2277] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:59:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 11:59:12.924021 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1588153321", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "451", "networks": [{"uuid": "8983cc54-9edf-4d81-9ef4-1ceabb18bb92"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:13.049761 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] validate_networks() for [('8983cc54-9edf-4d81-9ef4-1ceabb18bb92', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:59:13.135419 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5c17b35c-6298-4e8e-98d2-f8fc4ccc7e94 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:13.157873 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5c17b35c-6298-4e8e-98d2-f8fc4ccc7e94 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:13.161720 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5c17b35c-6298-4e8e-98d2-f8fc4ccc7e94 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:13.163310 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5c17b35c-6298-4e8e-98d2-f8fc4ccc7e94 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.695383 Jul 12 11:59:13.164752 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1227/2278] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:12 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:14.187522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-15fb17fb-7824-439c-a6fc-7af0a402f1be tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:14.188241 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-15fb17fb-7824-439c-a6fc-7af0a402f1be tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:14.205482 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-15fb17fb-7824-439c-a6fc-7af0a402f1be tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:14.206191 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-15fb17fb-7824-439c-a6fc-7af0a402f1be tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:14.207397 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-15fb17fb-7824-439c-a6fc-7af0a402f1be tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:14.208079 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-15fb17fb-7824-439c-a6fc-7af0a402f1be tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:14.554781 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-15fb17fb-7824-439c-a6fc-7af0a402f1be tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:14.570134 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-15fb17fb-7824-439c-a6fc-7af0a402f1be tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:14.572909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-15fb17fb-7824-439c-a6fc-7af0a402f1be tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:14.588909 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-15fb17fb-7824-439c-a6fc-7af0a402f1be tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.406811 Jul 12 11:59:14.605139 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1228/2279] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:14 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:59:15.668743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:59:15.672261 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:59:15.698337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:59:15.700393 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:59:15.718333 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4006b913-20e1-41f3-928b-b564cfde6142 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:15.722991 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:59:15.730101 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4006b913-20e1-41f3-928b-b564cfde6142 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:15.751339 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4006b913-20e1-41f3-928b-b564cfde6142 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:15.758689 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4006b913-20e1-41f3-928b-b564cfde6142 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:15.761749 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4006b913-20e1-41f3-928b-b564cfde6142 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:15.762341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4006b913-20e1-41f3-928b-b564cfde6142 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:15.781972 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:15.783162 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:15.789065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:15.790146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:15.918916 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Getting quotas for project 56c52b6ceeb64ea4a313ee77b0161dde. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:59:15.961158 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Getting quotas for user 1094ce20b0b14bd5883a82846c482842 and project 56c52b6ceeb64ea4a313ee77b0161dde. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:59:15.988224 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:59:15.992477 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:59:16.057906 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0ee07d50-0b1f-4eed-8ad8-3ba106f5f133 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.137858 Jul 12 11:59:16.064141 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1052/2280] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 11:59:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 11:59:16.070315 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-660ad23e-bf4e-4930-94b1-b3e13d89ea6b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:16.071523 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-660ad23e-bf4e-4930-94b1-b3e13d89ea6b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:16.193623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-660ad23e-bf4e-4930-94b1-b3e13d89ea6b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:16.203284 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-660ad23e-bf4e-4930-94b1-b3e13d89ea6b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1221 microversion: 2.1 time: 0.137221 Jul 12 11:59:16.215712 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1053/2281] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:16 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1221 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:17.224512 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-eadba66f-a480-4911-9ee2-3fe4a985676c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:17.225483 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-eadba66f-a480-4911-9ee2-3fe4a985676c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:17.457104 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eadba66f-a480-4911-9ee2-3fe4a985676c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:17.467734 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-eadba66f-a480-4911-9ee2-3fe4a985676c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1221 microversion: 2.1 time: 0.249366 Jul 12 11:59:17.468821 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1054/2282] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:17 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1221 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:17.845843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4006b913-20e1-41f3-928b-b564cfde6142 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:17.861586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4006b913-20e1-41f3-928b-b564cfde6142 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:17.871164 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4006b913-20e1-41f3-928b-b564cfde6142 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:17.877547 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4006b913-20e1-41f3-928b-b564cfde6142 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 2.261482 Jul 12 11:59:17.885628 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1229/2283] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:15 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:18.487787 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5ecb19c1-3b85-44fc-944c-8ffd2f3a2070 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:18.491419 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5ecb19c1-3b85-44fc-944c-8ffd2f3a2070 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:18.507546 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-cc214d99-7ab4-4ca3-a419-c64c05657d50 req-de2efe20-bc77-458f-8c16-77ea91db124c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b09df1e-5829-4233-af64-e442475c1c1c", "tag": "c9dea8ad-c9b6-4ead-9f6e-94271da2c995"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:18.525362 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5ecb19c1-3b85-44fc-944c-8ffd2f3a2070 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:18.526226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5ecb19c1-3b85-44fc-944c-8ffd2f3a2070 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:18.530314 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-cc214d99-7ab4-4ca3-a419-c64c05657d50 req-de2efe20-bc77-458f-8c16-77ea91db124c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:18.531153 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-cc214d99-7ab4-4ca3-a419-c64c05657d50 req-de2efe20-bc77-458f-8c16-77ea91db124c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:18.537109 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5ecb19c1-3b85-44fc-944c-8ffd2f3a2070 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:18.544270 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5ecb19c1-3b85-44fc-944c-8ffd2f3a2070 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:18.554103 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-cc214d99-7ab4-4ca3-a419-c64c05657d50 req-de2efe20-bc77-458f-8c16-77ea91db124c service nova] Creating event network-changed:c9dea8ad-c9b6-4ead-9f6e-94271da2c995 for instance 3b09df1e-5829-4233-af64-e442475c1c1c on n-h2-849104-4 Jul 12 11:59:18.560946 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-cc214d99-7ab4-4ca3-a419-c64c05657d50 req-de2efe20-bc77-458f-8c16-77ea91db124c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057396 Jul 12 11:59:18.564142 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1230/2284] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:59:18.909376 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c2ccac2e-8069-4c2c-a728-36b8178e32bd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:18.910311 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c2ccac2e-8069-4c2c-a728-36b8178e32bd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:18.930675 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c2ccac2e-8069-4c2c-a728-36b8178e32bd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:18.931522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c2ccac2e-8069-4c2c-a728-36b8178e32bd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:18.932552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c2ccac2e-8069-4c2c-a728-36b8178e32bd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:18.935528 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c2ccac2e-8069-4c2c-a728-36b8178e32bd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:19.121998 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5ecb19c1-3b85-44fc-944c-8ffd2f3a2070 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:19.146225 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5ecb19c1-3b85-44fc-944c-8ffd2f3a2070 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1273 microversion: 2.1 time: 0.663525 Jul 12 11:59:19.147359 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1055/2285] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:18 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1273 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:19.866191 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c2ccac2e-8069-4c2c-a728-36b8178e32bd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:19.878349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c2ccac2e-8069-4c2c-a728-36b8178e32bd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:19.880447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c2ccac2e-8069-4c2c-a728-36b8178e32bd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:19.882596 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c2ccac2e-8069-4c2c-a728-36b8178e32bd tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.979835 Jul 12 11:59:19.894945 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1231/2286] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:18 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:59:20.170818 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f227b85d-4b60-4232-bd2b-204dd87dc36c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:20.174574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f227b85d-4b60-4232-bd2b-204dd87dc36c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:20.192677 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f227b85d-4b60-4232-bd2b-204dd87dc36c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:20.193367 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f227b85d-4b60-4232-bd2b-204dd87dc36c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:20.194557 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f227b85d-4b60-4232-bd2b-204dd87dc36c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:20.195855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f227b85d-4b60-4232-bd2b-204dd87dc36c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:20.554625 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f227b85d-4b60-4232-bd2b-204dd87dc36c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:20.576749 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f227b85d-4b60-4232-bd2b-204dd87dc36c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1279 microversion: 2.1 time: 0.411211 Jul 12 11:59:20.578313 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1056/2287] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:20 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1279 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:20.903338 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9080d838-9058-4abe-b4c8-80ce2851c19e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:20.903974 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9080d838-9058-4abe-b4c8-80ce2851c19e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:20.912010 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:20.916463 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:20.920138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:20.939828 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9080d838-9058-4abe-b4c8-80ce2851c19e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:20.951812 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-892ccc79-67fa-415d-a943-8691b8b0a288 req-8bccd161-dace-4b13-924f-a6aaa66071a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e337b451-c995-432f-bfcf-c81b435abb3e", "tag": "a157f95c-3c36-4800-916f-7c7808bedeae"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:20.961762 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9080d838-9058-4abe-b4c8-80ce2851c19e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:20.963769 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9080d838-9058-4abe-b4c8-80ce2851c19e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:20.965310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9080d838-9058-4abe-b4c8-80ce2851c19e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:20.975112 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-892ccc79-67fa-415d-a943-8691b8b0a288 req-8bccd161-dace-4b13-924f-a6aaa66071a3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:20.975741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-892ccc79-67fa-415d-a943-8691b8b0a288 req-8bccd161-dace-4b13-924f-a6aaa66071a3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:21.015364 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-892ccc79-67fa-415d-a943-8691b8b0a288 req-8bccd161-dace-4b13-924f-a6aaa66071a3 service nova] Creating event network-changed:a157f95c-3c36-4800-916f-7c7808bedeae for instance e337b451-c995-432f-bfcf-c81b435abb3e on n-h1-849104-4 Jul 12 11:59:21.022726 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-892ccc79-67fa-415d-a943-8691b8b0a288 req-8bccd161-dace-4b13-924f-a6aaa66071a3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074527 Jul 12 11:59:21.029090 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1057/2288] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:59:21.611969 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2a681818-2ba4-48f7-9bf6-ddec73c20117 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:21.614406 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2a681818-2ba4-48f7-9bf6-ddec73c20117 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:21.641590 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2a681818-2ba4-48f7-9bf6-ddec73c20117 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:21.642311 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2a681818-2ba4-48f7-9bf6-ddec73c20117 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:21.643258 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2a681818-2ba4-48f7-9bf6-ddec73c20117 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:21.643854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2a681818-2ba4-48f7-9bf6-ddec73c20117 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:21.877852 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2a681818-2ba4-48f7-9bf6-ddec73c20117 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:21.886207 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2a681818-2ba4-48f7-9bf6-ddec73c20117 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1279 microversion: 2.1 time: 0.290262 Jul 12 11:59:21.887621 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1058/2289] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:21 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1279 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:22.412634 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9080d838-9058-4abe-b4c8-80ce2851c19e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:22.435451 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9080d838-9058-4abe-b4c8-80ce2851c19e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:22.437497 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9080d838-9058-4abe-b4c8-80ce2851c19e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:22.438870 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9080d838-9058-4abe-b4c8-80ce2851c19e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.541322 Jul 12 11:59:22.439459 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1232/2290] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:20 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:22.911578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-84cfcbf4-0839-4610-a516-61bc759f008b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:22.912509 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-84cfcbf4-0839-4610-a516-61bc759f008b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:22.942522 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-84cfcbf4-0839-4610-a516-61bc759f008b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:22.942522 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-84cfcbf4-0839-4610-a516-61bc759f008b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:22.943415 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-84cfcbf4-0839-4610-a516-61bc759f008b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:22.943415 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-84cfcbf4-0839-4610-a516-61bc759f008b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:23.463566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8b3e3051-1d0f-4e78-95c2-baa058407796 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:23.464457 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8b3e3051-1d0f-4e78-95c2-baa058407796 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:23.494448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b3e3051-1d0f-4e78-95c2-baa058407796 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:23.495418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b3e3051-1d0f-4e78-95c2-baa058407796 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:23.496264 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b3e3051-1d0f-4e78-95c2-baa058407796 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:23.501730 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8b3e3051-1d0f-4e78-95c2-baa058407796 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:24.033174 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-84cfcbf4-0839-4610-a516-61bc759f008b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:24.055624 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-84cfcbf4-0839-4610-a516-61bc759f008b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1321 microversion: 2.1 time: 1.150458 Jul 12 11:59:24.056824 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1059/2291] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:22 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1321 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:59:24.133854 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8b3e3051-1d0f-4e78-95c2-baa058407796 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:24.154040 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8b3e3051-1d0f-4e78-95c2-baa058407796 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:24.160663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8b3e3051-1d0f-4e78-95c2-baa058407796 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:24.162474 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8b3e3051-1d0f-4e78-95c2-baa058407796 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.706883 Jul 12 11:59:24.165654 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1233/2292] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:23 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:25.083832 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-89a9dd28-18ee-4ad7-84c0-6b23beb293f1 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:25.085876 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-89a9dd28-18ee-4ad7-84c0-6b23beb293f1 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:25.104682 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89a9dd28-18ee-4ad7-84c0-6b23beb293f1 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:25.108374 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89a9dd28-18ee-4ad7-84c0-6b23beb293f1 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:25.113253 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89a9dd28-18ee-4ad7-84c0-6b23beb293f1 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:25.117741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89a9dd28-18ee-4ad7-84c0-6b23beb293f1 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:25.200831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8c0196cd-d79a-44c5-9d47-a83e553d910e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:25.201450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8c0196cd-d79a-44c5-9d47-a83e553d910e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:25.226987 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c0196cd-d79a-44c5-9d47-a83e553d910e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:25.227939 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c0196cd-d79a-44c5-9d47-a83e553d910e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:25.229924 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c0196cd-d79a-44c5-9d47-a83e553d910e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:25.231920 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c0196cd-d79a-44c5-9d47-a83e553d910e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:25.825855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=4 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:26.177667 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-89a9dd28-18ee-4ad7-84c0-6b23beb293f1 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:26.234512 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-89a9dd28-18ee-4ad7-84c0-6b23beb293f1 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1321 microversion: 2.1 time: 1.160379 Jul 12 11:59:26.236963 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1060/2293] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:25 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1321 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:26.390074 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8c0196cd-d79a-44c5-9d47-a83e553d910e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:26.433392 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8c0196cd-d79a-44c5-9d47-a83e553d910e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:26.440538 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8c0196cd-d79a-44c5-9d47-a83e553d910e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:26.447405 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8c0196cd-d79a-44c5-9d47-a83e553d910e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.255578 Jul 12 11:59:26.452949 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1234/2294] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:25 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:27.263931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cce8cbd8-961c-423b-b47a-98828684b6db tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:27.265434 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cce8cbd8-961c-423b-b47a-98828684b6db tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:27.288425 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cce8cbd8-961c-423b-b47a-98828684b6db tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:27.290268 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cce8cbd8-961c-423b-b47a-98828684b6db tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:27.292524 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cce8cbd8-961c-423b-b47a-98828684b6db tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:27.293687 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cce8cbd8-961c-423b-b47a-98828684b6db tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:27.462861 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=16 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:27.467412 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2ff90e50-bfd1-41c3-addf-91931d7066db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:27.468774 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2ff90e50-bfd1-41c3-addf-91931d7066db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:27.489438 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2ff90e50-bfd1-41c3-addf-91931d7066db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:27.489948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2ff90e50-bfd1-41c3-addf-91931d7066db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:27.490827 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2ff90e50-bfd1-41c3-addf-91931d7066db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:27.491283 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2ff90e50-bfd1-41c3-addf-91931d7066db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:28.256601 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-cce8cbd8-961c-423b-b47a-98828684b6db tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:28.263321 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=93 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:28.268874 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cce8cbd8-961c-423b-b47a-98828684b6db tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1321 microversion: 2.1 time: 1.013756 Jul 12 11:59:28.280539 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1061/2295] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:27 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1321 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:28.581101 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-8c7dd663-1bcb-49ff-a07e-8b0f3ce9e91f req-a6d378a5-a92a-4b34-bfff-5a28983d788d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8ece58-3fc8-42d8-b049-038b865159ae", "tag": "4398a787-b528-4504-953e-274211d152cb"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:28.596773 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-8c7dd663-1bcb-49ff-a07e-8b0f3ce9e91f req-a6d378a5-a92a-4b34-bfff-5a28983d788d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:28.597319 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-8c7dd663-1bcb-49ff-a07e-8b0f3ce9e91f req-a6d378a5-a92a-4b34-bfff-5a28983d788d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:28.641061 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-8c7dd663-1bcb-49ff-a07e-8b0f3ce9e91f req-a6d378a5-a92a-4b34-bfff-5a28983d788d service nova] Creating event network-changed:4398a787-b528-4504-953e-274211d152cb for instance 5d8ece58-3fc8-42d8-b049-038b865159ae on n-h2-849104-4 Jul 12 11:59:28.680458 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-8c7dd663-1bcb-49ff-a07e-8b0f3ce9e91f req-a6d378a5-a92a-4b34-bfff-5a28983d788d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.396061 Jul 12 11:59:28.683901 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1062/2296] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:59:28.714785 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2ff90e50-bfd1-41c3-addf-91931d7066db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:28.726670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2ff90e50-bfd1-41c3-addf-91931d7066db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:28.728574 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2ff90e50-bfd1-41c3-addf-91931d7066db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:28.729976 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2ff90e50-bfd1-41c3-addf-91931d7066db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.267154 Jul 12 11:59:28.734285 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1235/2297] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:27 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:29.294999 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-21fdc260-bb31-4375-a997-68550a1a7b68 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:29.297018 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-21fdc260-bb31-4375-a997-68550a1a7b68 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:29.310073 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-21fdc260-bb31-4375-a997-68550a1a7b68 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:29.310799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-21fdc260-bb31-4375-a997-68550a1a7b68 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:29.311815 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-21fdc260-bb31-4375-a997-68550a1a7b68 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:29.312456 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-21fdc260-bb31-4375-a997-68550a1a7b68 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:29.755464 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a3522be0-4efc-45cd-a7d9-19f3bb33d8c5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:29.756899 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a3522be0-4efc-45cd-a7d9-19f3bb33d8c5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:29.771180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3522be0-4efc-45cd-a7d9-19f3bb33d8c5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:29.771883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3522be0-4efc-45cd-a7d9-19f3bb33d8c5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:29.772962 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3522be0-4efc-45cd-a7d9-19f3bb33d8c5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:29.777560 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a3522be0-4efc-45cd-a7d9-19f3bb33d8c5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:30.741726 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a3522be0-4efc-45cd-a7d9-19f3bb33d8c5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:30.763370 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a3522be0-4efc-45cd-a7d9-19f3bb33d8c5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:30.772838 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a3522be0-4efc-45cd-a7d9-19f3bb33d8c5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:30.774417 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a3522be0-4efc-45cd-a7d9-19f3bb33d8c5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.022946 Jul 12 11:59:30.776445 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1236/2298] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:29 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:30.790646 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7b111282-77ff-4981-8d06-241361be60c2 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:30.797592 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7b111282-77ff-4981-8d06-241361be60c2 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:30.800931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-21fdc260-bb31-4375-a997-68550a1a7b68 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:30.811757 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-21fdc260-bb31-4375-a997-68550a1a7b68 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1321 microversion: 2.1 time: 1.521889 Jul 12 11:59:30.821621 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1063/2299] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:29 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1321 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:30.829943 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7b111282-77ff-4981-8d06-241361be60c2 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:30.833364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7b111282-77ff-4981-8d06-241361be60c2 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:30.834233 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7b111282-77ff-4981-8d06-241361be60c2 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:30.834688 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7b111282-77ff-4981-8d06-241361be60c2 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:31.417497 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-7b111282-77ff-4981-8d06-241361be60c2 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'services' on Instance uuid b26b640d-3b19-492b-99f2-4c0cb3c10c25 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:59:31.472064 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7b111282-77ff-4981-8d06-241361be60c2 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 2346 microversion: 2.25 time: 0.693649 Jul 12 11:59:31.481922 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1237/2300] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:30 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 2346 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:31.503620 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-12375466-8c31-4871-b64c-7eebadbd9c47 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:31.506019 n-d-849104-4 devstack@n-api.service[125983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 11:59:31.506019 n-d-849104-4 devstack@n-api.service[125983]: warnings.warn(msg) Jul 12 11:59:31.507927 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-12375466-8c31-4871-b64c-7eebadbd9c47 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:31.517213 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-12375466-8c31-4871-b64c-7eebadbd9c47 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:31.519411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-12375466-8c31-4871-b64c-7eebadbd9c47 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:31.520449 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-12375466-8c31-4871-b64c-7eebadbd9c47 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:31.611666 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-12375466-8c31-4871-b64c-7eebadbd9c47 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.115457 Jul 12 11:59:31.617578 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1064/2301] 10.222.0.50 () {60 vars in 1216 bytes} [Tue Jul 12 11:59:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:59:31.816526 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e034de6e-9327-41cc-bd0c-26d887625bc4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:31.824331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e034de6e-9327-41cc-bd0c-26d887625bc4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:31.843774 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4e1c56ae-b8ab-413f-ad1d-4322cefe5f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:31.844550 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4e1c56ae-b8ab-413f-ad1d-4322cefe5f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:31.859125 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e1c56ae-b8ab-413f-ad1d-4322cefe5f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:31.859593 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e1c56ae-b8ab-413f-ad1d-4322cefe5f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:31.860691 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e1c56ae-b8ab-413f-ad1d-4322cefe5f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:31.867323 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e1c56ae-b8ab-413f-ad1d-4322cefe5f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:31.868327 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e034de6e-9327-41cc-bd0c-26d887625bc4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:31.869511 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e034de6e-9327-41cc-bd0c-26d887625bc4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:31.872223 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e034de6e-9327-41cc-bd0c-26d887625bc4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:31.873049 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e034de6e-9327-41cc-bd0c-26d887625bc4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:32.963015 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4e1c56ae-b8ab-413f-ad1d-4322cefe5f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:33.003490 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4e1c56ae-b8ab-413f-ad1d-4322cefe5f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1321 microversion: 2.1 time: 1.158187 Jul 12 11:59:33.004803 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1065/2302] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:31 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1321 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:33.463788 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e034de6e-9327-41cc-bd0c-26d887625bc4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:33.480285 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e034de6e-9327-41cc-bd0c-26d887625bc4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:33.481811 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e034de6e-9327-41cc-bd0c-26d887625bc4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:33.482995 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e034de6e-9327-41cc-bd0c-26d887625bc4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.683985 Jul 12 11:59:33.512141 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1238/2303] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:31 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:33.974137 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2e3d18ad-3853-43c2-bf10-6c3ce8687d8c tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] Action: 'create', calling method: .version_select at 0x7f5e139f3700>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:34.020525 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-2e3d18ad-3853-43c2-bf10-6c3ce8687d8c tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] Getting quotas for project 89ed4a99b535499ebd314676e64f6abd. Resources: {'server_groups'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:59:34.025068 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2d1bc6b0-626a-4c05-8ce8-10418a2f8962 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:34.026169 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2d1bc6b0-626a-4c05-8ce8-10418a2f8962 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:34.034600 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-2e3d18ad-3853-43c2-bf10-6c3ce8687d8c tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] Getting quotas for user 98c1b4782ecf4ea3ac2beffe9ab646a0 and project 89ed4a99b535499ebd314676e64f6abd. Resources: {'server_groups'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:59:34.044273 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2d1bc6b0-626a-4c05-8ce8-10418a2f8962 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:34.045255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2d1bc6b0-626a-4c05-8ce8-10418a2f8962 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:34.049191 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2d1bc6b0-626a-4c05-8ce8-10418a2f8962 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:34.049860 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2d1bc6b0-626a-4c05-8ce8-10418a2f8962 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:34.199195 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-2e3d18ad-3853-43c2-bf10-6c3ce8687d8c tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] Getting quotas for project 89ed4a99b535499ebd314676e64f6abd. Resources: {'server_groups'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:59:34.240258 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-2e3d18ad-3853-43c2-bf10-6c3ce8687d8c tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] Getting quotas for user 98c1b4782ecf4ea3ac2beffe9ab646a0 and project 89ed4a99b535499ebd314676e64f6abd. Resources: {'server_groups'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:59:34.298014 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2e3d18ad-3853-43c2-bf10-6c3ce8687d8c tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.683450 Jul 12 11:59:34.299211 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1066/2304] 10.222.0.50 () {62 vars in 1213 bytes} [Tue Jul 12 11:59:33 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:59:34.311136 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-906e2a82-c60e-44d0-811b-c264a4b7b01c tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:34.359984 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-906e2a82-c60e-44d0-811b-c264a4b7b01c tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.053473 Jul 12 11:59:34.369110 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1067/2305] 10.222.0.50 () {60 vars in 1192 bytes} [Tue Jul 12 11:59:34 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:59:34.380109 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-606548ce-1327-43c7-86d2-c06d248349a4 tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:34.385920 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:34.400066 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-606548ce-1327-43c7-86d2-c06d248349a4 tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/4e5d58b0-f682-4d46-8cf8-4556fc55f3e2" status: 200 len: 235 microversion: 2.64 time: 0.025107 Jul 12 11:59:34.401302 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1068/2306] 10.222.0.50 () {60 vars in 1303 bytes} [Tue Jul 12 11:59:34 2022] GET /compute/v2.1/os-server-groups/4e5d58b0-f682-4d46-8cf8-4556fc55f3e2 => generated 235 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:59:34.415303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c7c8748b-9a2f-4342-bb42-7fb26c6fe96f tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:34.490340 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c7c8748b-9a2f-4342-bb42-7fb26c6fe96f tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/4e5d58b0-f682-4d46-8cf8-4556fc55f3e2" status: 204 len: 0 microversion: 2.64 time: 0.082008 Jul 12 11:59:34.491449 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1069/2307] 10.222.0.50 () {60 vars in 1306 bytes} [Tue Jul 12 11:59:34 2022] DELETE /compute/v2.1/os-server-groups/4e5d58b0-f682-4d46-8cf8-4556fc55f3e2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 11:59:34.509859 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2e05d322-d6f4-41f7-ac32-86262d72ce5e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:34.510761 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2e05d322-d6f4-41f7-ac32-86262d72ce5e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:34.518122 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2e05d322-d6f4-41f7-ac32-86262d72ce5e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:34.518859 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2e05d322-d6f4-41f7-ac32-86262d72ce5e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:34.519913 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2e05d322-d6f4-41f7-ac32-86262d72ce5e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:34.520718 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2e05d322-d6f4-41f7-ac32-86262d72ce5e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:34.953804 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2d1bc6b0-626a-4c05-8ce8-10418a2f8962 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:34.983990 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2d1bc6b0-626a-4c05-8ce8-10418a2f8962 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1321 microversion: 2.1 time: 0.964919 Jul 12 11:59:34.998283 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1239/2308] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:34 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1321 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:35.015638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dd944737-63e4-435e-8bef-7c7b431ef6bb tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:35.028066 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-dd944737-63e4-435e-8bef-7c7b431ef6bb tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] HTTP exception thrown: Instance group 4e5d58b0-f682-4d46-8cf8-4556fc55f3e2 could not be found. Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dd944737-63e4-435e-8bef-7c7b431ef6bb tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] Request method failure captured: Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/os-server-groups/4e5d58b0-f682-4d46-8cf8-4556fc55f3e2 HTTP/1.1 Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWIltQwJAR-AR1HPChX-dodHabNWrEUzSChOoYRFHty0ixECwsWeDxdQEFI7RY9pEuMKT46yxTlLH7EQEc8IlLSwyh7xAO2V5CmnbheHZx5i2ibJWnTXTH1E-H1pjKf8lyBedYJkkUigHVGKUGeSMdrcRj3QPe7MCHo-sF40sVnydn0 Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Openstack-Nova-Api-Version: 2.64 Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 89ed4a99b535499ebd314676e64f6abd Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServerGroup264TestJSON-1433352654 Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/89ed4a99b535499ebd314676e64f6abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/89ed4a99b535499ebd314676e64f6abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/89ed4a99b535499ebd314676e64f6abd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_89ed4a99b535499ebd314676e64f6abd", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServerGroup264TestJSON-1433352654 Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 89ed4a99b535499ebd314676e64f6abd Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1433352654 Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServerGroup264TestJSON-1433352654-project Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 98c1b4782ecf4ea3ac2beffe9ab646a0 Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServerGroup264TestJSON-1433352654-project Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance group 4e5d58b0-f682-4d46-8cf8-4556fc55f3e2 could not be found. Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '4e5d58b0-f682-4d46-8cf8-4556fc55f3e2'} Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4e5d58b0-f682-4d46-8cf8-4556fc55f3e2 could not be found. Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4e5d58b0-f682-4d46-8cf8-4556fc55f3e2 could not be found. Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:35.037821 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:35.052784 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:59:35.052784 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:59:35.052784 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:59:35.052784 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:59:35.052784 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4e5d58b0-f682-4d46-8cf8-4556fc55f3e2 could not be found. Jul 12 11:59:35.052784 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:35.052784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dd944737-63e4-435e-8bef-7c7b431ef6bb tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] Returning 404 to user: Instance group 4e5d58b0-f682-4d46-8cf8-4556fc55f3e2 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:59:35.052784 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dd944737-63e4-435e-8bef-7c7b431ef6bb tempest-ServerGroup264TestJSON-1433352654 tempest-ServerGroup264TestJSON-1433352654-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/4e5d58b0-f682-4d46-8cf8-4556fc55f3e2" status: 404 len: 117 microversion: 2.64 time: 0.039798 Jul 12 11:59:35.052784 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1240/2309] 10.222.0.50 () {60 vars in 1306 bytes} [Tue Jul 12 11:59:34 2022] DELETE /compute/v2.1/os-server-groups/4e5d58b0-f682-4d46-8cf8-4556fc55f3e2 => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 11:59:35.052784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-486c0bc4-cbe6-4112-81cc-b9fdd1fcbe45 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9298d697-4552-4737-9144-55145cfeea34", "device": "/dev/xvdb"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:35.052784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-486c0bc4-cbe6-4112-81cc-b9fdd1fcbe45 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:35.073602 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-486c0bc4-cbe6-4112-81cc-b9fdd1fcbe45 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:35.076859 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-486c0bc4-cbe6-4112-81cc-b9fdd1fcbe45 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:35.078684 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-486c0bc4-cbe6-4112-81cc-b9fdd1fcbe45 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:35.082098 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-486c0bc4-cbe6-4112-81cc-b9fdd1fcbe45 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:35.137105 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2e05d322-d6f4-41f7-ac32-86262d72ce5e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:35.192411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2e05d322-d6f4-41f7-ac32-86262d72ce5e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:35.196514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2e05d322-d6f4-41f7-ac32-86262d72ce5e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:35.197947 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2e05d322-d6f4-41f7-ac32-86262d72ce5e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.692380 Jul 12 11:59:35.210764 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1070/2310] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:34 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:35.844352 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-486c0bc4-cbe6-4112-81cc-b9fdd1fcbe45 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "POST /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.798503 Jul 12 11:59:35.845486 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1241/2311] 10.222.0.50 () {62 vars in 1363 bytes} [Tue Jul 12 11:59:35 2022] POST /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 11:59:36.008332 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9910906b-ac98-4fc5-8542-e80b9a941cd3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:36.010370 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9910906b-ac98-4fc5-8542-e80b9a941cd3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:36.040112 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-f6d69161-5c49-413f-991e-89c89c479600 req-bdf13960-f956-4763-8bee-328c7052d301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b09df1e-5829-4233-af64-e442475c1c1c", "name": "network-vif-plugged", "status": "completed", "tag": "c9dea8ad-c9b6-4ead-9f6e-94271da2c995"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:36.044738 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9910906b-ac98-4fc5-8542-e80b9a941cd3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:36.048747 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9910906b-ac98-4fc5-8542-e80b9a941cd3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:36.049896 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9910906b-ac98-4fc5-8542-e80b9a941cd3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:36.050445 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9910906b-ac98-4fc5-8542-e80b9a941cd3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:36.072610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-f6d69161-5c49-413f-991e-89c89c479600 req-bdf13960-f956-4763-8bee-328c7052d301 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:36.074584 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-f6d69161-5c49-413f-991e-89c89c479600 req-bdf13960-f956-4763-8bee-328c7052d301 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:36.111186 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-f6d69161-5c49-413f-991e-89c89c479600 req-bdf13960-f956-4763-8bee-328c7052d301 service nova] Creating event network-vif-plugged:c9dea8ad-c9b6-4ead-9f6e-94271da2c995 for instance 3b09df1e-5829-4233-af64-e442475c1c1c on n-h2-849104-4 Jul 12 11:59:36.121435 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-f6d69161-5c49-413f-991e-89c89c479600 req-bdf13960-f956-4763-8bee-328c7052d301 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.269696 Jul 12 11:59:36.124658 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1071/2312] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:59:36.223954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a9b642fc-bb25-4aa5-b854-53220bcd970b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:36.226013 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a9b642fc-bb25-4aa5-b854-53220bcd970b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:36.235242 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a9b642fc-bb25-4aa5-b854-53220bcd970b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:36.236286 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a9b642fc-bb25-4aa5-b854-53220bcd970b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:36.237238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a9b642fc-bb25-4aa5-b854-53220bcd970b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:36.238274 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a9b642fc-bb25-4aa5-b854-53220bcd970b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:36.804363 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9910906b-ac98-4fc5-8542-e80b9a941cd3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:36.836542 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9910906b-ac98-4fc5-8542-e80b9a941cd3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1321 microversion: 2.1 time: 0.833845 Jul 12 11:59:36.837342 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1242/2313] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:36 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1321 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:59:37.510281 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a9b642fc-bb25-4aa5-b854-53220bcd970b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:37.521417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a9b642fc-bb25-4aa5-b854-53220bcd970b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:37.528592 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a9b642fc-bb25-4aa5-b854-53220bcd970b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:37.529875 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a9b642fc-bb25-4aa5-b854-53220bcd970b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.314728 Jul 12 11:59:37.537759 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1072/2314] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:36 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:59:37.691368 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b1fd5363-ccd2-42fb-bc05-39198deee9bf tempest-FloatingIPsNegativeTestJSON-338711019 tempest-FloatingIPsNegativeTestJSON-338711019-project] Calling method '.version_select at 0x7f5e099cd940>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:37.856834 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-147752e1-e1ae-4f69-a610-a3193e9e4977 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:37.857760 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-147752e1-e1ae-4f69-a610-a3193e9e4977 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:37.873924 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-147752e1-e1ae-4f69-a610-a3193e9e4977 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:37.877161 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-147752e1-e1ae-4f69-a610-a3193e9e4977 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:37.878245 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-147752e1-e1ae-4f69-a610-a3193e9e4977 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:37.878697 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-147752e1-e1ae-4f69-a610-a3193e9e4977 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:38.079915 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b1fd5363-ccd2-42fb-bc05-39198deee9bf tempest-FloatingIPsNegativeTestJSON-338711019 tempest-FloatingIPsNegativeTestJSON-338711019-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.561610 Jul 12 11:59:38.080554 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1243/2315] 10.222.0.50 () {58 vars in 1148 bytes} [Tue Jul 12 11:59:37 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 11:59:38.094021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2f55751d-a7aa-4751-b8ab-0ccb6ed05bc2 tempest-FloatingIPsNegativeTestJSON-338711019 tempest-FloatingIPsNegativeTestJSON-338711019-project] Action: 'create', calling method: .version_select at 0x7f5e099a9a60>, body: {"pool": "non_exist_pool"} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:38.140838 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-2f55751d-a7aa-4751-b8ab-0ccb6ed05bc2 tempest-FloatingIPsNegativeTestJSON-338711019 tempest-FloatingIPsNegativeTestJSON-338711019-project] HTTP exception thrown: Floating IP pool not found. Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2f55751d-a7aa-4751-b8ab-0ccb6ed05bc2 tempest-FloatingIPsNegativeTestJSON-338711019 tempest-FloatingIPsNegativeTestJSON-338711019-project] Request method failure captured: Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 26 Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWIpv3-eEdB7tIS8nHXgw4NTD0ma5oiXu8Lbgfs8Y9vH48mQaGljLZuiJNcupNwgJP_zHqvoXiRHByAoMihN-EvektF4IJVC2APK7UJqLwhGb12x1qDoL3vzp1URMmfrhgXgfpnFl6ZPk4q7vIzo01gP66aDxRYoRF5F0jqvxFI01K8 Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 0d24e6c7f6b64694b7c575d8e51f7d2f Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-338711019 Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0d24e6c7f6b64694b7c575d8e51f7d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0d24e6c7f6b64694b7c575d8e51f7d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0d24e6c7f6b64694b7c575d8e51f7d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0d24e6c7f6b64694b7c575d8e51f7d2f", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-338711019 Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 0d24e6c7f6b64694b7c575d8e51f7d2f Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-338711019 Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-FloatingIPsNegativeTestJSON-338711019-project Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 1ffd40c2a5f848c2b27afe777035002c Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-338711019-project Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: {"pool": "non_exist_pool"} Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: exception: Floating IP pool not found. Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:59:38.145604 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:59:38.157046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 12 11:59:38.157046 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:38.157046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2f55751d-a7aa-4751-b8ab-0ccb6ed05bc2 tempest-FloatingIPsNegativeTestJSON-338711019 tempest-FloatingIPsNegativeTestJSON-338711019-project] Returning 404 to user: Floating IP pool not found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:59:38.157046 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2f55751d-a7aa-4751-b8ab-0ccb6ed05bc2 tempest-FloatingIPsNegativeTestJSON-338711019 tempest-FloatingIPsNegativeTestJSON-338711019-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.065009 Jul 12 11:59:38.157046 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1244/2316] 10.222.0.50 () {60 vars in 1169 bytes} [Tue Jul 12 11:59:38 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 11:59:38.184668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9b194acd-53bc-4409-92db-50e92f4cf73c tempest-FloatingIPsNegativeTestJSON-338711019 tempest-FloatingIPsNegativeTestJSON-338711019-project] Calling method '.version_select at 0x7f5e0a6fd700>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:38.261103 n-d-849104-4 devstack@n-api.service[125984]: DEBUG neutronclient.v2_0.client [None req-9b194acd-53bc-4409-92db-50e92f4cf73c tempest-FloatingIPsNegativeTestJSON-338711019 tempest-FloatingIPsNegativeTestJSON-338711019-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 08c1e7b1-1ee1-4b6e-ac48-c4058c3970f4 could not be found", "detail": ""}} {{(pid=125984) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 12 11:59:38.262134 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-9b194acd-53bc-4409-92db-50e92f4cf73c tempest-FloatingIPsNegativeTestJSON-338711019 tempest-FloatingIPsNegativeTestJSON-338711019-project] HTTP exception thrown: Floating IP not found for ID 08c1e7b1-1ee1-4b6e-ac48-c4058c3970f4 Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9b194acd-53bc-4409-92db-50e92f4cf73c tempest-FloatingIPsNegativeTestJSON-338711019 tempest-FloatingIPsNegativeTestJSON-338711019-project] Request method failure captured: Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/os-floating-ips/08c1e7b1-1ee1-4b6e-ac48-c4058c3970f4 HTTP/1.1 Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWIpv3-eEdB7tIS8nHXgw4NTD0ma5oiXu8Lbgfs8Y9vH48mQaGljLZuiJNcupNwgJP_zHqvoXiRHByAoMihN-EvektF4IJVC2APK7UJqLwhGb12x1qDoL3vzp1URMmfrhgXgfpnFl6ZPk4q7vIzo01gP66aDxRYoRF5F0jqvxFI01K8 Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 0d24e6c7f6b64694b7c575d8e51f7d2f Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-338711019 Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0d24e6c7f6b64694b7c575d8e51f7d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0d24e6c7f6b64694b7c575d8e51f7d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0d24e6c7f6b64694b7c575d8e51f7d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0d24e6c7f6b64694b7c575d8e51f7d2f", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-338711019 Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 0d24e6c7f6b64694b7c575d8e51f7d2f Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-338711019 Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-FloatingIPsNegativeTestJSON-338711019-project Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 1ffd40c2a5f848c2b27afe777035002c Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-338711019-project Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: method: Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: exception: Floating IP not found for ID 08c1e7b1-1ee1-4b6e-ac48-c4058c3970f4 Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '08c1e7b1-1ee1-4b6e-ac48-c4058c3970f4'} Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 08c1e7b1-1ee1-4b6e-ac48-c4058c3970f4 could not be found Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6294c8f3-fb99-41d5-b75b-9626552f1b20'] Jul 12 11:59:38.265542 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 08c1e7b1-1ee1-4b6e-ac48-c4058c3970f4. Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 08c1e7b1-1ee1-4b6e-ac48-c4058c3970f4 Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 08c1e7b1-1ee1-4b6e-ac48-c4058c3970f4 Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9b194acd-53bc-4409-92db-50e92f4cf73c tempest-FloatingIPsNegativeTestJSON-338711019 tempest-FloatingIPsNegativeTestJSON-338711019-project] Returning 404 to user: Floating IP not found for ID 08c1e7b1-1ee1-4b6e-ac48-c4058c3970f4 {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 11:59:38.269064 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9b194acd-53bc-4409-92db-50e92f4cf73c tempest-FloatingIPsNegativeTestJSON-338711019 tempest-FloatingIPsNegativeTestJSON-338711019-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/08c1e7b1-1ee1-4b6e-ac48-c4058c3970f4" status: 404 len: 111 microversion: 2.1 time: 0.102435 Jul 12 11:59:38.271506 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1245/2317] 10.222.0.50 () {58 vars in 1262 bytes} [Tue Jul 12 11:59:38 2022] DELETE /compute/v2.1/os-floating-ips/08c1e7b1-1ee1-4b6e-ac48-c4058c3970f4 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 11:59:38.552875 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-83537513-c54a-46e5-9027-4ce9aeb8946b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:38.553936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-83537513-c54a-46e5-9027-4ce9aeb8946b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:38.574006 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83537513-c54a-46e5-9027-4ce9aeb8946b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:38.580595 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83537513-c54a-46e5-9027-4ce9aeb8946b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:38.584727 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83537513-c54a-46e5-9027-4ce9aeb8946b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:38.586952 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83537513-c54a-46e5-9027-4ce9aeb8946b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:38.656809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-147752e1-e1ae-4f69-a610-a3193e9e4977 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:38.678339 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-147752e1-e1ae-4f69-a610-a3193e9e4977 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1321 microversion: 2.1 time: 0.827634 Jul 12 11:59:38.680375 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1073/2318] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:37 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1321 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:59:39.700779 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f4b489c8-4964-4bea-ab6e-0e74b20179ac tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:39.701861 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f4b489c8-4964-4bea-ab6e-0e74b20179ac tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:39.719432 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f4b489c8-4964-4bea-ab6e-0e74b20179ac tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:39.719930 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f4b489c8-4964-4bea-ab6e-0e74b20179ac tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:39.723896 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f4b489c8-4964-4bea-ab6e-0e74b20179ac tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:39.724459 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f4b489c8-4964-4bea-ab6e-0e74b20179ac tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:39.793667 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-83537513-c54a-46e5-9027-4ce9aeb8946b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:39.826613 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-83537513-c54a-46e5-9027-4ce9aeb8946b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:39.832912 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-83537513-c54a-46e5-9027-4ce9aeb8946b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:39.841890 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-83537513-c54a-46e5-9027-4ce9aeb8946b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.295738 Jul 12 11:59:39.850260 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1246/2319] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:38 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:40.074960 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f4b489c8-4964-4bea-ab6e-0e74b20179ac tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:40.086869 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f4b489c8-4964-4bea-ab6e-0e74b20179ac tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1321 microversion: 2.1 time: 0.390471 Jul 12 11:59:40.088679 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1074/2320] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:39 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:40.869345 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-97858419-0126-4e1e-866b-6cda6d1b72ec tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:40.870767 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-97858419-0126-4e1e-866b-6cda6d1b72ec tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:40.911113 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-97858419-0126-4e1e-866b-6cda6d1b72ec tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:40.911953 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-97858419-0126-4e1e-866b-6cda6d1b72ec tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:40.913632 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-97858419-0126-4e1e-866b-6cda6d1b72ec tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:40.926566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-97858419-0126-4e1e-866b-6cda6d1b72ec tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:41.048992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:41.112498 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f89c4c6f-7a6f-49c7-b42e-18f1d8866d1e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:41.113356 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f89c4c6f-7a6f-49c7-b42e-18f1d8866d1e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:41.137136 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f89c4c6f-7a6f-49c7-b42e-18f1d8866d1e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:41.137922 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f89c4c6f-7a6f-49c7-b42e-18f1d8866d1e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:41.141875 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f89c4c6f-7a6f-49c7-b42e-18f1d8866d1e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:41.143102 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f89c4c6f-7a6f-49c7-b42e-18f1d8866d1e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:41.558451 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:41.653061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-97858419-0126-4e1e-866b-6cda6d1b72ec tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:41.670283 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-97858419-0126-4e1e-866b-6cda6d1b72ec tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:41.671848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-97858419-0126-4e1e-866b-6cda6d1b72ec tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:41.674853 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-97858419-0126-4e1e-866b-6cda6d1b72ec tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.814870 Jul 12 11:59:41.675431 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1247/2321] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:40 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:41.831301 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f89c4c6f-7a6f-49c7-b42e-18f1d8866d1e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:41.854570 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f89c4c6f-7a6f-49c7-b42e-18f1d8866d1e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1321 microversion: 2.1 time: 0.752706 Jul 12 11:59:41.857461 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1075/2322] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:41 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1321 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:59:42.699003 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-320b2255-a58a-4fe5-b768-6032bc4b608b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:42.704699 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-320b2255-a58a-4fe5-b768-6032bc4b608b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:42.719420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-320b2255-a58a-4fe5-b768-6032bc4b608b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:42.724595 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-320b2255-a58a-4fe5-b768-6032bc4b608b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:42.725605 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-320b2255-a58a-4fe5-b768-6032bc4b608b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:42.730711 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-320b2255-a58a-4fe5-b768-6032bc4b608b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:42.873515 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-283edefc-74e8-4f9d-b6ca-39429e6c7298 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:42.875141 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-283edefc-74e8-4f9d-b6ca-39429e6c7298 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:42.887740 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-283edefc-74e8-4f9d-b6ca-39429e6c7298 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:42.888405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-283edefc-74e8-4f9d-b6ca-39429e6c7298 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:42.894401 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-283edefc-74e8-4f9d-b6ca-39429e6c7298 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:42.895477 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-283edefc-74e8-4f9d-b6ca-39429e6c7298 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:43.541771 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-320b2255-a58a-4fe5-b768-6032bc4b608b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:43.553500 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-320b2255-a58a-4fe5-b768-6032bc4b608b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:43.556707 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-320b2255-a58a-4fe5-b768-6032bc4b608b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:43.558423 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-320b2255-a58a-4fe5-b768-6032bc4b608b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.866678 Jul 12 11:59:43.559263 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1248/2323] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:42 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:44.122584 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-3056d632-ddf8-442a-b71f-2e002583ceae req-4c913b16-3c94-4a08-be95-d41d85b608d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8ece58-3fc8-42d8-b049-038b865159ae", "name": "network-vif-plugged", "status": "completed", "tag": "4398a787-b528-4504-953e-274211d152cb"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:44.146742 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-3056d632-ddf8-442a-b71f-2e002583ceae req-4c913b16-3c94-4a08-be95-d41d85b608d5 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:44.150520 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-3056d632-ddf8-442a-b71f-2e002583ceae req-4c913b16-3c94-4a08-be95-d41d85b608d5 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:44.224087 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-3056d632-ddf8-442a-b71f-2e002583ceae req-4c913b16-3c94-4a08-be95-d41d85b608d5 service nova] Creating event network-vif-plugged:4398a787-b528-4504-953e-274211d152cb for instance 5d8ece58-3fc8-42d8-b049-038b865159ae on n-h2-849104-4 Jul 12 11:59:44.233900 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-3056d632-ddf8-442a-b71f-2e002583ceae req-4c913b16-3c94-4a08-be95-d41d85b608d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117237 Jul 12 11:59:44.254880 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1249/2324] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 11:59:44.274696 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=8 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:44.387394 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-302f8345-d813-45c4-9044-87df940cfd89 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:44.388484 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-302f8345-d813-45c4-9044-87df940cfd89 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:44.404843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-302f8345-d813-45c4-9044-87df940cfd89 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:44.410814 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-302f8345-d813-45c4-9044-87df940cfd89 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:44.411675 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-302f8345-d813-45c4-9044-87df940cfd89 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:44.412182 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-302f8345-d813-45c4-9044-87df940cfd89 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:44.452913 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-283edefc-74e8-4f9d-b6ca-39429e6c7298 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:44.470281 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-283edefc-74e8-4f9d-b6ca-39429e6c7298 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1321 microversion: 2.1 time: 1.598696 Jul 12 11:59:44.470955 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1076/2325] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:42 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1321 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:59:44.580433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-51857c3a-91ea-4f25-8c55-e8faaf2f7806 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:44.581304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-51857c3a-91ea-4f25-8c55-e8faaf2f7806 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:44.596772 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-51857c3a-91ea-4f25-8c55-e8faaf2f7806 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:44.597507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-51857c3a-91ea-4f25-8c55-e8faaf2f7806 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:44.601454 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-51857c3a-91ea-4f25-8c55-e8faaf2f7806 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:44.602127 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-51857c3a-91ea-4f25-8c55-e8faaf2f7806 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:45.247476 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-51857c3a-91ea-4f25-8c55-e8faaf2f7806 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:45.262970 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-51857c3a-91ea-4f25-8c55-e8faaf2f7806 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:45.264344 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-51857c3a-91ea-4f25-8c55-e8faaf2f7806 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:45.265557 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-51857c3a-91ea-4f25-8c55-e8faaf2f7806 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.690117 Jul 12 11:59:45.266628 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1077/2326] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:44 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 11:59:45.425681 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-787941171", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "85fd9913-7891-4fb3-9cb0-ce9b9c8a7564"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:45.539594 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] validate_networks() for [('85fd9913-7891-4fb3-9cb0-ce9b9c8a7564', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 11:59:45.553751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-302f8345-d813-45c4-9044-87df940cfd89 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:45.601330 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-302f8345-d813-45c4-9044-87df940cfd89 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:45.639127 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-302f8345-d813-45c4-9044-87df940cfd89 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:45.640725 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-302f8345-d813-45c4-9044-87df940cfd89 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 2955 microversion: 2.42 time: 1.258996 Jul 12 11:59:45.647233 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1250/2327] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:44 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 2955 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:45.669605 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b41adc9e-4856-48db-a519-069fbb56d1eb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:45.670241 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b41adc9e-4856-48db-a519-069fbb56d1eb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:45.697818 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b41adc9e-4856-48db-a519-069fbb56d1eb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:45.701054 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b41adc9e-4856-48db-a519-069fbb56d1eb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:45.702229 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b41adc9e-4856-48db-a519-069fbb56d1eb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:45.702554 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b41adc9e-4856-48db-a519-069fbb56d1eb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:46.926231 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b41adc9e-4856-48db-a519-069fbb56d1eb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:46.939077 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b41adc9e-4856-48db-a519-069fbb56d1eb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1321 microversion: 2.1 time: 1.290594 Jul 12 11:59:46.939697 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1251/2328] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:45 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1321 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:46.957581 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8fa6d152-694a-489b-8c1e-2743afb38022 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:46.958447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8fa6d152-694a-489b-8c1e-2743afb38022 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:46.965685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8fa6d152-694a-489b-8c1e-2743afb38022 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:46.966466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8fa6d152-694a-489b-8c1e-2743afb38022 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:46.967987 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8fa6d152-694a-489b-8c1e-2743afb38022 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:46.968625 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8fa6d152-694a-489b-8c1e-2743afb38022 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:47.021617 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 11:59:47.022084 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 11:59:47.022502 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 11:59:47.023249 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 11:59:47.023574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 11:59:47.044848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:47.046065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:47.047147 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:47.047595 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:47.092157 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Getting quotas for project 89c9205141214d3fa861f126077d83ff. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 11:59:47.100005 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Getting quotas for user 22a7fbaa31544f9cb741b7c102466c1d and project 89c9205141214d3fa861f126077d83ff. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 11:59:47.140577 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 11:59:47.147581 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 11:59:47.259845 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ed8a930b-98a8-436b-96d8-19ea33a620ff tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.992354 Jul 12 11:59:47.266919 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1078/2329] 10.222.0.50 () {62 vars in 1187 bytes} [Tue Jul 12 11:59:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 11:59:47.288345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-032b93f6-4243-4641-8e4d-567ff1aa258e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:47.288997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-032b93f6-4243-4641-8e4d-567ff1aa258e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:47.320695 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-032b93f6-4243-4641-8e4d-567ff1aa258e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:47.324817 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-032b93f6-4243-4641-8e4d-567ff1aa258e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:47.325685 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-032b93f6-4243-4641-8e4d-567ff1aa258e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:47.326312 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-032b93f6-4243-4641-8e4d-567ff1aa258e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:47.398626 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8fa6d152-694a-489b-8c1e-2743afb38022 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.446716 Jul 12 11:59:47.399807 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1252/2330] 10.222.0.50 () {60 vars in 1315 bytes} [Tue Jul 12 11:59:46 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725/os-interface => generated 1831 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:47.404933 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cdc74fbb-2b82-4367-af57-51e31103f149 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:47.405803 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cdc74fbb-2b82-4367-af57-51e31103f149 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:47.672314 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cdc74fbb-2b82-4367-af57-51e31103f149 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:47.705480 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cdc74fbb-2b82-4367-af57-51e31103f149 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:47.707244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cdc74fbb-2b82-4367-af57-51e31103f149 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:47.708409 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cdc74fbb-2b82-4367-af57-51e31103f149 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1258 microversion: 2.21 time: 0.307343 Jul 12 11:59:47.712478 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1253/2331] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:47 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1258 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:47.960297 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d7e00337-3626-492f-bd91-d2fc066915dc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:47.963121 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d7e00337-3626-492f-bd91-d2fc066915dc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:47.972887 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-032b93f6-4243-4641-8e4d-567ff1aa258e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:47.991635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d7e00337-3626-492f-bd91-d2fc066915dc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:48.023110 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d7e00337-3626-492f-bd91-d2fc066915dc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:48.024663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d7e00337-3626-492f-bd91-d2fc066915dc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:48.030894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d7e00337-3626-492f-bd91-d2fc066915dc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:48.042841 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-032b93f6-4243-4641-8e4d-567ff1aa258e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:48.062878 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-032b93f6-4243-4641-8e4d-567ff1aa258e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:48.076622 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-032b93f6-4243-4641-8e4d-567ff1aa258e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.803686 Jul 12 11:59:48.087155 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1079/2332] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:47 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:48.734789 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0935aa33-2806-4f99-863a-74fee6659c1a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:48.737289 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0935aa33-2806-4f99-863a-74fee6659c1a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:48.756790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0935aa33-2806-4f99-863a-74fee6659c1a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:48.757671 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0935aa33-2806-4f99-863a-74fee6659c1a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:48.758698 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0935aa33-2806-4f99-863a-74fee6659c1a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:48.760007 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0935aa33-2806-4f99-863a-74fee6659c1a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:49.190033 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0935aa33-2806-4f99-863a-74fee6659c1a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:49.231303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0935aa33-2806-4f99-863a-74fee6659c1a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:49.238095 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0935aa33-2806-4f99-863a-74fee6659c1a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:49.242356 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0935aa33-2806-4f99-863a-74fee6659c1a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1262 microversion: 2.21 time: 0.516576 Jul 12 11:59:49.261786 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1080/2333] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:48 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1262 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:49.269197 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-11af1f80-ce8c-47a6-8127-e3f7361d55a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:49.270146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-11af1f80-ce8c-47a6-8127-e3f7361d55a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:49.278268 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11af1f80-ce8c-47a6-8127-e3f7361d55a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:49.279103 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11af1f80-ce8c-47a6-8127-e3f7361d55a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:49.280151 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11af1f80-ce8c-47a6-8127-e3f7361d55a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:49.280758 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11af1f80-ce8c-47a6-8127-e3f7361d55a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:49.292935 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d7e00337-3626-492f-bd91-d2fc066915dc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:49.311652 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d7e00337-3626-492f-bd91-d2fc066915dc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1511 microversion: 2.1 time: 1.358206 Jul 12 11:59:49.328841 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1254/2334] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:47 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1511 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:59:49.334421 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6e14636c-0d3a-4c8d-8761-f79ce30343bc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:49.335311 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6e14636c-0d3a-4c8d-8761-f79ce30343bc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:49.347516 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6e14636c-0d3a-4c8d-8761-f79ce30343bc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:49.347980 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6e14636c-0d3a-4c8d-8761-f79ce30343bc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:49.348795 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6e14636c-0d3a-4c8d-8761-f79ce30343bc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:49.361132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6e14636c-0d3a-4c8d-8761-f79ce30343bc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:50.167205 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6e14636c-0d3a-4c8d-8761-f79ce30343bc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:50.190353 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6e14636c-0d3a-4c8d-8761-f79ce30343bc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1510 microversion: 2.1 time: 0.859700 Jul 12 11:59:50.191846 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1255/2335] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:49 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1510 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:50.221814 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3c771394-3832-418e-bc0b-37d49bac6cd5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:50.223791 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3c771394-3832-418e-bc0b-37d49bac6cd5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:50.238806 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c771394-3832-418e-bc0b-37d49bac6cd5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:50.239537 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c771394-3832-418e-bc0b-37d49bac6cd5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:50.240589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c771394-3832-418e-bc0b-37d49bac6cd5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:50.241410 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c771394-3832-418e-bc0b-37d49bac6cd5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:50.277728 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-11af1f80-ce8c-47a6-8127-e3f7361d55a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:50.300816 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-11af1f80-ce8c-47a6-8127-e3f7361d55a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:50.303487 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-11af1f80-ce8c-47a6-8127-e3f7361d55a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:50.304979 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-11af1f80-ce8c-47a6-8127-e3f7361d55a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.041875 Jul 12 11:59:50.305749 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1081/2336] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:49 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:50.312957 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b3748537-3faa-4a76-bc06-d677c294c845 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:50.313946 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b3748537-3faa-4a76-bc06-d677c294c845 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:50.321737 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3748537-3faa-4a76-bc06-d677c294c845 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:50.324598 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3748537-3faa-4a76-bc06-d677c294c845 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:50.332425 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3748537-3faa-4a76-bc06-d677c294c845 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:50.333316 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b3748537-3faa-4a76-bc06-d677c294c845 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:50.788181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3c771394-3832-418e-bc0b-37d49bac6cd5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:50.799972 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3c771394-3832-418e-bc0b-37d49bac6cd5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 200 len: 1321 microversion: 2.1 time: 0.584728 Jul 12 11:59:50.802058 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1256/2337] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:50 2022] GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 1321 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:50.861016 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b3748537-3faa-4a76-bc06-d677c294c845 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:50.884363 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b3748537-3faa-4a76-bc06-d677c294c845 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:50.890835 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b3748537-3faa-4a76-bc06-d677c294c845 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:50.894869 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b3748537-3faa-4a76-bc06-d677c294c845 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1316 microversion: 2.21 time: 0.587401 Jul 12 11:59:50.899420 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1082/2338] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:50 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:51.346598 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d19444f6-8475-453d-81d1-01234fb6c094 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:51.348403 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d19444f6-8475-453d-81d1-01234fb6c094 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:51.356104 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=46 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:51.387492 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d19444f6-8475-453d-81d1-01234fb6c094 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:51.393798 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d19444f6-8475-453d-81d1-01234fb6c094 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:51.399422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d19444f6-8475-453d-81d1-01234fb6c094 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:51.400325 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d19444f6-8475-453d-81d1-01234fb6c094 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:51.828556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-80cbfe41-0465-488c-ba56-07c3740dc746 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:51.834400 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-80cbfe41-0465-488c-ba56-07c3740dc746 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:51.893544 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80cbfe41-0465-488c-ba56-07c3740dc746 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:51.898177 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80cbfe41-0465-488c-ba56-07c3740dc746 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:51.908952 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80cbfe41-0465-488c-ba56-07c3740dc746 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:51.918449 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80cbfe41-0465-488c-ba56-07c3740dc746 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:52.468711 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d19444f6-8475-453d-81d1-01234fb6c094 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:52.502744 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d19444f6-8475-453d-81d1-01234fb6c094 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:52.514474 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d19444f6-8475-453d-81d1-01234fb6c094 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:52.517829 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d19444f6-8475-453d-81d1-01234fb6c094 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.187052 Jul 12 11:59:52.535273 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1257/2339] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:51 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:52.556573 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-20e6d02f-a603-4bb6-a143-cd6b8bb05697 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:52.557736 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-20e6d02f-a603-4bb6-a143-cd6b8bb05697 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:52.588875 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20e6d02f-a603-4bb6-a143-cd6b8bb05697 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:52.596511 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20e6d02f-a603-4bb6-a143-cd6b8bb05697 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:52.601016 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20e6d02f-a603-4bb6-a143-cd6b8bb05697 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:52.601779 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20e6d02f-a603-4bb6-a143-cd6b8bb05697 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:52.898994 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-20e6d02f-a603-4bb6-a143-cd6b8bb05697 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:52.912809 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-20e6d02f-a603-4bb6-a143-cd6b8bb05697 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:52.920103 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-20e6d02f-a603-4bb6-a143-cd6b8bb05697 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:52.929673 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-20e6d02f-a603-4bb6-a143-cd6b8bb05697 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1316 microversion: 2.21 time: 0.390021 Jul 12 11:59:52.933652 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1258/2340] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:52 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1316 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:53.543822 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9046b63b-04a1-4753-a89a-25782b542604 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:53.545185 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9046b63b-04a1-4753-a89a-25782b542604 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:53.556389 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9046b63b-04a1-4753-a89a-25782b542604 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:53.576208 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9046b63b-04a1-4753-a89a-25782b542604 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:53.583824 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9046b63b-04a1-4753-a89a-25782b542604 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:53.584957 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9046b63b-04a1-4753-a89a-25782b542604 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:54.574611 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9046b63b-04a1-4753-a89a-25782b542604 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:54.596983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9046b63b-04a1-4753-a89a-25782b542604 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:54.600955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9046b63b-04a1-4753-a89a-25782b542604 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:54.603153 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9046b63b-04a1-4753-a89a-25782b542604 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.064329 Jul 12 11:59:54.604843 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1259/2341] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:53 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:54.610449 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a7ac5d2a-4ca6-4127-aa0f-86934ae42a3c tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:54.611854 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a7ac5d2a-4ca6-4127-aa0f-86934ae42a3c tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:54.622250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7ac5d2a-4ca6-4127-aa0f-86934ae42a3c tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:54.622965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7ac5d2a-4ca6-4127-aa0f-86934ae42a3c tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:54.624541 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7ac5d2a-4ca6-4127-aa0f-86934ae42a3c tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:54.625583 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a7ac5d2a-4ca6-4127-aa0f-86934ae42a3c tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:54.810326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-80cbfe41-0465-488c-ba56-07c3740dc746 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:54.839513 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-80cbfe41-0465-488c-ba56-07c3740dc746 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 200 len: 1321 microversion: 2.1 time: 3.017783 Jul 12 11:59:54.844128 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1083/2342] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:51 2022] GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 1321 bytes in 3022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 11:59:54.862507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7bd04447-79b7-45f6-899a-b8f960f70560 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:54.863629 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7bd04447-79b7-45f6-899a-b8f960f70560 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:54.909767 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7bd04447-79b7-45f6-899a-b8f960f70560 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:54.910232 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7bd04447-79b7-45f6-899a-b8f960f70560 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:54.919411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7bd04447-79b7-45f6-899a-b8f960f70560 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:54.919885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7bd04447-79b7-45f6-899a-b8f960f70560 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:54.939120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-a7ac5d2a-4ca6-4127-aa0f-86934ae42a3c tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'services' on Instance uuid b26b640d-3b19-492b-99f2-4c0cb3c10c25 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:59:55.002475 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a7ac5d2a-4ca6-4127-aa0f-86934ae42a3c tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 2424 microversion: 2.25 time: 0.396198 Jul 12 11:59:55.009823 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1260/2343] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:54 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 2424 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:55.033105 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a869eace-cad0-4d78-847c-7e7ad650d508 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-849104-4", "block_migration": "auto"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:55.035147 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a869eace-cad0-4d78-847c-7e7ad650d508 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:55.060075 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a869eace-cad0-4d78-847c-7e7ad650d508 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:55.067476 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a869eace-cad0-4d78-847c-7e7ad650d508 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:55.069391 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a869eace-cad0-4d78-847c-7e7ad650d508 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:55.072004 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a869eace-cad0-4d78-847c-7e7ad650d508 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:55.588292 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7bd04447-79b7-45f6-899a-b8f960f70560 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:55.635689 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7bd04447-79b7-45f6-899a-b8f960f70560 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:55.645974 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7bd04447-79b7-45f6-899a-b8f960f70560 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:55.653485 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7bd04447-79b7-45f6-899a-b8f960f70560 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1316 microversion: 2.21 time: 0.806153 Jul 12 11:59:55.680709 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1084/2344] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:54 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1316 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:55.701349 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e8778b7b-5d85-4fc5-9adb-abec96f7ccb6 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:55.705123 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e8778b7b-5d85-4fc5-9adb-abec96f7ccb6 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:55.737472 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8778b7b-5d85-4fc5-9adb-abec96f7ccb6 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:55.742295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8778b7b-5d85-4fc5-9adb-abec96f7ccb6 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:55.745250 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8778b7b-5d85-4fc5-9adb-abec96f7ccb6 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:55.747847 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8778b7b-5d85-4fc5-9adb-abec96f7ccb6 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:55.796279 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-a869eace-cad0-4d78-847c-7e7ad650d508 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'flavor' on Instance uuid b26b640d-3b19-492b-99f2-4c0cb3c10c25 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 11:59:55.873118 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:55.891723 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a869eace-cad0-4d78-847c-7e7ad650d508 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Going to try to live migrate instance to n-h1-849104-4 {{(pid=125984) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 12 11:59:57.071209 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:57.123230 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=6 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:57.573876 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e8778b7b-5d85-4fc5-9adb-abec96f7ccb6 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:57.632392 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e8778b7b-5d85-4fc5-9adb-abec96f7ccb6 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:57.646692 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e8778b7b-5d85-4fc5-9adb-abec96f7ccb6 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:57.648216 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e8778b7b-5d85-4fc5-9adb-abec96f7ccb6 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.970261 Jul 12 11:59:57.661721 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1085/2345] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:55 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:57.673370 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4eb85271-9bc0-4632-b084-9c998eaaa9aa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:57.678926 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4eb85271-9bc0-4632-b084-9c998eaaa9aa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:57.683452 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 11:59:57.722746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4eb85271-9bc0-4632-b084-9c998eaaa9aa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:57.724829 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4eb85271-9bc0-4632-b084-9c998eaaa9aa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:57.728578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4eb85271-9bc0-4632-b084-9c998eaaa9aa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:57.732570 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4eb85271-9bc0-4632-b084-9c998eaaa9aa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:58.541024 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4eb85271-9bc0-4632-b084-9c998eaaa9aa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:58.567991 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4eb85271-9bc0-4632-b084-9c998eaaa9aa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 200 len: 1321 microversion: 2.1 time: 0.900959 Jul 12 11:59:58.587244 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1086/2346] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 11:59:57 2022] GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 1321 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 11:59:58.604670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-023aa30a-6a79-4de1-858a-b6c341ed0092 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:58.611523 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-023aa30a-6a79-4de1-858a-b6c341ed0092 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:58.652497 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-023aa30a-6a79-4de1-858a-b6c341ed0092 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:58.654398 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-023aa30a-6a79-4de1-858a-b6c341ed0092 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:58.658692 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-023aa30a-6a79-4de1-858a-b6c341ed0092 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:58.660335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-023aa30a-6a79-4de1-858a-b6c341ed0092 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:59.198097 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-023aa30a-6a79-4de1-858a-b6c341ed0092 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:59.238544 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-023aa30a-6a79-4de1-858a-b6c341ed0092 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:59.245811 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-023aa30a-6a79-4de1-858a-b6c341ed0092 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 11:59:59.250292 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-023aa30a-6a79-4de1-858a-b6c341ed0092 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1358 microversion: 2.21 time: 0.658552 Jul 12 11:59:59.256746 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1087/2347] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:58 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1358 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 11:59:59.302516 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-4fe6b4dd-459f-4a3b-b8be-e35c303dec47 req-e376d47e-44ba-4cd0-af27-c2ea913cedc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-plugged", "status": "completed", "tag": "62d08446-a99d-4f41-bebb-6117d86305fb"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 11:59:59.336294 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4fe6b4dd-459f-4a3b-b8be-e35c303dec47 req-e376d47e-44ba-4cd0-af27-c2ea913cedc7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:59.341507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4fe6b4dd-459f-4a3b-b8be-e35c303dec47 req-e376d47e-44ba-4cd0-af27-c2ea913cedc7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:59.377646 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-4fe6b4dd-459f-4a3b-b8be-e35c303dec47 req-e376d47e-44ba-4cd0-af27-c2ea913cedc7 service nova] Creating event network-vif-plugged:62d08446-a99d-4f41-bebb-6117d86305fb for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 11:59:59.391862 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-4fe6b4dd-459f-4a3b-b8be-e35c303dec47 req-e376d47e-44ba-4cd0-af27-c2ea913cedc7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131613 Jul 12 11:59:59.393453 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1088/2348] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 11:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 11:59:59.408380 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d277b3a5-7403-42f8-a988-a29561867f1d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 11:59:59.409864 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d277b3a5-7403-42f8-a988-a29561867f1d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 11:59:59.426385 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d277b3a5-7403-42f8-a988-a29561867f1d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:59.427319 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d277b3a5-7403-42f8-a988-a29561867f1d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 11:59:59.432856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d277b3a5-7403-42f8-a988-a29561867f1d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 11:59:59.434890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d277b3a5-7403-42f8-a988-a29561867f1d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:00.483065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d277b3a5-7403-42f8-a988-a29561867f1d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:00.516023 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d277b3a5-7403-42f8-a988-a29561867f1d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:00.522322 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d277b3a5-7403-42f8-a988-a29561867f1d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:00.523707 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d277b3a5-7403-42f8-a988-a29561867f1d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.123756 Jul 12 12:00:00.524972 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1089/2349] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 11:59:59 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:00.543814 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-dcc4ec71-08a3-4169-a88e-f2f002766a37 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:00.545437 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-dcc4ec71-08a3-4169-a88e-f2f002766a37 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:00.572730 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dcc4ec71-08a3-4169-a88e-f2f002766a37 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:00.583727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dcc4ec71-08a3-4169-a88e-f2f002766a37 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:00.588941 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dcc4ec71-08a3-4169-a88e-f2f002766a37 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:00.590254 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dcc4ec71-08a3-4169-a88e-f2f002766a37 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:01.228842 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-dcc4ec71-08a3-4169-a88e-f2f002766a37 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:01.255131 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-dcc4ec71-08a3-4169-a88e-f2f002766a37 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 200 len: 1321 microversion: 2.1 time: 0.726896 Jul 12 12:00:01.259756 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1090/2350] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:00 2022] GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 1321 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:01.288367 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-deb4f49b-c0ef-4f32-a0a6-692f7361d0e5 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:01.293097 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-deb4f49b-c0ef-4f32-a0a6-692f7361d0e5 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:01.322725 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-deb4f49b-c0ef-4f32-a0a6-692f7361d0e5 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:01.328634 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-deb4f49b-c0ef-4f32-a0a6-692f7361d0e5 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:01.330181 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-deb4f49b-c0ef-4f32-a0a6-692f7361d0e5 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:01.335028 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-deb4f49b-c0ef-4f32-a0a6-692f7361d0e5 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:01.382291 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a869eace-cad0-4d78-847c-7e7ad650d508 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/action" status: 202 len: 0 microversion: 2.25 time: 6.354141 Jul 12 12:00:01.384092 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1261/2351] 10.222.0.50 () {62 vars in 1318 bytes} [Tue Jul 12 11:59:55 2022] POST /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/action => generated 0 bytes in 6357 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:00:01.394193 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-58608792-3a92-404a-bb3a-f75812230219 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:01.395435 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-58608792-3a92-404a-bb3a-f75812230219 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:01.432484 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58608792-3a92-404a-bb3a-f75812230219 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:01.433253 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58608792-3a92-404a-bb3a-f75812230219 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:01.436404 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58608792-3a92-404a-bb3a-f75812230219 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:01.438343 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-58608792-3a92-404a-bb3a-f75812230219 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:02.139937 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-58608792-3a92-404a-bb3a-f75812230219 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:02.213257 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-58608792-3a92-404a-bb3a-f75812230219 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:02.219118 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-58608792-3a92-404a-bb3a-f75812230219 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:02.220414 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-58608792-3a92-404a-bb3a-f75812230219 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.831050 Jul 12 12:00:02.232756 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1262/2352] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:01 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:00:02.247721 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1d0a59be-24ae-47e7-a493-922126635f78 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:02.249513 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1d0a59be-24ae-47e7-a493-922126635f78 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:02.257123 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1d0a59be-24ae-47e7-a493-922126635f78 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:02.257583 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1d0a59be-24ae-47e7-a493-922126635f78 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:02.258378 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1d0a59be-24ae-47e7-a493-922126635f78 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:02.258909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1d0a59be-24ae-47e7-a493-922126635f78 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:02.279052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:02.334096 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-deb4f49b-c0ef-4f32-a0a6-692f7361d0e5 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:02.366907 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-deb4f49b-c0ef-4f32-a0a6-692f7361d0e5 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:02.376567 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-deb4f49b-c0ef-4f32-a0a6-692f7361d0e5 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:02.382125 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-deb4f49b-c0ef-4f32-a0a6-692f7361d0e5 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1358 microversion: 2.21 time: 1.118057 Jul 12 12:00:02.398607 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1091/2353] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:01 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1358 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:02.417440 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-2237adf8-3cd4-4d58-85b1-7fb729d6050d req-632e4676-34f3-47d9-881f-8e1e0af30e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-plugged", "status": "completed", "tag": "a0d155ae-ac1b-49ea-b8e9-248ed51e6471"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:02.452193 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-2237adf8-3cd4-4d58-85b1-7fb729d6050d req-632e4676-34f3-47d9-881f-8e1e0af30e92 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:02.455071 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-2237adf8-3cd4-4d58-85b1-7fb729d6050d req-632e4676-34f3-47d9-881f-8e1e0af30e92 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:02.493369 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-2237adf8-3cd4-4d58-85b1-7fb729d6050d req-632e4676-34f3-47d9-881f-8e1e0af30e92 service nova] Creating event network-vif-plugged:a0d155ae-ac1b-49ea-b8e9-248ed51e6471 for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:00:02.521828 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-2237adf8-3cd4-4d58-85b1-7fb729d6050d req-632e4676-34f3-47d9-881f-8e1e0af30e92 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116924 Jul 12 12:00:02.527147 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1092/2354] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:02.561596 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-6c391d5b-6217-4eb3-b3ad-75fafad44653 req-41586eb5-e9c1-41c5-8613-1977f799281e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd", "tag": "31aa98f4-2088-4064-96c5-9d8d63250784"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:02.588206 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-6c391d5b-6217-4eb3-b3ad-75fafad44653 req-41586eb5-e9c1-41c5-8613-1977f799281e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:02.590143 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-6c391d5b-6217-4eb3-b3ad-75fafad44653 req-41586eb5-e9c1-41c5-8613-1977f799281e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:02.632957 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-6c391d5b-6217-4eb3-b3ad-75fafad44653 req-41586eb5-e9c1-41c5-8613-1977f799281e service nova] Creating event network-changed:31aa98f4-2088-4064-96c5-9d8d63250784 for instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd on n-h1-849104-4 Jul 12 12:00:02.646903 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-6c391d5b-6217-4eb3-b3ad-75fafad44653 req-41586eb5-e9c1-41c5-8613-1977f799281e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113867 Jul 12 12:00:02.647754 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1093/2355] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:02.663811 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a0b5cd24-1121-4090-a795-efdaa41b127b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:02.665715 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a0b5cd24-1121-4090-a795-efdaa41b127b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:02.686562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a0b5cd24-1121-4090-a795-efdaa41b127b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:02.689239 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a0b5cd24-1121-4090-a795-efdaa41b127b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:02.690209 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a0b5cd24-1121-4090-a795-efdaa41b127b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:02.691351 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a0b5cd24-1121-4090-a795-efdaa41b127b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:03.201107 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1d0a59be-24ae-47e7-a493-922126635f78 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:03.212582 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1d0a59be-24ae-47e7-a493-922126635f78 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:03.223837 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1d0a59be-24ae-47e7-a493-922126635f78 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:03.225667 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1d0a59be-24ae-47e7-a493-922126635f78 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.989148 Jul 12 12:00:03.228444 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1263/2356] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:02 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:03.246358 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2badae35-c210-4def-bb08-fa39e67a869f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:03.247492 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2badae35-c210-4def-bb08-fa39e67a869f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:03.259784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2badae35-c210-4def-bb08-fa39e67a869f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:03.260715 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2badae35-c210-4def-bb08-fa39e67a869f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:03.265617 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2badae35-c210-4def-bb08-fa39e67a869f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:03.266305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2badae35-c210-4def-bb08-fa39e67a869f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:03.506036 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a0b5cd24-1121-4090-a795-efdaa41b127b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:03.522059 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a0b5cd24-1121-4090-a795-efdaa41b127b tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 200 len: 1321 microversion: 2.1 time: 0.870879 Jul 12 12:00:03.522656 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1094/2357] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:02 2022] GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 1321 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:03.527505 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ffe74c10-8052-486d-a782-41a77975d9cc tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:03.528170 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ffe74c10-8052-486d-a782-41a77975d9cc tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:03.551399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ffe74c10-8052-486d-a782-41a77975d9cc tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:03.554651 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ffe74c10-8052-486d-a782-41a77975d9cc tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:03.563453 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ffe74c10-8052-486d-a782-41a77975d9cc tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:03.564246 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ffe74c10-8052-486d-a782-41a77975d9cc tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:03.956155 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ffe74c10-8052-486d-a782-41a77975d9cc tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:03.965325 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ffe74c10-8052-486d-a782-41a77975d9cc tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:03.966901 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ffe74c10-8052-486d-a782-41a77975d9cc tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:03.975889 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ffe74c10-8052-486d-a782-41a77975d9cc tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1358 microversion: 2.21 time: 0.452138 Jul 12 12:00:03.980273 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1095/2358] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:03 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1358 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:04.040756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2badae35-c210-4def-bb08-fa39e67a869f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:04.077532 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2badae35-c210-4def-bb08-fa39e67a869f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:04.089722 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2badae35-c210-4def-bb08-fa39e67a869f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:04.091210 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2badae35-c210-4def-bb08-fa39e67a869f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.849234 Jul 12 12:00:04.094608 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1264/2359] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:03 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:00:04.252569 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-82a36f20-26d7-4f39-aa5a-340d2f4851cf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:04.253557 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-82a36f20-26d7-4f39-aa5a-340d2f4851cf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:04.264915 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-82a36f20-26d7-4f39-aa5a-340d2f4851cf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:04.268751 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-82a36f20-26d7-4f39-aa5a-340d2f4851cf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:04.271517 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-82a36f20-26d7-4f39-aa5a-340d2f4851cf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:04.277069 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-82a36f20-26d7-4f39-aa5a-340d2f4851cf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:04.543721 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-74660644-798d-4eb4-b243-19b4cf8fea6f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:04.544621 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-74660644-798d-4eb4-b243-19b4cf8fea6f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:04.560228 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74660644-798d-4eb4-b243-19b4cf8fea6f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:04.561429 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74660644-798d-4eb4-b243-19b4cf8fea6f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:04.562324 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74660644-798d-4eb4-b243-19b4cf8fea6f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:04.564007 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74660644-798d-4eb4-b243-19b4cf8fea6f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:04.783617 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-82a36f20-26d7-4f39-aa5a-340d2f4851cf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:04.814779 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-82a36f20-26d7-4f39-aa5a-340d2f4851cf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:04.818814 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-82a36f20-26d7-4f39-aa5a-340d2f4851cf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:04.820316 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-82a36f20-26d7-4f39-aa5a-340d2f4851cf tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.572889 Jul 12 12:00:04.830737 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1096/2360] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:04 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:04.857117 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-2710c107-b0d8-473b-bafb-c96c23090a28 req-6dbb27e4-6077-4b1b-a0b3-d7e87b0fa4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e337b451-c995-432f-bfcf-c81b435abb3e", "name": "network-vif-plugged", "status": "completed", "tag": "a157f95c-3c36-4800-916f-7c7808bedeae"}, {"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-plugged", "status": "completed", "tag": "6e06bf3e-6215-4546-a454-04123539ab53"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:04.867967 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:04.902060 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-2710c107-b0d8-473b-bafb-c96c23090a28 req-6dbb27e4-6077-4b1b-a0b3-d7e87b0fa4b6 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:04.902902 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-2710c107-b0d8-473b-bafb-c96c23090a28 req-6dbb27e4-6077-4b1b-a0b3-d7e87b0fa4b6 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:04.925325 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-2710c107-b0d8-473b-bafb-c96c23090a28 req-6dbb27e4-6077-4b1b-a0b3-d7e87b0fa4b6 service nova] Creating event network-vif-plugged:a157f95c-3c36-4800-916f-7c7808bedeae for instance e337b451-c995-432f-bfcf-c81b435abb3e on n-h1-849104-4 Jul 12 12:00:04.926257 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-2710c107-b0d8-473b-bafb-c96c23090a28 req-6dbb27e4-6077-4b1b-a0b3-d7e87b0fa4b6 service nova] Creating event network-vif-plugged:6e06bf3e-6215-4546-a454-04123539ab53 for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:00:04.935305 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-2710c107-b0d8-473b-bafb-c96c23090a28 req-6dbb27e4-6077-4b1b-a0b3-d7e87b0fa4b6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102774 Jul 12 12:00:04.937095 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1097/2361] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:05.010082 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-490bffbc-893d-4e89-8df0-7ebbeff083da tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:05.015327 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-490bffbc-893d-4e89-8df0-7ebbeff083da tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:05.057391 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-490bffbc-893d-4e89-8df0-7ebbeff083da tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:05.057862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-490bffbc-893d-4e89-8df0-7ebbeff083da tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:05.058656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-490bffbc-893d-4e89-8df0-7ebbeff083da tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:05.061838 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-490bffbc-893d-4e89-8df0-7ebbeff083da tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:05.305060 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-74660644-798d-4eb4-b243-19b4cf8fea6f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:05.318987 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-74660644-798d-4eb4-b243-19b4cf8fea6f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 200 len: 1321 microversion: 2.1 time: 0.781225 Jul 12 12:00:05.335071 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1265/2362] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:04 2022] GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 1321 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:05.347337 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-237a0649-a557-4331-96ac-e8508ac487fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:05.369692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-237a0649-a557-4331-96ac-e8508ac487fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:05.378456 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-237a0649-a557-4331-96ac-e8508ac487fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:05.379202 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-237a0649-a557-4331-96ac-e8508ac487fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:05.380229 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-237a0649-a557-4331-96ac-e8508ac487fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:05.383005 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-237a0649-a557-4331-96ac-e8508ac487fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:05.724459 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-490bffbc-893d-4e89-8df0-7ebbeff083da tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:05.735686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-490bffbc-893d-4e89-8df0-7ebbeff083da tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:05.744100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-490bffbc-893d-4e89-8df0-7ebbeff083da tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:05.746321 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-490bffbc-893d-4e89-8df0-7ebbeff083da tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1358 microversion: 2.21 time: 0.739958 Jul 12 12:00:05.763520 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1098/2363] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:05 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1358 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:05.853834 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9b0db250-1ee4-4b64-a375-a75da0024a07 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:05.869186 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9b0db250-1ee4-4b64-a375-a75da0024a07 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:05.888479 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9b0db250-1ee4-4b64-a375-a75da0024a07 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:05.895593 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9b0db250-1ee4-4b64-a375-a75da0024a07 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:05.897916 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9b0db250-1ee4-4b64-a375-a75da0024a07 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:05.898692 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9b0db250-1ee4-4b64-a375-a75da0024a07 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:06.290084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-237a0649-a557-4331-96ac-e8508ac487fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:06.330201 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-237a0649-a557-4331-96ac-e8508ac487fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:06.339444 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-237a0649-a557-4331-96ac-e8508ac487fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:06.344178 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-237a0649-a557-4331-96ac-e8508ac487fd tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 1.007636 Jul 12 12:00:06.364128 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1266/2364] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:05 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:06.383592 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4b6eece6-c942-4ed8-8730-d8ddb3544a04 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:06.395160 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4b6eece6-c942-4ed8-8730-d8ddb3544a04 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:06.412703 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b6eece6-c942-4ed8-8730-d8ddb3544a04 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:06.413298 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b6eece6-c942-4ed8-8730-d8ddb3544a04 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:06.414324 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b6eece6-c942-4ed8-8730-d8ddb3544a04 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:06.414982 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4b6eece6-c942-4ed8-8730-d8ddb3544a04 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:06.957226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9b0db250-1ee4-4b64-a375-a75da0024a07 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:06.972639 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9b0db250-1ee4-4b64-a375-a75da0024a07 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:06.974322 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9b0db250-1ee4-4b64-a375-a75da0024a07 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:06.975572 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9b0db250-1ee4-4b64-a375-a75da0024a07 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.128609 Jul 12 12:00:07.006064 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1099/2365] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:05 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:07.037296 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1df5da1a-7423-450c-87bb-3952f3884c31 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:07.040322 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1df5da1a-7423-450c-87bb-3952f3884c31 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:07.050298 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1df5da1a-7423-450c-87bb-3952f3884c31 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:07.050956 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1df5da1a-7423-450c-87bb-3952f3884c31 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:07.051931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1df5da1a-7423-450c-87bb-3952f3884c31 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:07.052561 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1df5da1a-7423-450c-87bb-3952f3884c31 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:07.298222 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1df5da1a-7423-450c-87bb-3952f3884c31 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:07.310396 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1df5da1a-7423-450c-87bb-3952f3884c31 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:07.313958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1df5da1a-7423-450c-87bb-3952f3884c31 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:07.320089 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1df5da1a-7423-450c-87bb-3952f3884c31 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1358 microversion: 2.21 time: 0.312527 Jul 12 12:00:07.320720 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1100/2366] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:07 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:07.339377 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-e1465f3c-98ed-4682-9e6f-f2adce631e17 req-a1a6e675-c2ad-416a-81e9-c42843d027d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-plugged", "status": "completed", "tag": "7735c15f-29a4-4440-9e1b-3a9b16dafddb"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:07.352491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-e1465f3c-98ed-4682-9e6f-f2adce631e17 req-a1a6e675-c2ad-416a-81e9-c42843d027d3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:07.355109 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-e1465f3c-98ed-4682-9e6f-f2adce631e17 req-a1a6e675-c2ad-416a-81e9-c42843d027d3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:07.386957 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-e1465f3c-98ed-4682-9e6f-f2adce631e17 req-a1a6e675-c2ad-416a-81e9-c42843d027d3 service nova] Creating event network-vif-plugged:7735c15f-29a4-4440-9e1b-3a9b16dafddb for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:00:07.429433 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-e1465f3c-98ed-4682-9e6f-f2adce631e17 req-a1a6e675-c2ad-416a-81e9-c42843d027d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107053 Jul 12 12:00:07.439775 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1101/2367] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:07.461064 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ff40b6e7-3bed-49b1-a216-784d97a4141c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:07.464387 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ff40b6e7-3bed-49b1-a216-784d97a4141c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:07.483774 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff40b6e7-3bed-49b1-a216-784d97a4141c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:07.485247 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff40b6e7-3bed-49b1-a216-784d97a4141c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:07.487084 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff40b6e7-3bed-49b1-a216-784d97a4141c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:07.490985 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff40b6e7-3bed-49b1-a216-784d97a4141c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:07.831892 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ff40b6e7-3bed-49b1-a216-784d97a4141c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:07.891468 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ff40b6e7-3bed-49b1-a216-784d97a4141c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:07.896771 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ff40b6e7-3bed-49b1-a216-784d97a4141c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:07.900773 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ff40b6e7-3bed-49b1-a216-784d97a4141c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.459288 Jul 12 12:00:07.903311 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1102/2368] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:07 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:07.961833 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4b6eece6-c942-4ed8-8730-d8ddb3544a04 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:07.986133 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4b6eece6-c942-4ed8-8730-d8ddb3544a04 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 200 len: 1321 microversion: 2.1 time: 1.629640 Jul 12 12:00:07.988085 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1267/2369] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:06 2022] GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 1321 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:08.006790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2565959d-84ca-411d-a69d-a24e897608a5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:08.007496 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2565959d-84ca-411d-a69d-a24e897608a5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:08.019332 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2565959d-84ca-411d-a69d-a24e897608a5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:08.020232 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2565959d-84ca-411d-a69d-a24e897608a5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:08.021598 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2565959d-84ca-411d-a69d-a24e897608a5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:08.022203 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2565959d-84ca-411d-a69d-a24e897608a5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:08.344487 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-59aadf25-fb61-4568-ab5b-416313484a6f tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:08.345940 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-59aadf25-fb61-4568-ab5b-416313484a6f tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:08.358232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59aadf25-fb61-4568-ab5b-416313484a6f tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:08.361162 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59aadf25-fb61-4568-ab5b-416313484a6f tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:08.363935 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59aadf25-fb61-4568-ab5b-416313484a6f tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:08.364622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59aadf25-fb61-4568-ab5b-416313484a6f tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:08.440375 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2565959d-84ca-411d-a69d-a24e897608a5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:08.457497 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2565959d-84ca-411d-a69d-a24e897608a5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:08.459278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2565959d-84ca-411d-a69d-a24e897608a5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:08.460525 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2565959d-84ca-411d-a69d-a24e897608a5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.459372 Jul 12 12:00:08.469096 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1103/2370] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:07 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:08.871178 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-59aadf25-fb61-4568-ab5b-416313484a6f tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:08.885000 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-59aadf25-fb61-4568-ab5b-416313484a6f tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:08.888398 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-59aadf25-fb61-4568-ab5b-416313484a6f tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:08.891820 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-59aadf25-fb61-4568-ab5b-416313484a6f tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1358 microversion: 2.21 time: 0.552234 Jul 12 12:00:08.914502 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1268/2371] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:08 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1358 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:00:08.921631 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-57004e0a-5b93-4801-842d-8dc8fed4a1ba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:08.922255 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-57004e0a-5b93-4801-842d-8dc8fed4a1ba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:08.932017 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-57004e0a-5b93-4801-842d-8dc8fed4a1ba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:08.932513 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-57004e0a-5b93-4801-842d-8dc8fed4a1ba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:08.933326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-57004e0a-5b93-4801-842d-8dc8fed4a1ba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:08.933775 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-57004e0a-5b93-4801-842d-8dc8fed4a1ba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:09.011928 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-39f8aeb8-3b2a-4e8b-a9f1-ca3489aeb5d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:09.015094 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-39f8aeb8-3b2a-4e8b-a9f1-ca3489aeb5d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:09.032696 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39f8aeb8-3b2a-4e8b-a9f1-ca3489aeb5d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:09.034889 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39f8aeb8-3b2a-4e8b-a9f1-ca3489aeb5d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:09.036984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39f8aeb8-3b2a-4e8b-a9f1-ca3489aeb5d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:09.038952 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39f8aeb8-3b2a-4e8b-a9f1-ca3489aeb5d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:09.213487 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-57004e0a-5b93-4801-842d-8dc8fed4a1ba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:09.225550 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-57004e0a-5b93-4801-842d-8dc8fed4a1ba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:09.227409 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-57004e0a-5b93-4801-842d-8dc8fed4a1ba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:09.228870 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-57004e0a-5b93-4801-842d-8dc8fed4a1ba tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.311230 Jul 12 12:00:09.229638 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1104/2372] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:08 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:09.488066 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4e09d9c7-b728-46f7-a401-dff2fe6cb3cc tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:09.488725 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4e09d9c7-b728-46f7-a401-dff2fe6cb3cc tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:09.507507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e09d9c7-b728-46f7-a401-dff2fe6cb3cc tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:09.514399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e09d9c7-b728-46f7-a401-dff2fe6cb3cc tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:09.516620 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e09d9c7-b728-46f7-a401-dff2fe6cb3cc tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:09.519984 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4e09d9c7-b728-46f7-a401-dff2fe6cb3cc tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:09.544476 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:10.004346 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4e09d9c7-b728-46f7-a401-dff2fe6cb3cc tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:10.032909 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4e09d9c7-b728-46f7-a401-dff2fe6cb3cc tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:10.057409 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4e09d9c7-b728-46f7-a401-dff2fe6cb3cc tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:10.078628 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4e09d9c7-b728-46f7-a401-dff2fe6cb3cc tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.575292 Jul 12 12:00:10.096382 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1105/2373] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:09 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:00:10.136312 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-88465e45-7865-4c72-89f5-f8e5c8146fe5 req-51aa2f34-cfc5-4449-9a8e-efb1b90940cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-plugged", "status": "completed", "tag": "4b024111-c5ba-43ca-a440-579a6738d07e"}, {"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-plugged", "status": "completed", "tag": "6ade7ded-bc94-401b-9a37-8c94c0fbf2c7"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:10.185037 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-88465e45-7865-4c72-89f5-f8e5c8146fe5 req-51aa2f34-cfc5-4449-9a8e-efb1b90940cd service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:10.185412 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-88465e45-7865-4c72-89f5-f8e5c8146fe5 req-51aa2f34-cfc5-4449-9a8e-efb1b90940cd service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:10.249156 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-88465e45-7865-4c72-89f5-f8e5c8146fe5 req-51aa2f34-cfc5-4449-9a8e-efb1b90940cd service nova] Creating event network-vif-plugged:4b024111-c5ba-43ca-a440-579a6738d07e for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:00:10.252254 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-88465e45-7865-4c72-89f5-f8e5c8146fe5 req-51aa2f34-cfc5-4449-9a8e-efb1b90940cd service nova] Creating event network-vif-plugged:6ade7ded-bc94-401b-9a37-8c94c0fbf2c7 for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:00:10.270020 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-88465e45-7865-4c72-89f5-f8e5c8146fe5 req-51aa2f34-cfc5-4449-9a8e-efb1b90940cd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.171913 Jul 12 12:00:10.271873 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1106/2374] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:10.287562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6f984a5e-dc21-404e-8fc5-05585a8cf877 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:10.288466 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6f984a5e-dc21-404e-8fc5-05585a8cf877 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:10.290877 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-39f8aeb8-3b2a-4e8b-a9f1-ca3489aeb5d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:10.302992 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f984a5e-dc21-404e-8fc5-05585a8cf877 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:10.303706 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f984a5e-dc21-404e-8fc5-05585a8cf877 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:10.305005 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f984a5e-dc21-404e-8fc5-05585a8cf877 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:10.305609 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f984a5e-dc21-404e-8fc5-05585a8cf877 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:10.309381 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-39f8aeb8-3b2a-4e8b-a9f1-ca3489aeb5d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 200 len: 1510 microversion: 2.1 time: 1.303765 Jul 12 12:00:10.310882 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1269/2375] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:09 2022] GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 1510 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:00:10.316021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9b35e826-de4a-428f-a5fe-eb4140557406 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:10.316882 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9b35e826-de4a-428f-a5fe-eb4140557406 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:10.335309 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9b35e826-de4a-428f-a5fe-eb4140557406 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:10.336084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9b35e826-de4a-428f-a5fe-eb4140557406 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:10.337100 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9b35e826-de4a-428f-a5fe-eb4140557406 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:10.337544 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9b35e826-de4a-428f-a5fe-eb4140557406 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:10.558662 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6f984a5e-dc21-404e-8fc5-05585a8cf877 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:10.571326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6f984a5e-dc21-404e-8fc5-05585a8cf877 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:10.574240 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6f984a5e-dc21-404e-8fc5-05585a8cf877 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:10.575609 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6f984a5e-dc21-404e-8fc5-05585a8cf877 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1358 microversion: 2.21 time: 0.302456 Jul 12 12:00:10.576758 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1107/2376] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:10 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:10.583363 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d928f884-11f5-4386-b336-461abe50a49a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:10.587500 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d928f884-11f5-4386-b336-461abe50a49a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:10.588641 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d928f884-11f5-4386-b336-461abe50a49a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:00:10.602613 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d928f884-11f5-4386-b336-461abe50a49a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:10.603397 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d928f884-11f5-4386-b336-461abe50a49a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:10.604465 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d928f884-11f5-4386-b336-461abe50a49a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:10.618183 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d928f884-11f5-4386-b336-461abe50a49a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:10.882634 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.multi_cell_list [None req-d928f884-11f5-4386-b336-461abe50a49a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:00:10.895432 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9b35e826-de4a-428f-a5fe-eb4140557406 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:10.914390 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9b35e826-de4a-428f-a5fe-eb4140557406 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:10.922661 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9b35e826-de4a-428f-a5fe-eb4140557406 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:10.932254 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9b35e826-de4a-428f-a5fe-eb4140557406 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.618173 Jul 12 12:00:10.934929 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1270/2377] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:10 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:11.067304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d928f884-11f5-4386-b336-461abe50a49a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:11.082490 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d928f884-11f5-4386-b336-461abe50a49a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:11.085614 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d928f884-11f5-4386-b336-461abe50a49a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:11.127390 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-799c82a4-2eec-4a9f-946f-35d18dc37813 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:11.128380 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-799c82a4-2eec-4a9f-946f-35d18dc37813 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:11.146196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-799c82a4-2eec-4a9f-946f-35d18dc37813 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:11.149765 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-799c82a4-2eec-4a9f-946f-35d18dc37813 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:11.156855 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-799c82a4-2eec-4a9f-946f-35d18dc37813 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:11.157468 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-799c82a4-2eec-4a9f-946f-35d18dc37813 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:11.486012 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d928f884-11f5-4386-b336-461abe50a49a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.907925 Jul 12 12:00:11.487196 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1108/2378] 10.222.0.50 () {58 vars in 1166 bytes} [Tue Jul 12 12:00:10 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:11.511667 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-81b9e06a-5227-4617-806d-3835a1e598cb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:11.521966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-81b9e06a-5227-4617-806d-3835a1e598cb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:11.523407 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-81b9e06a-5227-4617-806d-3835a1e598cb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1726329593', 'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:00:11.535194 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-81b9e06a-5227-4617-806d-3835a1e598cb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:11.545936 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-81b9e06a-5227-4617-806d-3835a1e598cb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:11.547708 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-81b9e06a-5227-4617-806d-3835a1e598cb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:11.548435 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-81b9e06a-5227-4617-806d-3835a1e598cb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:11.784806 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.multi_cell_list [None req-81b9e06a-5227-4617-806d-3835a1e598cb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:00:11.856002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-799c82a4-2eec-4a9f-946f-35d18dc37813 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:11.875092 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-799c82a4-2eec-4a9f-946f-35d18dc37813 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:11.879965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-799c82a4-2eec-4a9f-946f-35d18dc37813 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:11.889203 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-799c82a4-2eec-4a9f-946f-35d18dc37813 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 0.776778 Jul 12 12:00:11.912487 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1271/2379] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:11 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:11.919523 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b64ec7b2-c607-43c5-a4c2-2c80dc5803bb tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:11.928110 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b64ec7b2-c607-43c5-a4c2-2c80dc5803bb tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:11.943974 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-81b9e06a-5227-4617-806d-3835a1e598cb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:11.949650 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b64ec7b2-c607-43c5-a4c2-2c80dc5803bb tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:11.955512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b64ec7b2-c607-43c5-a4c2-2c80dc5803bb tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:11.960576 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b64ec7b2-c607-43c5-a4c2-2c80dc5803bb tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:11.962108 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b64ec7b2-c607-43c5-a4c2-2c80dc5803bb tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:11.964999 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-81b9e06a-5227-4617-806d-3835a1e598cb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:11.965723 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-81b9e06a-5227-4617-806d-3835a1e598cb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:12.604757 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b64ec7b2-c607-43c5-a4c2-2c80dc5803bb tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:12.631191 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b64ec7b2-c607-43c5-a4c2-2c80dc5803bb tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:12.633391 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b64ec7b2-c607-43c5-a4c2-2c80dc5803bb tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:12.645475 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b64ec7b2-c607-43c5-a4c2-2c80dc5803bb tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1358 microversion: 2.21 time: 0.731381 Jul 12 12:00:12.653540 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1272/2380] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:11 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1358 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:12.673644 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0a95855c-8960-467a-8a63-fe7cb13b4167 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:12.682690 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0a95855c-8960-467a-8a63-fe7cb13b4167 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:12.714193 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a95855c-8960-467a-8a63-fe7cb13b4167 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:12.723619 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a95855c-8960-467a-8a63-fe7cb13b4167 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:12.729832 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a95855c-8960-467a-8a63-fe7cb13b4167 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:12.730759 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a95855c-8960-467a-8a63-fe7cb13b4167 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:13.126126 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-81b9e06a-5227-4617-806d-3835a1e598cb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1726329593" status: 200 len: 1513 microversion: 2.1 time: 1.618679 Jul 12 12:00:13.127106 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1109/2381] 10.222.0.50 () {58 vars in 1262 bytes} [Tue Jul 12 12:00:11 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1726329593 => generated 1513 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:00:13.132673 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-7a416dc7-ffa8-4950-88e4-3d8d4b1a71c2 req-59d9af45-6783-4218-b634-0b942a0ceea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-plugged", "status": "completed", "tag": "65251375-ff74-4521-a4d6-cec51c2c3fa2"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:13.157781 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-7a416dc7-ffa8-4950-88e4-3d8d4b1a71c2 req-59d9af45-6783-4218-b634-0b942a0ceea7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:13.171964 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-7a416dc7-ffa8-4950-88e4-3d8d4b1a71c2 req-59d9af45-6783-4218-b634-0b942a0ceea7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:13.205583 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-7a416dc7-ffa8-4950-88e4-3d8d4b1a71c2 req-59d9af45-6783-4218-b634-0b942a0ceea7 service nova] Creating event network-vif-plugged:65251375-ff74-4521-a4d6-cec51c2c3fa2 for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:00:13.219514 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-7a416dc7-ffa8-4950-88e4-3d8d4b1a71c2 req-59d9af45-6783-4218-b634-0b942a0ceea7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090677 Jul 12 12:00:13.221042 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1110/2382] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:13.236899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-710bbe11-f4b8-43a8-96e1-0b346007c0a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:13.239864 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-710bbe11-f4b8-43a8-96e1-0b346007c0a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:13.257686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-710bbe11-f4b8-43a8-96e1-0b346007c0a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:13.259854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-710bbe11-f4b8-43a8-96e1-0b346007c0a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:13.272669 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-710bbe11-f4b8-43a8-96e1-0b346007c0a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:13.273454 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-710bbe11-f4b8-43a8-96e1-0b346007c0a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:13.573106 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0a95855c-8960-467a-8a63-fe7cb13b4167 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:13.618756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0a95855c-8960-467a-8a63-fe7cb13b4167 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:13.631249 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0a95855c-8960-467a-8a63-fe7cb13b4167 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:13.634824 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0a95855c-8960-467a-8a63-fe7cb13b4167 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.979109 Jul 12 12:00:13.645528 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1273/2383] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:12 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:13.662235 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2512849c-2239-4031-b565-41162e3b01c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:13.685453 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2512849c-2239-4031-b565-41162e3b01c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:13.691596 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2512849c-2239-4031-b565-41162e3b01c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:00:13.712561 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2512849c-2239-4031-b565-41162e3b01c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:13.726506 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2512849c-2239-4031-b565-41162e3b01c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:13.738331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2512849c-2239-4031-b565-41162e3b01c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:13.739025 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2512849c-2239-4031-b565-41162e3b01c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:14.035708 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-2512849c-2239-4031-b565-41162e3b01c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:00:14.202842 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2512849c-2239-4031-b565-41162e3b01c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:14.213132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2512849c-2239-4031-b565-41162e3b01c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:14.213748 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2512849c-2239-4031-b565-41162e3b01c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:14.294784 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-710bbe11-f4b8-43a8-96e1-0b346007c0a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:14.316235 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-710bbe11-f4b8-43a8-96e1-0b346007c0a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:14.319297 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-710bbe11-f4b8-43a8-96e1-0b346007c0a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:14.321690 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-710bbe11-f4b8-43a8-96e1-0b346007c0a9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1880 microversion: 2.32 time: 1.099268 Jul 12 12:00:14.334239 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1111/2384] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:13 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1880 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:14.364804 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0a690bb8-6103-4599-a172-94091e494de8 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:14.365848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0a690bb8-6103-4599-a172-94091e494de8 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:14.397973 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0a690bb8-6103-4599-a172-94091e494de8 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:14.404795 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0a690bb8-6103-4599-a172-94091e494de8 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:14.406005 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0a690bb8-6103-4599-a172-94091e494de8 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:14.406629 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0a690bb8-6103-4599-a172-94091e494de8 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:14.587783 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2512849c-2239-4031-b565-41162e3b01c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 0.937381 Jul 12 12:00:14.588957 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1274/2385] 10.222.0.50 () {58 vars in 1172 bytes} [Tue Jul 12 12:00:13 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:14.718840 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ea94a648-fd68-4c8b-9b54-cc3c672d3984 tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] Action: 'create', calling method: .version_select at 0x7f5e099bb820>, body: {"pool": null} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:14.926417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0a690bb8-6103-4599-a172-94091e494de8 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:14.939370 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0a690bb8-6103-4599-a172-94091e494de8 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:14.943528 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0a690bb8-6103-4599-a172-94091e494de8 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:14.944748 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0a690bb8-6103-4599-a172-94091e494de8 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1358 microversion: 2.21 time: 0.595007 Jul 12 12:00:14.945319 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1112/2386] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:14 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1358 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:14.958727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fb728354-3c8d-4b63-a8c8-bf5e3b1e9103 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:14.975053 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fb728354-3c8d-4b63-a8c8-bf5e3b1e9103 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:14.991863 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.compute.servers [None req-fb728354-3c8d-4b63-a8c8-bf5e3b1e9103 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Removing options 'limit' from query {{(pid=125983) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 12 12:00:14.995013 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fb728354-3c8d-4b63-a8c8-bf5e3b1e9103 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:00:15.016465 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fb728354-3c8d-4b63-a8c8-bf5e3b1e9103 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:15.016924 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fb728354-3c8d-4b63-a8c8-bf5e3b1e9103 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:15.017754 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fb728354-3c8d-4b63-a8c8-bf5e3b1e9103 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:15.018375 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fb728354-3c8d-4b63-a8c8-bf5e3b1e9103 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:15.328079 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fb728354-3c8d-4b63-a8c8-bf5e3b1e9103 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:15.343699 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fb728354-3c8d-4b63-a8c8-bf5e3b1e9103 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:15.344407 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fb728354-3c8d-4b63-a8c8-bf5e3b1e9103 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:16.078390 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fb728354-3c8d-4b63-a8c8-bf5e3b1e9103 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 1.123847 Jul 12 12:00:16.079895 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1113/2387] 10.222.0.50 () {58 vars in 1160 bytes} [Tue Jul 12 12:00:14 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:16.100011 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fd3e2da9-5fe3-409b-a8f0-5cc0888be627 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:16.101238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fd3e2da9-5fe3-409b-a8f0-5cc0888be627 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:16.115312 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd3e2da9-5fe3-409b-a8f0-5cc0888be627 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:16.116277 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd3e2da9-5fe3-409b-a8f0-5cc0888be627 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:16.117533 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd3e2da9-5fe3-409b-a8f0-5cc0888be627 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:16.118845 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd3e2da9-5fe3-409b-a8f0-5cc0888be627 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:16.772841 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fd3e2da9-5fe3-409b-a8f0-5cc0888be627 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:16.805274 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fd3e2da9-5fe3-409b-a8f0-5cc0888be627 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:16.817758 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fd3e2da9-5fe3-409b-a8f0-5cc0888be627 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:16.824584 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fd3e2da9-5fe3-409b-a8f0-5cc0888be627 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.742876 Jul 12 12:00:16.827486 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1114/2388] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:16 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:16.833893 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-f4fc00ac-3928-4d5d-b794-b600cbef57b1 req-4b0f0aa8-5b03-4e4c-b2b8-bf280dcbc214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd", "name": "network-vif-plugged", "status": "completed", "tag": "31aa98f4-2088-4064-96c5-9d8d63250784"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:16.860116 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-f4fc00ac-3928-4d5d-b794-b600cbef57b1 req-4b0f0aa8-5b03-4e4c-b2b8-bf280dcbc214 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:16.865015 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-f4fc00ac-3928-4d5d-b794-b600cbef57b1 req-4b0f0aa8-5b03-4e4c-b2b8-bf280dcbc214 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:16.908663 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-f4fc00ac-3928-4d5d-b794-b600cbef57b1 req-4b0f0aa8-5b03-4e4c-b2b8-bf280dcbc214 service nova] Creating event network-vif-plugged:31aa98f4-2088-4064-96c5-9d8d63250784 for instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd on n-h1-849104-4 Jul 12 12:00:16.924951 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-f4fc00ac-3928-4d5d-b794-b600cbef57b1 req-4b0f0aa8-5b03-4e4c-b2b8-bf280dcbc214 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094099 Jul 12 12:00:16.930778 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1115/2389] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:16.941757 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8ea76b7a-ba0b-4788-a4a4-13834206e201 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:16.944925 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8ea76b7a-ba0b-4788-a4a4-13834206e201 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:16.965345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ea76b7a-ba0b-4788-a4a4-13834206e201 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:16.968977 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ea76b7a-ba0b-4788-a4a4-13834206e201 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:16.970254 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ea76b7a-ba0b-4788-a4a4-13834206e201 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:16.970975 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ea76b7a-ba0b-4788-a4a4-13834206e201 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:17.307373 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ea94a648-fd68-4c8b-9b54-cc3c672d3984 tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.717171 Jul 12 12:00:17.322447 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1275/2390] 10.222.0.50 () {60 vars in 1169 bytes} [Tue Jul 12 12:00:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:17.322447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ce00fbe3-cf12-4365-8dc0-b769cb7e2d33 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:17.322447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ce00fbe3-cf12-4365-8dc0-b769cb7e2d33 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:17.327440 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ce00fbe3-cf12-4365-8dc0-b769cb7e2d33 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:17.328771 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ce00fbe3-cf12-4365-8dc0-b769cb7e2d33 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:17.331152 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ce00fbe3-cf12-4365-8dc0-b769cb7e2d33 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:17.334373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ce00fbe3-cf12-4365-8dc0-b769cb7e2d33 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:17.421880 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8ea76b7a-ba0b-4788-a4a4-13834206e201 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:17.444093 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8ea76b7a-ba0b-4788-a4a4-13834206e201 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:17.450817 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8ea76b7a-ba0b-4788-a4a4-13834206e201 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:17.452714 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8ea76b7a-ba0b-4788-a4a4-13834206e201 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 2832 microversion: 2.32 time: 0.520502 Jul 12 12:00:17.453292 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1116/2391] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:16 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 2832 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:17.481519 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-158511e7-9e9a-47d7-837a-ab626f0b4c9f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:17.489532 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-158511e7-9e9a-47d7-837a-ab626f0b4c9f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:17.490655 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-158511e7-9e9a-47d7-837a-ab626f0b4c9f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:00:17.507042 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-158511e7-9e9a-47d7-837a-ab626f0b4c9f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:17.507523 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-158511e7-9e9a-47d7-837a-ab626f0b4c9f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:17.513109 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-158511e7-9e9a-47d7-837a-ab626f0b4c9f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:17.513611 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-158511e7-9e9a-47d7-837a-ab626f0b4c9f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:17.586204 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ce00fbe3-cf12-4365-8dc0-b769cb7e2d33 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:17.598958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ce00fbe3-cf12-4365-8dc0-b769cb7e2d33 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:17.600512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ce00fbe3-cf12-4365-8dc0-b769cb7e2d33 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:17.601673 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ce00fbe3-cf12-4365-8dc0-b769cb7e2d33 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1358 microversion: 2.21 time: 0.292719 Jul 12 12:00:17.616184 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1276/2392] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:17 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1358 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:17.628145 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-af46fc13-17ae-45ca-a4b0-9ccc9dd6b33f tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] Action: 'create', calling method: .version_select at 0x7f5e13bfa280>, body: {"pool": null} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:17.703002 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.multi_cell_list [None req-158511e7-9e9a-47d7-837a-ab626f0b4c9f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:00:17.810492 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-158511e7-9e9a-47d7-837a-ab626f0b4c9f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.335960 Jul 12 12:00:17.812755 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1117/2393] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 12:00:17 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:17.901784 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1560739438", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:17.982192 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] validate_networks() for [('2962b434-7039-41ae-a66b-582cb340c07b', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 12:00:19.016919 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:00:19.017642 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:00:19.018249 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:00:19.018861 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:00:19.019485 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:00:19.044573 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:19.045557 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:19.046547 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:19.047114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:19.123834 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Getting quotas for project 9c2da0a7a8cc49eaa09a6aff6f977dae. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:00:19.141798 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Getting quotas for user 4731a65ac69548eaaa6ccb9049662968 and project 9c2da0a7a8cc49eaa09a6aff6f977dae. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:00:19.172160 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 12:00:19.174801 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:00:19.300554 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-86f35c38-6db0-4dff-ab5c-28458bf415e3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.485965 Jul 12 12:00:19.302805 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1118/2394] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 12:00:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 12:00:19.310433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8589fc2f-a073-488a-8001-66e8b8cc11ae tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:19.317120 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8589fc2f-a073-488a-8001-66e8b8cc11ae tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:19.339524 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8589fc2f-a073-488a-8001-66e8b8cc11ae tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:19.339917 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8589fc2f-a073-488a-8001-66e8b8cc11ae tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:19.340765 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8589fc2f-a073-488a-8001-66e8b8cc11ae tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:19.341222 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8589fc2f-a073-488a-8001-66e8b8cc11ae tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:19.666521 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8589fc2f-a073-488a-8001-66e8b8cc11ae tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.362529 Jul 12 12:00:19.667131 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1119/2395] 10.222.0.50 () {60 vars in 1315 bytes} [Tue Jul 12 12:00:19 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444/os-interface => generated 1830 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:19.673116 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0c28c040-e20f-4af9-a25d-893c1a057f06 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:19.683507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0c28c040-e20f-4af9-a25d-893c1a057f06 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:19.683978 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.compute.servers [None req-0c28c040-e20f-4af9-a25d-893c1a057f06 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Removing options 'limit' from query {{(pid=125983) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 12 12:00:19.684691 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0c28c040-e20f-4af9-a25d-893c1a057f06 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:00:19.714109 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c28c040-e20f-4af9-a25d-893c1a057f06 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:19.714256 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c28c040-e20f-4af9-a25d-893c1a057f06 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:19.715171 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c28c040-e20f-4af9-a25d-893c1a057f06 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:19.715616 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c28c040-e20f-4af9-a25d-893c1a057f06 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:19.841523 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.multi_cell_list [None req-0c28c040-e20f-4af9-a25d-893c1a057f06 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:00:20.028634 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0c28c040-e20f-4af9-a25d-893c1a057f06 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.359721 Jul 12 12:00:20.036807 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1120/2396] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Jul 12 12:00:19 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:20.080845 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-16d90c09-342d-4605-a79b-33b56ce47a5d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:20.086427 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-16d90c09-342d-4605-a79b-33b56ce47a5d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:20.130083 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16d90c09-342d-4605-a79b-33b56ce47a5d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:20.135316 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16d90c09-342d-4605-a79b-33b56ce47a5d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:20.143729 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16d90c09-342d-4605-a79b-33b56ce47a5d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:20.147103 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16d90c09-342d-4605-a79b-33b56ce47a5d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:20.734969 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-16d90c09-342d-4605-a79b-33b56ce47a5d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:20.773070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-16d90c09-342d-4605-a79b-33b56ce47a5d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:20.786277 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-16d90c09-342d-4605-a79b-33b56ce47a5d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:20.788478 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-16d90c09-342d-4605-a79b-33b56ce47a5d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.742864 Jul 12 12:00:20.802041 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1121/2397] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:20 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:20.812853 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-285f9323-52d1-4220-a23a-6aa87f04afe2 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:20.820870 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-285f9323-52d1-4220-a23a-6aa87f04afe2 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:20.837086 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-285f9323-52d1-4220-a23a-6aa87f04afe2 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:20.837916 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-285f9323-52d1-4220-a23a-6aa87f04afe2 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:20.839361 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-285f9323-52d1-4220-a23a-6aa87f04afe2 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:20.840128 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-285f9323-52d1-4220-a23a-6aa87f04afe2 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:21.214170 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-285f9323-52d1-4220-a23a-6aa87f04afe2 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:21.225421 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:21.237559 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-285f9323-52d1-4220-a23a-6aa87f04afe2 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:21.242077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-285f9323-52d1-4220-a23a-6aa87f04afe2 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:21.243753 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-285f9323-52d1-4220-a23a-6aa87f04afe2 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1550 microversion: 2.21 time: 0.440350 Jul 12 12:00:21.244618 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1122/2398] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:20 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1550 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:21.253009 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e8a75c94-bf87-4ce9-8f06-93f61c8ea54c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:21.254631 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e8a75c94-bf87-4ce9-8f06-93f61c8ea54c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:21.265928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8a75c94-bf87-4ce9-8f06-93f61c8ea54c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:21.266664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8a75c94-bf87-4ce9-8f06-93f61c8ea54c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:21.268135 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8a75c94-bf87-4ce9-8f06-93f61c8ea54c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:21.269365 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8a75c94-bf87-4ce9-8f06-93f61c8ea54c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:21.449827 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e8a75c94-bf87-4ce9-8f06-93f61c8ea54c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:21.466406 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e8a75c94-bf87-4ce9-8f06-93f61c8ea54c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1266 microversion: 2.1 time: 0.220071 Jul 12 12:00:21.479746 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1123/2399] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:21 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:21.512920 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ab5195a9-9055-4ae2-88df-3cb572ed31bd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:21.535799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ab5195a9-9055-4ae2-88df-3cb572ed31bd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:21.536648 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ab5195a9-9055-4ae2-88df-3cb572ed31bd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:00:21.590844 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ab5195a9-9055-4ae2-88df-3cb572ed31bd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:21.592639 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ab5195a9-9055-4ae2-88df-3cb572ed31bd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:21.593478 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ab5195a9-9055-4ae2-88df-3cb572ed31bd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:21.593928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ab5195a9-9055-4ae2-88df-3cb572ed31bd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:21.710655 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.multi_cell_list [None req-ab5195a9-9055-4ae2-88df-3cb572ed31bd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:00:21.794182 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ab5195a9-9055-4ae2-88df-3cb572ed31bd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.308422 Jul 12 12:00:21.794810 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1124/2400] 10.222.0.50 () {58 vars in 1124 bytes} [Tue Jul 12 12:00:21 2022] GET /compute/v2.1/servers => generated 1012 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:21.815604 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9c9a3aa6-fe0d-4f5f-a838-4f1c504f9f7a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:21.822737 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9c9a3aa6-fe0d-4f5f-a838-4f1c504f9f7a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:21.836285 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9c9a3aa6-fe0d-4f5f-a838-4f1c504f9f7a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:21.836759 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9c9a3aa6-fe0d-4f5f-a838-4f1c504f9f7a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:21.837741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9c9a3aa6-fe0d-4f5f-a838-4f1c504f9f7a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:21.838373 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9c9a3aa6-fe0d-4f5f-a838-4f1c504f9f7a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:21.923848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9c9a3aa6-fe0d-4f5f-a838-4f1c504f9f7a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:00:22.095873 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9c9a3aa6-fe0d-4f5f-a838-4f1c504f9f7a tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "DELETE /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 204 len: 0 microversion: 2.21 time: 0.284187 Jul 12 12:00:22.098255 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1125/2401] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 12:00:21 2022] DELETE /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 12:00:22.116318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-dc4f78a9-7968-41a1-93fa-64208cc6e91a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:22.122242 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-dc4f78a9-7968-41a1-93fa-64208cc6e91a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:22.158318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dc4f78a9-7968-41a1-93fa-64208cc6e91a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:22.160850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dc4f78a9-7968-41a1-93fa-64208cc6e91a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:22.162184 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dc4f78a9-7968-41a1-93fa-64208cc6e91a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:22.190226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dc4f78a9-7968-41a1-93fa-64208cc6e91a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:22.785986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-dc4f78a9-7968-41a1-93fa-64208cc6e91a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:22.798626 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-dc4f78a9-7968-41a1-93fa-64208cc6e91a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:22.804547 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-dc4f78a9-7968-41a1-93fa-64208cc6e91a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:22.805938 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-dc4f78a9-7968-41a1-93fa-64208cc6e91a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.705440 Jul 12 12:00:22.816780 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1126/2402] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:22 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:22.816780 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-54923063-b5d2-4170-b6bc-05e0536c4160 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:22.822562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-54923063-b5d2-4170-b6bc-05e0536c4160 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:22.823156 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-54923063-b5d2-4170-b6bc-05e0536c4160 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:00:22.855250 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-54923063-b5d2-4170-b6bc-05e0536c4160 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:22.855709 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-54923063-b5d2-4170-b6bc-05e0536c4160 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:22.858850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-54923063-b5d2-4170-b6bc-05e0536c4160 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:22.859303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-54923063-b5d2-4170-b6bc-05e0536c4160 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:23.084401 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.multi_cell_list [None req-54923063-b5d2-4170-b6bc-05e0536c4160 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:00:23.322848 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-54923063-b5d2-4170-b6bc-05e0536c4160 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.513860 Jul 12 12:00:23.329676 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1127/2403] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 12:00:22 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:23.339145 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a1ce5858-5e2a-446a-9684-ef8f11062862 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:23.339686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a1ce5858-5e2a-446a-9684-ef8f11062862 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:23.377271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a1ce5858-5e2a-446a-9684-ef8f11062862 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:23.377739 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a1ce5858-5e2a-446a-9684-ef8f11062862 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:23.378538 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a1ce5858-5e2a-446a-9684-ef8f11062862 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:23.379071 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a1ce5858-5e2a-446a-9684-ef8f11062862 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:23.426457 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-af46fc13-17ae-45ca-a4b0-9ccc9dd6b33f tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.808685 Jul 12 12:00:23.428291 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1277/2404] 10.222.0.50 () {60 vars in 1169 bytes} [Tue Jul 12 12:00:17 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:23.435567 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ca16ebc9-02dc-42f8-a4d7-1ffc4fa1b478 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:23.442543 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ca16ebc9-02dc-42f8-a4d7-1ffc4fa1b478 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:23.473050 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=42 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:23.474888 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ca16ebc9-02dc-42f8-a4d7-1ffc4fa1b478 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:23.475410 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ca16ebc9-02dc-42f8-a4d7-1ffc4fa1b478 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:23.486532 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ca16ebc9-02dc-42f8-a4d7-1ffc4fa1b478 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:23.487076 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ca16ebc9-02dc-42f8-a4d7-1ffc4fa1b478 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:23.719101 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ca16ebc9-02dc-42f8-a4d7-1ffc4fa1b478 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:23.735910 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ca16ebc9-02dc-42f8-a4d7-1ffc4fa1b478 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1314 microversion: 2.1 time: 0.305857 Jul 12 12:00:23.737200 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1278/2405] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:23 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:23.758789 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-40e9e6d3-7976-444a-98ad-76d9629552a9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:23.773126 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-40e9e6d3-7976-444a-98ad-76d9629552a9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:23.774048 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.compute.servers [None req-40e9e6d3-7976-444a-98ad-76d9629552a9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Removing options 'limit' from query {{(pid=125984) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 12 12:00:23.775220 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-40e9e6d3-7976-444a-98ad-76d9629552a9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:00:23.783584 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40e9e6d3-7976-444a-98ad-76d9629552a9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:23.784645 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40e9e6d3-7976-444a-98ad-76d9629552a9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:23.786188 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40e9e6d3-7976-444a-98ad-76d9629552a9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:23.786993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-40e9e6d3-7976-444a-98ad-76d9629552a9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:23.840374 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-40e9e6d3-7976-444a-98ad-76d9629552a9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.101692 Jul 12 12:00:23.842074 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1279/2406] 10.222.0.50 () {58 vars in 1139 bytes} [Tue Jul 12 12:00:23 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:23.849673 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6c9f2ad5-45d2-4382-b89d-a719abdb12eb tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] Action: 'create', calling method: .version_select at 0x7f5e099cdb80>, body: {"pool": null} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:23.871464 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a1ce5858-5e2a-446a-9684-ef8f11062862 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:23.914742 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a1ce5858-5e2a-446a-9684-ef8f11062862 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:23.918938 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a1ce5858-5e2a-446a-9684-ef8f11062862 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a7fbaa31544f9cb741b7c102466c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9205141214d3fa861f126077d83ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:23.920519 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a1ce5858-5e2a-446a-9684-ef8f11062862 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 200 len: 1556 microversion: 2.21 time: 0.587740 Jul 12 12:00:23.924914 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1128/2407] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:23 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 1556 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:24.028637 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-fc90ff52-abd5-4946-82c9-02e609ad1074 req-ada9449d-163a-461a-a3e5-01bdf53653f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "tag": "a0d155ae-ac1b-49ea-b8e9-248ed51e6471"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:24.051402 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-fc90ff52-abd5-4946-82c9-02e609ad1074 req-ada9449d-163a-461a-a3e5-01bdf53653f0 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:24.054113 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-fc90ff52-abd5-4946-82c9-02e609ad1074 req-ada9449d-163a-461a-a3e5-01bdf53653f0 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:24.088384 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-fc90ff52-abd5-4946-82c9-02e609ad1074 req-ada9449d-163a-461a-a3e5-01bdf53653f0 service nova] Creating event network-changed:a0d155ae-ac1b-49ea-b8e9-248ed51e6471 for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:00:24.106584 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-fc90ff52-abd5-4946-82c9-02e609ad1074 req-ada9449d-163a-461a-a3e5-01bdf53653f0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180156 Jul 12 12:00:24.111174 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1129/2408] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:24.133660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-610362da-a433-4aac-9912-ad7db6a0cb47 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:24.134999 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-610362da-a433-4aac-9912-ad7db6a0cb47 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:24.147852 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-610362da-a433-4aac-9912-ad7db6a0cb47 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:24.152845 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-610362da-a433-4aac-9912-ad7db6a0cb47 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:24.155738 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-610362da-a433-4aac-9912-ad7db6a0cb47 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:24.164152 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-610362da-a433-4aac-9912-ad7db6a0cb47 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:24.205532 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:25.587333 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-610362da-a433-4aac-9912-ad7db6a0cb47 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:25.615018 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-610362da-a433-4aac-9912-ad7db6a0cb47 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:25.617642 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-610362da-a433-4aac-9912-ad7db6a0cb47 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:25.619670 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-610362da-a433-4aac-9912-ad7db6a0cb47 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 1.506116 Jul 12 12:00:25.632486 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1130/2409] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:24 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:25.652730 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c5b0bef5-3957-4b65-b086-9175aaf6cffd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:25.658203 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c5b0bef5-3957-4b65-b086-9175aaf6cffd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:25.659275 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c5b0bef5-3957-4b65-b086-9175aaf6cffd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1726329593', 'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:00:25.678633 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5b0bef5-3957-4b65-b086-9175aaf6cffd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:25.679467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5b0bef5-3957-4b65-b086-9175aaf6cffd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:25.680781 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5b0bef5-3957-4b65-b086-9175aaf6cffd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:25.681228 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5b0bef5-3957-4b65-b086-9175aaf6cffd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:25.941226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.multi_cell_list [None req-c5b0bef5-3957-4b65-b086-9175aaf6cffd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:00:26.151662 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c5b0bef5-3957-4b65-b086-9175aaf6cffd tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1726329593" status: 200 len: 346 microversion: 2.1 time: 0.515559 Jul 12 12:00:26.153327 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1131/2410] 10.222.0.50 () {58 vars in 1241 bytes} [Tue Jul 12 12:00:25 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1726329593 => generated 346 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:26.161822 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b48fbc16-b35c-412b-82ca-9fb35d511ff2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:26.164285 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b48fbc16-b35c-412b-82ca-9fb35d511ff2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:26.175648 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:26.179078 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b48fbc16-b35c-412b-82ca-9fb35d511ff2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:26.179953 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b48fbc16-b35c-412b-82ca-9fb35d511ff2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:26.181663 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b48fbc16-b35c-412b-82ca-9fb35d511ff2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:26.183622 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b48fbc16-b35c-412b-82ca-9fb35d511ff2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:27.359082 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6c9f2ad5-45d2-4382-b89d-a719abdb12eb tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.515420 Jul 12 12:00:27.360100 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1280/2411] 10.222.0.50 () {60 vars in 1169 bytes} [Tue Jul 12 12:00:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:27.364783 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-59536d1a-b2ff-4bd9-8963-2fb87dfdc24b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:27.367080 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-59536d1a-b2ff-4bd9-8963-2fb87dfdc24b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:27.394978 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59536d1a-b2ff-4bd9-8963-2fb87dfdc24b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:27.395480 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59536d1a-b2ff-4bd9-8963-2fb87dfdc24b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:27.396355 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59536d1a-b2ff-4bd9-8963-2fb87dfdc24b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:27.396967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-59536d1a-b2ff-4bd9-8963-2fb87dfdc24b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:27.425858 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-59536d1a-b2ff-4bd9-8963-2fb87dfdc24b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] HTTP exception thrown: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-59536d1a-b2ff-4bd9-8963-2fb87dfdc24b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Request method failure captured: Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd HTTP/1.1 Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWIwjxhTViBMaT0HwzePmb1tv3mw1sLaJE9WbkStPLyMMnPxfjN3tQS_FO2PXxSfO2upcIbzFAz5z3xZlEMV3lps1hIzULG6cWHeZgjBPLAyaHup_33ABP0ZE5C8UTcN_3z72V0rwj0DQIXyL1lveLqWi-6BBTaZSdTJ3Kh-kVvVA04 Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Openstack-Nova-Api-Version: 2.21 Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 89c9205141214d3fa861f126077d83ff Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1926527473 Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/89c9205141214d3fa861f126077d83ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/89c9205141214d3fa861f126077d83ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/89c9205141214d3fa861f126077d83ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_89c9205141214d3fa861f126077d83ff", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-InstanceActionsV221TestJSON-1926527473 Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 89c9205141214d3fa861f126077d83ff Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1926527473 Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-InstanceActionsV221TestJSON-1926527473-project Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 22a7fbaa31544f9cb741b7c102466c1d Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-InstanceActionsV221TestJSON-1926527473-project Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd'} Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:27.427785 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:00:27.433024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:27.433024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:00:27.433024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:00:27.433024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:00:27.433024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:00:27.433024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:00:27.433024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:27.433024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:27.433024 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-59536d1a-b2ff-4bd9-8963-2fb87dfdc24b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Returning 404 to user: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:00:27.434279 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-59536d1a-b2ff-4bd9-8963-2fb87dfdc24b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 404 len: 111 microversion: 2.21 time: 0.071700 Jul 12 12:00:27.434279 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1281/2412] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:27 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 12:00:27.439683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0c2882dd-5d58-4d3b-974d-0d86b7b16dd4 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:27.447037 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0c2882dd-5d58-4d3b-974d-0d86b7b16dd4 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:27.447497 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0c2882dd-5d58-4d3b-974d-0d86b7b16dd4 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:27.489227 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0c2882dd-5d58-4d3b-974d-0d86b7b16dd4 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Going to try to stop instance {{(pid=125984) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 12:00:27.538448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:27.572600 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0c2882dd-5d58-4d3b-974d-0d86b7b16dd4 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "POST /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.136747 Jul 12 12:00:27.573141 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1282/2413] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 12:00:27 2022] POST /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 12:00:27.581077 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-fdff8412-704a-4b11-a51d-483bafb66ac3 req-0c055b71-8b3e-4529-bce8-90f1adb1ac77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd", "name": "network-vif-deleted", "tag": "31aa98f4-2088-4064-96c5-9d8d63250784"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:27.595275 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-fdff8412-704a-4b11-a51d-483bafb66ac3 req-0c055b71-8b3e-4529-bce8-90f1adb1ac77 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:27.596208 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-fdff8412-704a-4b11-a51d-483bafb66ac3 req-0c055b71-8b3e-4529-bce8-90f1adb1ac77 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:27.610789 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-fdff8412-704a-4b11-a51d-483bafb66ac3 req-0c055b71-8b3e-4529-bce8-90f1adb1ac77 service nova] Creating event network-vif-deleted:31aa98f4-2088-4064-96c5-9d8d63250784 for instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd on n-h1-849104-4 Jul 12 12:00:27.617447 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-fdff8412-704a-4b11-a51d-483bafb66ac3 req-0c055b71-8b3e-4529-bce8-90f1adb1ac77 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042681 Jul 12 12:00:27.618345 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1283/2414] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:27.631965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cbfba018-796d-4c0e-9e7f-3c6433672638 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:27.633183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cbfba018-796d-4c0e-9e7f-3c6433672638 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:27.646261 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cbfba018-796d-4c0e-9e7f-3c6433672638 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:27.647348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cbfba018-796d-4c0e-9e7f-3c6433672638 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:27.649133 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cbfba018-796d-4c0e-9e7f-3c6433672638 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:27.650190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cbfba018-796d-4c0e-9e7f-3c6433672638 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:27.732344 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b48fbc16-b35c-412b-82ca-9fb35d511ff2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:27.759172 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b48fbc16-b35c-412b-82ca-9fb35d511ff2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1314 microversion: 2.1 time: 1.603145 Jul 12 12:00:27.761520 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1132/2415] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:26 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1314 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:27.773442 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-b1a7a132-f7be-404f-8602-4c4ab8d4f595 req-106d6053-c799-463b-868c-2756c3d86ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26b640d-3b19-492b-99f2-4c0cb3c10c25", "name": "network-vif-unplugged", "status": "completed", "tag": "fefc048a-c90e-4ca6-908e-d9728a5304fa"}, {"name": "network-changed", "server_uuid": "e8e01337-f4c5-4f7d-ad6c-b84e035f064c", "tag": "c5022b36-eb9d-406c-baba-17ffa943e001"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:27.791071 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-b1a7a132-f7be-404f-8602-4c4ab8d4f595 req-106d6053-c799-463b-868c-2756c3d86ae1 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:27.793075 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-b1a7a132-f7be-404f-8602-4c4ab8d4f595 req-106d6053-c799-463b-868c-2756c3d86ae1 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:27.814546 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-b1a7a132-f7be-404f-8602-4c4ab8d4f595 req-106d6053-c799-463b-868c-2756c3d86ae1 service nova] Creating event network-vif-unplugged:fefc048a-c90e-4ca6-908e-d9728a5304fa for instance b26b640d-3b19-492b-99f2-4c0cb3c10c25 on n-h2-849104-4 Jul 12 12:00:27.815484 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-b1a7a132-f7be-404f-8602-4c4ab8d4f595 req-106d6053-c799-463b-868c-2756c3d86ae1 service nova] Creating event network-changed:c5022b36-eb9d-406c-baba-17ffa943e001 for instance e8e01337-f4c5-4f7d-ad6c-b84e035f064c on n-h2-849104-4 Jul 12 12:00:27.825654 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-b1a7a132-f7be-404f-8602-4c4ab8d4f595 req-106d6053-c799-463b-868c-2756c3d86ae1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.062318 Jul 12 12:00:27.827808 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1133/2416] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:27.834354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f870f537-49e4-4898-b067-c6b2f8f88775 tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] Action: 'create', calling method: .version_select at 0x7f5e13b5ca60>, body: {"pool": null} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:27.913410 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cbfba018-796d-4c0e-9e7f-3c6433672638 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:27.927477 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cbfba018-796d-4c0e-9e7f-3c6433672638 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:27.929452 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cbfba018-796d-4c0e-9e7f-3c6433672638 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:27.931518 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cbfba018-796d-4c0e-9e7f-3c6433672638 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.309115 Jul 12 12:00:27.932367 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1284/2417] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:27 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:27.938100 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1ac4a211-10e0-4278-87d4-fe21ad403b1b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '.version_select at 0x7f5e13b84040>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:27.938981 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1ac4a211-10e0-4278-87d4-fe21ad403b1b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:27.948857 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1ac4a211-10e0-4278-87d4-fe21ad403b1b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:27.949609 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1ac4a211-10e0-4278-87d4-fe21ad403b1b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:27.950710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1ac4a211-10e0-4278-87d4-fe21ad403b1b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:27.952057 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1ac4a211-10e0-4278-87d4-fe21ad403b1b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:28.036804 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1ac4a211-10e0-4278-87d4-fe21ad403b1b tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.103132 Jul 12 12:00:28.038287 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1285/2418] 10.222.0.50 () {60 vars in 1336 bytes} [Tue Jul 12 12:00:27 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd/os-instance-actions => generated 611 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 12:00:28.043031 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5f24ffdc-5e36-41fc-bae0-339684222f9c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:28.043899 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5f24ffdc-5e36-41fc-bae0-339684222f9c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:28.054185 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f24ffdc-5e36-41fc-bae0-339684222f9c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:28.055026 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f24ffdc-5e36-41fc-bae0-339684222f9c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:28.055988 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f24ffdc-5e36-41fc-bae0-339684222f9c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:28.056454 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f24ffdc-5e36-41fc-bae0-339684222f9c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:28.253894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5f24ffdc-5e36-41fc-bae0-339684222f9c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:28.264340 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5f24ffdc-5e36-41fc-bae0-339684222f9c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1520 microversion: 2.1 time: 0.224085 Jul 12 12:00:28.265600 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1286/2419] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:28 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:28.271085 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8264736b-03cf-407d-bf46-f14375ca3010 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:28.271820 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8264736b-03cf-407d-bf46-f14375ca3010 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:28.278363 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8264736b-03cf-407d-bf46-f14375ca3010 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:28.279030 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8264736b-03cf-407d-bf46-f14375ca3010 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:28.280003 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8264736b-03cf-407d-bf46-f14375ca3010 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:28.280639 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8264736b-03cf-407d-bf46-f14375ca3010 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:28.314691 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-8264736b-03cf-407d-bf46-f14375ca3010 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] HTTP exception thrown: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8264736b-03cf-407d-bf46-f14375ca3010 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Request method failure captured: Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd HTTP/1.1 Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWIwjxhTViBMaT0HwzePmb1tv3mw1sLaJE9WbkStPLyMMnPxfjN3tQS_FO2PXxSfO2upcIbzFAz5z3xZlEMV3lps1hIzULG6cWHeZgjBPLAyaHup_33ABP0ZE5C8UTcN_3z72V0rwj0DQIXyL1lveLqWi-6BBTaZSdTJ3Kh-kVvVA04 Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Openstack-Nova-Api-Version: 2.21 Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 89c9205141214d3fa861f126077d83ff Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1926527473 Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/89c9205141214d3fa861f126077d83ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/89c9205141214d3fa861f126077d83ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/89c9205141214d3fa861f126077d83ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_89c9205141214d3fa861f126077d83ff", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-InstanceActionsV221TestJSON-1926527473 Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 89c9205141214d3fa861f126077d83ff Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1926527473 Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-InstanceActionsV221TestJSON-1926527473-project Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 22a7fbaa31544f9cb741b7c102466c1d Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-InstanceActionsV221TestJSON-1926527473-project Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd'} Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:00:28.318281 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:00:28.325171 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:28.325171 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:28.325171 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:00:28.325171 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:28.325171 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:00:28.325171 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:00:28.325171 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:00:28.325171 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:00:28.325171 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:00:28.325171 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:28.325171 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:28.325171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8264736b-03cf-407d-bf46-f14375ca3010 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Returning 404 to user: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:00:28.325171 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8264736b-03cf-407d-bf46-f14375ca3010 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "DELETE /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 404 len: 111 microversion: 2.21 time: 0.053362 Jul 12 12:00:28.328259 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1287/2420] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 12:00:28 2022] DELETE /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 12:00:28.333121 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fb674873-4437-4607-8eff-39a3f6cadd84 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:28.334371 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fb674873-4437-4607-8eff-39a3f6cadd84 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] [instance: 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:28.341054 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb674873-4437-4607-8eff-39a3f6cadd84 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:28.341455 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb674873-4437-4607-8eff-39a3f6cadd84 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:28.342575 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb674873-4437-4607-8eff-39a3f6cadd84 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:28.343037 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb674873-4437-4607-8eff-39a3f6cadd84 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:28.365507 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-fb674873-4437-4607-8eff-39a3f6cadd84 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] HTTP exception thrown: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fb674873-4437-4607-8eff-39a3f6cadd84 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Request method failure captured: Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd HTTP/1.1 Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWIwjxhTViBMaT0HwzePmb1tv3mw1sLaJE9WbkStPLyMMnPxfjN3tQS_FO2PXxSfO2upcIbzFAz5z3xZlEMV3lps1hIzULG6cWHeZgjBPLAyaHup_33ABP0ZE5C8UTcN_3z72V0rwj0DQIXyL1lveLqWi-6BBTaZSdTJ3Kh-kVvVA04 Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Openstack-Nova-Api-Version: 2.21 Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 89c9205141214d3fa861f126077d83ff Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1926527473 Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/89c9205141214d3fa861f126077d83ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/89c9205141214d3fa861f126077d83ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/89c9205141214d3fa861f126077d83ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_89c9205141214d3fa861f126077d83ff", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-InstanceActionsV221TestJSON-1926527473 Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 89c9205141214d3fa861f126077d83ff Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1926527473 Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-InstanceActionsV221TestJSON-1926527473-project Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 22a7fbaa31544f9cb741b7c102466c1d Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-InstanceActionsV221TestJSON-1926527473-project Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd'} Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:28.367065 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:00:28.370843 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:28.370843 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:00:28.370843 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:00:28.370843 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:00:28.370843 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:00:28.370843 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:00:28.370843 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. Jul 12 12:00:28.370843 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:00:28.370843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fb674873-4437-4607-8eff-39a3f6cadd84 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] Returning 404 to user: Instance 936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:00:28.370843 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fb674873-4437-4607-8eff-39a3f6cadd84 tempest-InstanceActionsV221TestJSON-1926527473 tempest-InstanceActionsV221TestJSON-1926527473-project] 10.222.0.50 "GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd" status: 404 len: 111 microversion: 2.21 time: 0.039299 Jul 12 12:00:28.370843 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1288/2421] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:28 2022] GET /compute/v2.1/servers/936f0bdf-d7b5-48cf-b691-8c8c4a49d4bd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 12:00:28.791304 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a306329d-98d2-4660-8585-8c0ae19af043 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:28.794154 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a306329d-98d2-4660-8585-8c0ae19af043 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:28.827663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a306329d-98d2-4660-8585-8c0ae19af043 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:28.828418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a306329d-98d2-4660-8585-8c0ae19af043 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:28.834493 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a306329d-98d2-4660-8585-8c0ae19af043 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:28.836580 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a306329d-98d2-4660-8585-8c0ae19af043 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:29.158567 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=12 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:29.537050 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a306329d-98d2-4660-8585-8c0ae19af043 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:29.552531 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a306329d-98d2-4660-8585-8c0ae19af043 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1314 microversion: 2.1 time: 0.767865 Jul 12 12:00:29.556357 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1289/2422] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:28 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:29.566870 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3de5ad94-31f2-4013-807c-69f42134f814 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:29.570164 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3de5ad94-31f2-4013-807c-69f42134f814 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:29.594021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3de5ad94-31f2-4013-807c-69f42134f814 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:29.594710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3de5ad94-31f2-4013-807c-69f42134f814 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:29.595777 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3de5ad94-31f2-4013-807c-69f42134f814 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:29.598547 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3de5ad94-31f2-4013-807c-69f42134f814 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:30.023008 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3de5ad94-31f2-4013-807c-69f42134f814 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:30.061362 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3de5ad94-31f2-4013-807c-69f42134f814 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:30.069515 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3de5ad94-31f2-4013-807c-69f42134f814 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:30.074034 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3de5ad94-31f2-4013-807c-69f42134f814 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.511958 Jul 12 12:00:30.076618 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1290/2423] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:29 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:30.090485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5d4d6e25-d7f4-4d46-b0c4-dfb3279dda70 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:30.091377 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5d4d6e25-d7f4-4d46-b0c4-dfb3279dda70 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:30.102498 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5d4d6e25-d7f4-4d46-b0c4-dfb3279dda70 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:30.103208 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5d4d6e25-d7f4-4d46-b0c4-dfb3279dda70 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:30.106536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5d4d6e25-d7f4-4d46-b0c4-dfb3279dda70 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:30.108635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5d4d6e25-d7f4-4d46-b0c4-dfb3279dda70 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:30.591505 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5d4d6e25-d7f4-4d46-b0c4-dfb3279dda70 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:30.601509 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5d4d6e25-d7f4-4d46-b0c4-dfb3279dda70 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1520 microversion: 2.1 time: 0.523364 Jul 12 12:00:30.607405 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1291/2424] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:30 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1520 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:30.616786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-9bc14a96-22ac-47ae-9cf4-3bcbb8233512 req-bf6a62fb-a65f-4b5e-b9ef-70a6a83fa4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26b640d-3b19-492b-99f2-4c0cb3c10c25", "tag": "fefc048a-c90e-4ca6-908e-d9728a5304fa"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:30.633243 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-9bc14a96-22ac-47ae-9cf4-3bcbb8233512 req-bf6a62fb-a65f-4b5e-b9ef-70a6a83fa4d9 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:30.633938 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-9bc14a96-22ac-47ae-9cf4-3bcbb8233512 req-bf6a62fb-a65f-4b5e-b9ef-70a6a83fa4d9 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:30.663718 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-9bc14a96-22ac-47ae-9cf4-3bcbb8233512 req-bf6a62fb-a65f-4b5e-b9ef-70a6a83fa4d9 service nova] Creating event network-changed:fefc048a-c90e-4ca6-908e-d9728a5304fa for instance b26b640d-3b19-492b-99f2-4c0cb3c10c25 on n-h2-849104-4 Jul 12 12:00:30.705698 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-9bc14a96-22ac-47ae-9cf4-3bcbb8233512 req-bf6a62fb-a65f-4b5e-b9ef-70a6a83fa4d9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096704 Jul 12 12:00:30.706423 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1292/2425] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:30.720209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-db5affd6-d9fb-41cd-8c54-fe91b376c4af tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:30.721549 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-db5affd6-d9fb-41cd-8c54-fe91b376c4af tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:30.750457 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db5affd6-d9fb-41cd-8c54-fe91b376c4af tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:30.750919 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db5affd6-d9fb-41cd-8c54-fe91b376c4af tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:30.751752 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db5affd6-d9fb-41cd-8c54-fe91b376c4af tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:30.752284 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db5affd6-d9fb-41cd-8c54-fe91b376c4af tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:31.067610 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-db5affd6-d9fb-41cd-8c54-fe91b376c4af tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:31.087238 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-db5affd6-d9fb-41cd-8c54-fe91b376c4af tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1314 microversion: 2.1 time: 0.379014 Jul 12 12:00:31.091021 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1293/2426] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:30 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:31.096557 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-125b7300-76a1-4c9d-87d4-b0bd554dfdcf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:31.097171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-125b7300-76a1-4c9d-87d4-b0bd554dfdcf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:31.110527 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-125b7300-76a1-4c9d-87d4-b0bd554dfdcf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:31.111331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-125b7300-76a1-4c9d-87d4-b0bd554dfdcf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:31.112871 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-125b7300-76a1-4c9d-87d4-b0bd554dfdcf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:31.113644 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-125b7300-76a1-4c9d-87d4-b0bd554dfdcf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:31.186436 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f870f537-49e4-4898-b067-c6b2f8f88775 tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.355232 Jul 12 12:00:31.188481 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1134/2427] 10.222.0.50 () {60 vars in 1169 bytes} [Tue Jul 12 12:00:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:31.203006 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b7e88bea-547f-4ca6-9ca9-fcc68bbcc5f5 tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] Calling method '.version_select at 0x7f5e0a6c2f70>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:31.549354 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-125b7300-76a1-4c9d-87d4-b0bd554dfdcf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:31.561601 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-125b7300-76a1-4c9d-87d4-b0bd554dfdcf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:31.565423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-125b7300-76a1-4c9d-87d4-b0bd554dfdcf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:31.570551 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-125b7300-76a1-4c9d-87d4-b0bd554dfdcf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.478634 Jul 12 12:00:31.592693 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1294/2428] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:31 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:31.619161 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6d39a900-6301-49d5-abc9-59e32fd7d228 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:31.620001 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6d39a900-6301-49d5-abc9-59e32fd7d228 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:31.635389 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d39a900-6301-49d5-abc9-59e32fd7d228 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:31.636150 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d39a900-6301-49d5-abc9-59e32fd7d228 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:31.637106 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d39a900-6301-49d5-abc9-59e32fd7d228 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:31.637665 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d39a900-6301-49d5-abc9-59e32fd7d228 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:32.000740 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6d39a900-6301-49d5-abc9-59e32fd7d228 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:32.018918 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6d39a900-6301-49d5-abc9-59e32fd7d228 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1520 microversion: 2.1 time: 0.400195 Jul 12 12:00:32.022322 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1295/2429] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:31 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1520 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:32.110365 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dac3a082-500e-453e-919d-08ba49abf476 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:32.110983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dac3a082-500e-453e-919d-08ba49abf476 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:32.120743 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dac3a082-500e-453e-919d-08ba49abf476 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:32.124908 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dac3a082-500e-453e-919d-08ba49abf476 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:32.125754 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dac3a082-500e-453e-919d-08ba49abf476 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:32.126294 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dac3a082-500e-453e-919d-08ba49abf476 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:32.395038 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dac3a082-500e-453e-919d-08ba49abf476 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:32.413997 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dac3a082-500e-453e-919d-08ba49abf476 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1314 microversion: 2.1 time: 0.308797 Jul 12 12:00:32.428379 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1296/2430] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:32 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:32.610682 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e981236f-cc8f-4e8c-a34f-207155003c32 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Action: 'create', calling method: .version_select at 0x7f5e13bfa670>, body: {"keypair": {"name": "tempest-keypair-279994026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLp6Ubm8E9KY1l9DBu1uWKCJg1XRNMhbxq4hePRF+LQPQyIwj0Fg9BeNf0DNR6v8N33BGwdLoY0DDrLlU1CfdtpknHoOy0SBgdDNrXi2d8A3Kw1/t2watLI1vmZOTXboQ=="}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:32.626944 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b7e88bea-547f-4ca6-9ca9-fcc68bbcc5f5 tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/a33b3144-323e-4fca-980c-11048515d900" status: 200 len: 142 microversion: 2.1 time: 1.431190 Jul 12 12:00:32.637831 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1135/2431] 10.222.0.50 () {58 vars in 1259 bytes} [Tue Jul 12 12:00:31 2022] GET /compute/v2.1/os-floating-ips/a33b3144-323e-4fca-980c-11048515d900 => generated 142 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:32.637831 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ded37f7c-43d7-4296-954c-acafc987b962 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:32.637831 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ded37f7c-43d7-4296-954c-acafc987b962 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:32.645491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ded37f7c-43d7-4296-954c-acafc987b962 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:32.645979 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ded37f7c-43d7-4296-954c-acafc987b962 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:32.646754 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ded37f7c-43d7-4296-954c-acafc987b962 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:32.647209 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ded37f7c-43d7-4296-954c-acafc987b962 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:32.658871 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-e981236f-cc8f-4e8c-a34f-207155003c32 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Getting quotas for project 15fad99a609b4c8cb44c8d83adae2f62. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:00:32.668309 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-e981236f-cc8f-4e8c-a34f-207155003c32 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Getting quotas for user c0a99251f6314c1298b54cdaef4ce916 and project 15fad99a609b4c8cb44c8d83adae2f62. Resources: {'key_pairs'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:00:32.710990 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e981236f-cc8f-4e8c-a34f-207155003c32 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.279322 Jul 12 12:00:32.712482 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1297/2432] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 12:00:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:32.720777 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d9ebcd9f-3c20-457f-8cb2-ee9c9866f758 tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] Calling method '.version_select at 0x7f5e13af5040>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:33.067964 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ded37f7c-43d7-4296-954c-acafc987b962 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:33.084335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ded37f7c-43d7-4296-954c-acafc987b962 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:33.086448 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ded37f7c-43d7-4296-954c-acafc987b962 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:33.089082 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ded37f7c-43d7-4296-954c-acafc987b962 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.459926 Jul 12 12:00:33.105794 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1136/2433] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:32 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:33.113880 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e9f21eb9-1bbc-453f-97c7-30c0fd159b8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:33.115683 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e9f21eb9-1bbc-453f-97c7-30c0fd159b8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:33.124412 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9f21eb9-1bbc-453f-97c7-30c0fd159b8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:33.125834 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9f21eb9-1bbc-453f-97c7-30c0fd159b8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:33.126855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9f21eb9-1bbc-453f-97c7-30c0fd159b8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:33.127534 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9f21eb9-1bbc-453f-97c7-30c0fd159b8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:33.505190 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e9f21eb9-1bbc-453f-97c7-30c0fd159b8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:33.518872 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e9f21eb9-1bbc-453f-97c7-30c0fd159b8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1520 microversion: 2.1 time: 0.411302 Jul 12 12:00:33.520617 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1137/2434] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:33 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1520 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:33.528696 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7aa9ad4b-4fe2-4b73-a12c-df086c050fa0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:33.530333 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7aa9ad4b-4fe2-4b73-a12c-df086c050fa0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:33.538526 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7aa9ad4b-4fe2-4b73-a12c-df086c050fa0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:33.538526 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7aa9ad4b-4fe2-4b73-a12c-df086c050fa0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:33.539578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7aa9ad4b-4fe2-4b73-a12c-df086c050fa0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:33.540056 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7aa9ad4b-4fe2-4b73-a12c-df086c050fa0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:33.749107 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7aa9ad4b-4fe2-4b73-a12c-df086c050fa0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:33.764698 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7aa9ad4b-4fe2-4b73-a12c-df086c050fa0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1314 microversion: 2.1 time: 0.240937 Jul 12 12:00:33.766280 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1138/2435] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:33 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:33.796814 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=4 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:34.122907 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e27f291f-4d69-42ad-a6d2-3f256e5c3126 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:34.123607 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e27f291f-4d69-42ad-a6d2-3f256e5c3126 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:34.131559 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e27f291f-4d69-42ad-a6d2-3f256e5c3126 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:34.132186 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e27f291f-4d69-42ad-a6d2-3f256e5c3126 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:34.133091 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e27f291f-4d69-42ad-a6d2-3f256e5c3126 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:34.133758 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e27f291f-4d69-42ad-a6d2-3f256e5c3126 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:34.459873 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e27f291f-4d69-42ad-a6d2-3f256e5c3126 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:34.481578 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e27f291f-4d69-42ad-a6d2-3f256e5c3126 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:34.483941 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e27f291f-4d69-42ad-a6d2-3f256e5c3126 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:34.487122 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e27f291f-4d69-42ad-a6d2-3f256e5c3126 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.371933 Jul 12 12:00:34.487760 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1139/2436] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:34 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:00:34.553232 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-37b6f28a-174f-4e2b-a7f8-0dd0a968eeec tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:34.554781 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-37b6f28a-174f-4e2b-a7f8-0dd0a968eeec tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:34.569605 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37b6f28a-174f-4e2b-a7f8-0dd0a968eeec tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:34.570252 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37b6f28a-174f-4e2b-a7f8-0dd0a968eeec tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:34.571340 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37b6f28a-174f-4e2b-a7f8-0dd0a968eeec tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:34.571789 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37b6f28a-174f-4e2b-a7f8-0dd0a968eeec tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:34.601506 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:34.784381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-37b6f28a-174f-4e2b-a7f8-0dd0a968eeec tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:34.794003 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-37b6f28a-174f-4e2b-a7f8-0dd0a968eeec tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1520 microversion: 2.1 time: 0.254855 Jul 12 12:00:34.799079 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1140/2437] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:34 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:34.817544 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-c30a74b3-1031-419a-b00f-e67453b8f43c req-fa578930-c124-4ddb-95af-23c789b0bd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e01337-f4c5-4f7d-ad6c-b84e035f064c", "name": "network-vif-plugged", "status": "completed", "tag": "c5022b36-eb9d-406c-baba-17ffa943e001"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:34.827540 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-c30a74b3-1031-419a-b00f-e67453b8f43c req-fa578930-c124-4ddb-95af-23c789b0bd6f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:34.828267 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-c30a74b3-1031-419a-b00f-e67453b8f43c req-fa578930-c124-4ddb-95af-23c789b0bd6f service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:34.845375 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-c30a74b3-1031-419a-b00f-e67453b8f43c req-fa578930-c124-4ddb-95af-23c789b0bd6f service nova] Creating event network-vif-plugged:c5022b36-eb9d-406c-baba-17ffa943e001 for instance e8e01337-f4c5-4f7d-ad6c-b84e035f064c on n-h2-849104-4 Jul 12 12:00:34.850847 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-c30a74b3-1031-419a-b00f-e67453b8f43c req-fa578930-c124-4ddb-95af-23c789b0bd6f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041142 Jul 12 12:00:34.852061 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1141/2438] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:34.858642 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-448ded54-4532-40a3-a8b0-ccdbe6f32f75 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:34.859831 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-448ded54-4532-40a3-a8b0-ccdbe6f32f75 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:34.867493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-448ded54-4532-40a3-a8b0-ccdbe6f32f75 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:34.868756 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-448ded54-4532-40a3-a8b0-ccdbe6f32f75 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:34.870166 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-448ded54-4532-40a3-a8b0-ccdbe6f32f75 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:34.870990 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-448ded54-4532-40a3-a8b0-ccdbe6f32f75 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:34.953613 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d9ebcd9f-3c20-457f-8cb2-ee9c9866f758 tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/a33b3144-323e-4fca-980c-11048515d900" status: 202 len: 0 microversion: 2.1 time: 2.239193 Jul 12 12:00:34.955158 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1298/2439] 10.222.0.50 () {58 vars in 1262 bytes} [Tue Jul 12 12:00:32 2022] DELETE /compute/v2.1/os-floating-ips/a33b3144-323e-4fca-980c-11048515d900 => generated 0 bytes in 2242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 12:00:34.969046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a2e8f3dd-93ae-4a87-b114-82ffa768dd24 tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] Calling method '.version_select at 0x7f5e099a9ee0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:35.106959 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-448ded54-4532-40a3-a8b0-ccdbe6f32f75 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:35.115400 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-448ded54-4532-40a3-a8b0-ccdbe6f32f75 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1314 microversion: 2.1 time: 0.261867 Jul 12 12:00:35.120321 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1142/2440] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:34 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:35.511031 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bf4c203d-41c1-43db-908e-2a4a5670adb8 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:35.513152 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-bf4c203d-41c1-43db-908e-2a4a5670adb8 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:35.523162 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bf4c203d-41c1-43db-908e-2a4a5670adb8 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:35.523886 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bf4c203d-41c1-43db-908e-2a4a5670adb8 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:35.524963 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bf4c203d-41c1-43db-908e-2a4a5670adb8 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:35.525677 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bf4c203d-41c1-43db-908e-2a4a5670adb8 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:35.619618 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a2e8f3dd-93ae-4a87-b114-82ffa768dd24 tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.658716 Jul 12 12:00:35.620687 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1299/2441] 10.222.0.50 () {58 vars in 1163 bytes} [Tue Jul 12 12:00:34 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 12:00:35.636772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-94d19b0a-f335-44da-8824-8a6837cbd5fa tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] Calling method '.version_select at 0x7f5e13af5280>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:35.811951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=18 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:35.833948 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bf4c203d-41c1-43db-908e-2a4a5670adb8 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:35.851432 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bf4c203d-41c1-43db-908e-2a4a5670adb8 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:35.853168 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bf4c203d-41c1-43db-908e-2a4a5670adb8 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:35.854409 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bf4c203d-41c1-43db-908e-2a4a5670adb8 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.351171 Jul 12 12:00:35.856302 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1143/2442] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:35 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:35.862476 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d25a1d3d-f568-4ad3-a8c9-eee6ee470ce4 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:35.863304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d25a1d3d-f568-4ad3-a8c9-eee6ee470ce4 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:35.871955 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d25a1d3d-f568-4ad3-a8c9-eee6ee470ce4 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:35.872445 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d25a1d3d-f568-4ad3-a8c9-eee6ee470ce4 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:35.873865 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d25a1d3d-f568-4ad3-a8c9-eee6ee470ce4 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:35.874303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d25a1d3d-f568-4ad3-a8c9-eee6ee470ce4 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:36.087876 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-94d19b0a-f335-44da-8824-8a6837cbd5fa tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.454828 Jul 12 12:00:36.103550 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1300/2443] 10.222.0.50 () {58 vars in 1148 bytes} [Tue Jul 12 12:00:35 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:36.110434 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-52846f07-a884-4963-bb0a-464ab5c5a0ba tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] Calling method '.version_select at 0x7f5e13b17ca0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:36.154483 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d25a1d3d-f568-4ad3-a8c9-eee6ee470ce4 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:36.179589 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d25a1d3d-f568-4ad3-a8c9-eee6ee470ce4 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1520 microversion: 2.1 time: 0.321794 Jul 12 12:00:36.189862 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1144/2444] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:35 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:36.213150 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d4ebe60a-f733-40cd-9fdd-863ca01826db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:36.214124 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d4ebe60a-f733-40cd-9fdd-863ca01826db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:36.224149 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d4ebe60a-f733-40cd-9fdd-863ca01826db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:36.224895 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d4ebe60a-f733-40cd-9fdd-863ca01826db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:36.226758 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d4ebe60a-f733-40cd-9fdd-863ca01826db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:36.227778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d4ebe60a-f733-40cd-9fdd-863ca01826db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:36.543405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d4ebe60a-f733-40cd-9fdd-863ca01826db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:36.552444 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d4ebe60a-f733-40cd-9fdd-863ca01826db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1314 microversion: 2.1 time: 0.354412 Jul 12 12:00:36.555232 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1145/2445] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:36 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:36.876009 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ff506efd-4227-4ab8-a2e0-6715311d37f7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:36.876678 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ff506efd-4227-4ab8-a2e0-6715311d37f7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:36.884541 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff506efd-4227-4ab8-a2e0-6715311d37f7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:36.885255 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff506efd-4227-4ab8-a2e0-6715311d37f7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:36.886226 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff506efd-4227-4ab8-a2e0-6715311d37f7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:36.886828 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff506efd-4227-4ab8-a2e0-6715311d37f7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:37.074743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ff506efd-4227-4ab8-a2e0-6715311d37f7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:37.090863 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ff506efd-4227-4ab8-a2e0-6715311d37f7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:37.109351 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ff506efd-4227-4ab8-a2e0-6715311d37f7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:37.111726 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ff506efd-4227-4ab8-a2e0-6715311d37f7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.239919 Jul 12 12:00:37.127598 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1146/2446] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:36 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:37.205367 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c0f36d2c-af02-49ff-b5e5-8d6a418a0382 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:37.206174 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c0f36d2c-af02-49ff-b5e5-8d6a418a0382 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:37.230383 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c0f36d2c-af02-49ff-b5e5-8d6a418a0382 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:37.231486 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c0f36d2c-af02-49ff-b5e5-8d6a418a0382 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:37.234586 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c0f36d2c-af02-49ff-b5e5-8d6a418a0382 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:37.235292 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c0f36d2c-af02-49ff-b5e5-8d6a418a0382 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:37.469188 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c0f36d2c-af02-49ff-b5e5-8d6a418a0382 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:37.478373 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c0f36d2c-af02-49ff-b5e5-8d6a418a0382 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1520 microversion: 2.1 time: 0.278780 Jul 12 12:00:37.479298 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1147/2447] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:37 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:37.484725 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-799378067", "imageRef": "960950a7-c4af-4324-9418-db40e6faee77", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "61082332-84e1-4570-884a-d727ccecd656"}], "security_groups": [{"name": "tempest-securitygroup--217474055"}], "key_name": "tempest-keypair-279994026", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:37.562006 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-52846f07-a884-4963-bb0a-464ab5c5a0ba tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/b3d99d98-9678-4100-ac9b-5ae62700260e" status: 202 len: 0 microversion: 2.1 time: 1.456553 Jul 12 12:00:37.563240 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1301/2448] 10.222.0.50 () {58 vars in 1262 bytes} [Tue Jul 12 12:00:36 2022] DELETE /compute/v2.1/os-floating-ips/b3d99d98-9678-4100-ac9b-5ae62700260e => generated 0 bytes in 1459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 12:00:37.577628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b8646309-8717-4b5c-b8d7-ffeebb83dca3 tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] Calling method '.version_select at 0x7f5e099a9d30>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:37.686047 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] validate_networks() for [('61082332-84e1-4570-884a-d727ccecd656', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 12:00:38.200550 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:00:38.201260 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:00:38.201712 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:00:38.202232 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:00:38.202752 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:00:38.216271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:38.217487 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:38.218369 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:38.218916 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:38.239703 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Getting quotas for project 15fad99a609b4c8cb44c8d83adae2f62. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:00:38.246110 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Getting quotas for user c0a99251f6314c1298b54cdaef4ce916 and project 15fad99a609b4c8cb44c8d83adae2f62. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:00:38.261649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 12:00:38.265283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='960950a7-c4af-4324-9418-db40e6faee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:00:38.332799 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-53ac3e38-8b38-4d29-a350-d04c5a6f2dd0 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.851550 Jul 12 12:00:38.334324 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1148/2449] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 12:00:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 12:00:38.340157 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1e3ad931-bdce-4ab5-ae4a-915c4b011c5d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:38.341116 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1e3ad931-bdce-4ab5-ae4a-915c4b011c5d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:38.350044 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1e3ad931-bdce-4ab5-ae4a-915c4b011c5d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:38.350807 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1e3ad931-bdce-4ab5-ae4a-915c4b011c5d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:38.351772 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1e3ad931-bdce-4ab5-ae4a-915c4b011c5d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:38.352411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1e3ad931-bdce-4ab5-ae4a-915c4b011c5d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:38.633210 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1e3ad931-bdce-4ab5-ae4a-915c4b011c5d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:38.646062 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1e3ad931-bdce-4ab5-ae4a-915c4b011c5d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1500 microversion: 2.1 time: 0.309971 Jul 12 12:00:38.646902 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1149/2450] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:38 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1500 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:38.653894 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3bed809d-6ee0-4733-b2e4-e9b87f5b1ca7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:38.655589 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3bed809d-6ee0-4733-b2e4-e9b87f5b1ca7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:38.663989 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3bed809d-6ee0-4733-b2e4-e9b87f5b1ca7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:38.664730 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3bed809d-6ee0-4733-b2e4-e9b87f5b1ca7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:38.665917 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3bed809d-6ee0-4733-b2e4-e9b87f5b1ca7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:38.666942 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3bed809d-6ee0-4733-b2e4-e9b87f5b1ca7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:38.913648 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b8646309-8717-4b5c-b8d7-ffeebb83dca3 tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/77719865-fa97-433a-afc3-ba8bc45e765d" status: 202 len: 0 microversion: 2.1 time: 1.345746 Jul 12 12:00:38.914986 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1302/2451] 10.222.0.50 () {58 vars in 1262 bytes} [Tue Jul 12 12:00:37 2022] DELETE /compute/v2.1/os-floating-ips/77719865-fa97-433a-afc3-ba8bc45e765d => generated 0 bytes in 1347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 12:00:38.930654 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f6ecdc51-9d33-4173-95d6-c33e7ea2acdb tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:38.936694 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f6ecdc51-9d33-4173-95d6-c33e7ea2acdb tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:38.987987 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3bed809d-6ee0-4733-b2e4-e9b87f5b1ca7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:39.022291 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3bed809d-6ee0-4733-b2e4-e9b87f5b1ca7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:39.024450 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3bed809d-6ee0-4733-b2e4-e9b87f5b1ca7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:39.026447 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3bed809d-6ee0-4733-b2e4-e9b87f5b1ca7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.378481 Jul 12 12:00:39.031448 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1150/2452] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:38 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:39.047853 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e9d79d90-ff08-4826-9939-162a50c4371e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:39.049434 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e9d79d90-ff08-4826-9939-162a50c4371e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:39.070923 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9d79d90-ff08-4826-9939-162a50c4371e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:39.071422 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9d79d90-ff08-4826-9939-162a50c4371e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:39.073888 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f6ecdc51-9d33-4173-95d6-c33e7ea2acdb tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:39.074259 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9d79d90-ff08-4826-9939-162a50c4371e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:39.074930 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9d79d90-ff08-4826-9939-162a50c4371e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:39.094836 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f6ecdc51-9d33-4173-95d6-c33e7ea2acdb tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1244 microversion: 2.1 time: 0.172570 Jul 12 12:00:39.095447 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1303/2453] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:38 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1244 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:39.108478 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ccd736a4-3be8-4be5-830c-2920423f26db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:39.112639 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ccd736a4-3be8-4be5-830c-2920423f26db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:39.128951 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ccd736a4-3be8-4be5-830c-2920423f26db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:39.129804 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ccd736a4-3be8-4be5-830c-2920423f26db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:39.130599 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ccd736a4-3be8-4be5-830c-2920423f26db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:39.131447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ccd736a4-3be8-4be5-830c-2920423f26db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:39.180697 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-ccd736a4-3be8-4be5-830c-2920423f26db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lazy-loading 'flavor' on Instance uuid e8e01337-f4c5-4f7d-ad6c-b84e035f064c {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:00:39.320484 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ccd736a4-3be8-4be5-830c-2920423f26db tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "POST /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c/action" status: 200 len: 32 microversion: 2.1 time: 0.218749 Jul 12 12:00:39.321614 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1304/2454] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 12:00:39 2022] POST /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 12:00:39.330491 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-54663ade-023b-4c8e-b6c6-d8783b015a35 req-ac9e8267-2fc2-49d3-ad44-8441b71f4bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26b640d-3b19-492b-99f2-4c0cb3c10c25", "name": "network-vif-unplugged", "status": "completed", "tag": "fefc048a-c90e-4ca6-908e-d9728a5304fa"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:39.340459 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-54663ade-023b-4c8e-b6c6-d8783b015a35 req-ac9e8267-2fc2-49d3-ad44-8441b71f4bac service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:39.340783 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-54663ade-023b-4c8e-b6c6-d8783b015a35 req-ac9e8267-2fc2-49d3-ad44-8441b71f4bac service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:39.367591 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-54663ade-023b-4c8e-b6c6-d8783b015a35 req-ac9e8267-2fc2-49d3-ad44-8441b71f4bac service nova] Creating event network-vif-unplugged:fefc048a-c90e-4ca6-908e-d9728a5304fa for instance b26b640d-3b19-492b-99f2-4c0cb3c10c25 on n-h2-849104-4 Jul 12 12:00:39.376476 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-54663ade-023b-4c8e-b6c6-d8783b015a35 req-ac9e8267-2fc2-49d3-ad44-8441b71f4bac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052679 Jul 12 12:00:39.377814 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1305/2455] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:39.385700 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e9d79d90-ff08-4826-9939-162a50c4371e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:39.387315 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-32adc4a8-e5dd-466c-b5f6-da37743a990d tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] Calling method '.version_select at 0x7f5e13bddee0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:39.400074 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e9d79d90-ff08-4826-9939-162a50c4371e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1520 microversion: 2.1 time: 0.364972 Jul 12 12:00:39.401046 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1151/2456] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:39 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1520 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:39.406480 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-76646d68-8ad7-4d30-907e-acf40cf2ddc5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:39.407315 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-76646d68-8ad7-4d30-907e-acf40cf2ddc5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:39.413885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76646d68-8ad7-4d30-907e-acf40cf2ddc5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:39.414593 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76646d68-8ad7-4d30-907e-acf40cf2ddc5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:39.415606 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76646d68-8ad7-4d30-907e-acf40cf2ddc5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:39.416227 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-76646d68-8ad7-4d30-907e-acf40cf2ddc5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:39.942360 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-76646d68-8ad7-4d30-907e-acf40cf2ddc5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:39.953502 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-76646d68-8ad7-4d30-907e-acf40cf2ddc5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.551065 Jul 12 12:00:39.967255 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1152/2457] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:39 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:40.062177 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1dbe6bd8-0aa4-410c-9b32-b0d9bd218626 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:40.063724 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1dbe6bd8-0aa4-410c-9b32-b0d9bd218626 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:40.074562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1dbe6bd8-0aa4-410c-9b32-b0d9bd218626 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:40.075570 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1dbe6bd8-0aa4-410c-9b32-b0d9bd218626 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:40.077363 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1dbe6bd8-0aa4-410c-9b32-b0d9bd218626 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:40.077993 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1dbe6bd8-0aa4-410c-9b32-b0d9bd218626 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:40.823074 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1dbe6bd8-0aa4-410c-9b32-b0d9bd218626 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:40.841963 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1dbe6bd8-0aa4-410c-9b32-b0d9bd218626 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:40.847140 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1dbe6bd8-0aa4-410c-9b32-b0d9bd218626 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:40.849175 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1dbe6bd8-0aa4-410c-9b32-b0d9bd218626 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.795835 Jul 12 12:00:40.852630 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1153/2458] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:40 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:00:40.863170 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f5b3058d-e035-49ef-838e-1b88179f7cf1 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:40.873747 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f5b3058d-e035-49ef-838e-1b88179f7cf1 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:40.916090 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5b3058d-e035-49ef-838e-1b88179f7cf1 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:40.918338 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5b3058d-e035-49ef-838e-1b88179f7cf1 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:40.921222 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5b3058d-e035-49ef-838e-1b88179f7cf1 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:40.922471 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5b3058d-e035-49ef-838e-1b88179f7cf1 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:41.382862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f5b3058d-e035-49ef-838e-1b88179f7cf1 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:41.402963 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f5b3058d-e035-49ef-838e-1b88179f7cf1 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1302 microversion: 2.1 time: 0.548945 Jul 12 12:00:41.404970 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1154/2459] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:40 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1302 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:41.424147 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-beef17b5-a049-48d9-88dd-746a1a443d1c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:41.425081 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-beef17b5-a049-48d9-88dd-746a1a443d1c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:41.453315 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-beef17b5-a049-48d9-88dd-746a1a443d1c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:41.454055 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-beef17b5-a049-48d9-88dd-746a1a443d1c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:41.458141 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-beef17b5-a049-48d9-88dd-746a1a443d1c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:41.459537 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-beef17b5-a049-48d9-88dd-746a1a443d1c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:41.816956 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-32adc4a8-e5dd-466c-b5f6-da37743a990d tempest-FloatingIPDetailsTestJSON-609978661 tempest-FloatingIPDetailsTestJSON-609978661-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/27f17adc-8ec6-4989-a427-c1c9a5fda44c" status: 202 len: 0 microversion: 2.1 time: 2.436603 Jul 12 12:00:41.818845 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1306/2460] 10.222.0.50 () {58 vars in 1262 bytes} [Tue Jul 12 12:00:39 2022] DELETE /compute/v2.1/os-floating-ips/27f17adc-8ec6-4989-a427-c1c9a5fda44c => generated 0 bytes in 2440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 12:00:41.837069 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-584f3cc9-54f5-4d94-8938-d847890d2d18 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:41.843148 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-584f3cc9-54f5-4d94-8938-d847890d2d18 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:41.875525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-584f3cc9-54f5-4d94-8938-d847890d2d18 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:41.878569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-584f3cc9-54f5-4d94-8938-d847890d2d18 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:41.880843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-584f3cc9-54f5-4d94-8938-d847890d2d18 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:41.889786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-584f3cc9-54f5-4d94-8938-d847890d2d18 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:42.472097 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-beef17b5-a049-48d9-88dd-746a1a443d1c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:42.491695 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-beef17b5-a049-48d9-88dd-746a1a443d1c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1520 microversion: 2.1 time: 1.084047 Jul 12 12:00:42.493486 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1155/2461] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:41 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1520 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:42.502606 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-017a61b7-eb82-417b-acd7-8cee95293596 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:42.514118 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-017a61b7-eb82-417b-acd7-8cee95293596 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:42.529510 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-017a61b7-eb82-417b-acd7-8cee95293596 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:42.530662 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-017a61b7-eb82-417b-acd7-8cee95293596 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:42.531873 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-017a61b7-eb82-417b-acd7-8cee95293596 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:42.532726 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-017a61b7-eb82-417b-acd7-8cee95293596 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:42.697003 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-584f3cc9-54f5-4d94-8938-d847890d2d18 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:42.744844 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-584f3cc9-54f5-4d94-8938-d847890d2d18 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.920470 Jul 12 12:00:42.761276 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1307/2462] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:41 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:42.772629 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-215c91cd-1e03-4d6a-be96-4c9ce9b76ac7 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:42.774227 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-215c91cd-1e03-4d6a-be96-4c9ce9b76ac7 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:42.811756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-215c91cd-1e03-4d6a-be96-4c9ce9b76ac7 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:42.813084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-215c91cd-1e03-4d6a-be96-4c9ce9b76ac7 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:42.816166 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-215c91cd-1e03-4d6a-be96-4c9ce9b76ac7 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:42.820063 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-215c91cd-1e03-4d6a-be96-4c9ce9b76ac7 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:42.953878 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:43.498718 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-215c91cd-1e03-4d6a-be96-4c9ce9b76ac7 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:43.518967 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-215c91cd-1e03-4d6a-be96-4c9ce9b76ac7 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1369 microversion: 2.1 time: 0.753556 Jul 12 12:00:43.534623 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1308/2463] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:42 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1369 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:43.543691 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4abed51e-4a4b-41e6-b160-ec4dfb4f24f6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:43.546749 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4abed51e-4a4b-41e6-b160-ec4dfb4f24f6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:43.563670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4abed51e-4a4b-41e6-b160-ec4dfb4f24f6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:43.564677 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4abed51e-4a4b-41e6-b160-ec4dfb4f24f6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:43.571621 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4abed51e-4a4b-41e6-b160-ec4dfb4f24f6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:43.572458 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4abed51e-4a4b-41e6-b160-ec4dfb4f24f6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:44.182990 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4abed51e-4a4b-41e6-b160-ec4dfb4f24f6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:44.200250 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4abed51e-4a4b-41e6-b160-ec4dfb4f24f6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1520 microversion: 2.1 time: 0.656436 Jul 12 12:00:44.201207 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1309/2464] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:43 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1520 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:44.214784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d8bc2284-4dc8-4f03-b4ee-c698389e98c2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:44.215679 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d8bc2284-4dc8-4f03-b4ee-c698389e98c2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:44.226470 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d8bc2284-4dc8-4f03-b4ee-c698389e98c2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:44.227180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d8bc2284-4dc8-4f03-b4ee-c698389e98c2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:44.233835 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d8bc2284-4dc8-4f03-b4ee-c698389e98c2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:44.234666 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d8bc2284-4dc8-4f03-b4ee-c698389e98c2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:44.290057 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-017a61b7-eb82-417b-acd7-8cee95293596 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:44.309112 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-017a61b7-eb82-417b-acd7-8cee95293596 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:44.311374 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-017a61b7-eb82-417b-acd7-8cee95293596 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:44.312726 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-017a61b7-eb82-417b-acd7-8cee95293596 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 1.817816 Jul 12 12:00:44.313298 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1156/2465] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:42 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:44.551913 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8b62c1f6-7a65-4b7b-8c9b-be61709599da tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:44.556677 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8b62c1f6-7a65-4b7b-8c9b-be61709599da tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:44.580769 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8b62c1f6-7a65-4b7b-8c9b-be61709599da tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:44.583886 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8b62c1f6-7a65-4b7b-8c9b-be61709599da tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:44.586279 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8b62c1f6-7a65-4b7b-8c9b-be61709599da tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:44.587300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8b62c1f6-7a65-4b7b-8c9b-be61709599da tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:44.779207 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d8bc2284-4dc8-4f03-b4ee-c698389e98c2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:44.791788 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d8bc2284-4dc8-4f03-b4ee-c698389e98c2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.589173 Jul 12 12:00:44.808071 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1310/2466] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:44 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:45.226411 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-157bf5ac-1368-42bc-9912-c69d6a8d0d0a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:45.227404 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-157bf5ac-1368-42bc-9912-c69d6a8d0d0a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:45.240528 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-157bf5ac-1368-42bc-9912-c69d6a8d0d0a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:45.241369 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-157bf5ac-1368-42bc-9912-c69d6a8d0d0a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:45.247026 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-157bf5ac-1368-42bc-9912-c69d6a8d0d0a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:45.248629 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-157bf5ac-1368-42bc-9912-c69d6a8d0d0a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:45.639720 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8b62c1f6-7a65-4b7b-8c9b-be61709599da tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:45.670440 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8b62c1f6-7a65-4b7b-8c9b-be61709599da tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1369 microversion: 2.1 time: 1.128687 Jul 12 12:00:45.689876 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1157/2467] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:44 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1369 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:00:45.705544 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-abdb7cbf-eef8-4e4c-a76b-a649aa25041c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:45.712197 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-abdb7cbf-eef8-4e4c-a76b-a649aa25041c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:45.728157 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-abdb7cbf-eef8-4e4c-a76b-a649aa25041c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:45.729208 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-abdb7cbf-eef8-4e4c-a76b-a649aa25041c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:45.731539 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-abdb7cbf-eef8-4e4c-a76b-a649aa25041c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:45.733397 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-abdb7cbf-eef8-4e4c-a76b-a649aa25041c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:45.743929 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:45.985689 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-157bf5ac-1368-42bc-9912-c69d6a8d0d0a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:46.011054 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-157bf5ac-1368-42bc-9912-c69d6a8d0d0a tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1520 microversion: 2.1 time: 0.788608 Jul 12 12:00:46.014947 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1311/2468] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:45 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1520 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:46.027387 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4cd50dc5-305d-4bc5-8606-c09b90d4fa04 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:46.030373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4cd50dc5-305d-4bc5-8606-c09b90d4fa04 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:46.052461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4cd50dc5-305d-4bc5-8606-c09b90d4fa04 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:46.054707 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4cd50dc5-305d-4bc5-8606-c09b90d4fa04 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:46.057418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4cd50dc5-305d-4bc5-8606-c09b90d4fa04 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:46.058974 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4cd50dc5-305d-4bc5-8606-c09b90d4fa04 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:46.598946 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-abdb7cbf-eef8-4e4c-a76b-a649aa25041c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:46.612383 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4cd50dc5-305d-4bc5-8606-c09b90d4fa04 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:46.624521 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4cd50dc5-305d-4bc5-8606-c09b90d4fa04 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.607358 Jul 12 12:00:46.630883 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1312/2469] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:46 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:46.634365 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-abdb7cbf-eef8-4e4c-a76b-a649aa25041c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:46.642311 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-abdb7cbf-eef8-4e4c-a76b-a649aa25041c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:46.647052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-12c3acdc-378d-411a-9880-80270639306d req-e313bb4a-cd22-439f-8b5b-874722756791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea153f9-9c62-4a41-a8be-4bdf4c5d3998", "tag": "019bd511-acab-4a0b-948a-24a1fb3e56ad"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:46.648763 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-abdb7cbf-eef8-4e4c-a76b-a649aa25041c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1815 microversion: 2.25 time: 0.954199 Jul 12 12:00:46.652701 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1158/2470] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:45 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1815 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:46.692839 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-12c3acdc-378d-411a-9880-80270639306d req-e313bb4a-cd22-439f-8b5b-874722756791 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:46.693359 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-12c3acdc-378d-411a-9880-80270639306d req-e313bb4a-cd22-439f-8b5b-874722756791 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:46.702232 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9210122e-147d-4d86-930a-ffb7decd1b05 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:46.703088 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9210122e-147d-4d86-930a-ffb7decd1b05 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:46.720167 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9210122e-147d-4d86-930a-ffb7decd1b05 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:46.722686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9210122e-147d-4d86-930a-ffb7decd1b05 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:46.725305 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9210122e-147d-4d86-930a-ffb7decd1b05 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:46.727880 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9210122e-147d-4d86-930a-ffb7decd1b05 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:46.732973 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-12c3acdc-378d-411a-9880-80270639306d req-e313bb4a-cd22-439f-8b5b-874722756791 service nova] Creating event network-changed:019bd511-acab-4a0b-948a-24a1fb3e56ad for instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 on n-h2-849104-4 Jul 12 12:00:46.748417 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-12c3acdc-378d-411a-9880-80270639306d req-e313bb4a-cd22-439f-8b5b-874722756791 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113832 Jul 12 12:00:46.750891 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1313/2471] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:47.043925 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-478178bb-9dbe-4d9b-b17a-e4d6a6f3f4d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:47.059515 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-478178bb-9dbe-4d9b-b17a-e4d6a6f3f4d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:47.090112 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-478178bb-9dbe-4d9b-b17a-e4d6a6f3f4d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:47.090631 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-478178bb-9dbe-4d9b-b17a-e4d6a6f3f4d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:47.094011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-478178bb-9dbe-4d9b-b17a-e4d6a6f3f4d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:47.095584 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-478178bb-9dbe-4d9b-b17a-e4d6a6f3f4d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:47.622439 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9210122e-147d-4d86-930a-ffb7decd1b05 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:47.655311 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9210122e-147d-4d86-930a-ffb7decd1b05 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1369 microversion: 2.1 time: 0.958299 Jul 12 12:00:47.675722 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1159/2472] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:46 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1369 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:47.689348 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f47f4369-83ba-4b23-bec2-68a519a5e871 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:47.690425 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f47f4369-83ba-4b23-bec2-68a519a5e871 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:47.714693 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f47f4369-83ba-4b23-bec2-68a519a5e871 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:47.718186 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f47f4369-83ba-4b23-bec2-68a519a5e871 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:47.719181 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f47f4369-83ba-4b23-bec2-68a519a5e871 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:47.719823 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f47f4369-83ba-4b23-bec2-68a519a5e871 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:47.758824 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-478178bb-9dbe-4d9b-b17a-e4d6a6f3f4d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:47.793598 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-478178bb-9dbe-4d9b-b17a-e4d6a6f3f4d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1520 microversion: 2.1 time: 0.763982 Jul 12 12:00:47.807009 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1314/2473] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:47 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1520 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:47.833196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1e4e0c5d-a498-4ff8-809b-f2bcae1f4d86 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:47.834818 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1e4e0c5d-a498-4ff8-809b-f2bcae1f4d86 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:47.847289 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1e4e0c5d-a498-4ff8-809b-f2bcae1f4d86 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:47.848655 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1e4e0c5d-a498-4ff8-809b-f2bcae1f4d86 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:47.850369 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1e4e0c5d-a498-4ff8-809b-f2bcae1f4d86 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:47.851498 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1e4e0c5d-a498-4ff8-809b-f2bcae1f4d86 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:48.021278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f47f4369-83ba-4b23-bec2-68a519a5e871 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:48.030469 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f47f4369-83ba-4b23-bec2-68a519a5e871 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.349761 Jul 12 12:00:48.040389 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1160/2474] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:47 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:48.368837 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1e4e0c5d-a498-4ff8-809b-f2bcae1f4d86 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:48.402116 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1e4e0c5d-a498-4ff8-809b-f2bcae1f4d86 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:48.407364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1e4e0c5d-a498-4ff8-809b-f2bcae1f4d86 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:48.416970 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1e4e0c5d-a498-4ff8-809b-f2bcae1f4d86 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1805 microversion: 2.25 time: 0.600344 Jul 12 12:00:48.420332 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1315/2475] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:47 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1805 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:48.446530 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5450ed9d-afe2-4a5b-ab26-fb77c1439323 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '.version_select at 0x7f5e0ab88280>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:48.460743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5450ed9d-afe2-4a5b-ab26-fb77c1439323 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:48.461957 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5450ed9d-afe2-4a5b-ab26-fb77c1439323 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:48.470796 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:48.473572 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=6 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:48.517190 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5450ed9d-afe2-4a5b-ab26-fb77c1439323 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1524 microversion: 2.25 time: 0.077526 Jul 12 12:00:48.524384 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1161/2476] 10.222.0.50 () {60 vars in 1183 bytes} [Tue Jul 12 12:00:48 2022] GET /compute/v2.1/os-migrations => generated 1524 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:48.542249 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a593da1d-514b-4787-b3c3-1617cb025f6a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:48.549567 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a593da1d-514b-4787-b3c3-1617cb025f6a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:48.580962 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a593da1d-514b-4787-b3c3-1617cb025f6a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:48.581513 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a593da1d-514b-4787-b3c3-1617cb025f6a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:48.592263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a593da1d-514b-4787-b3c3-1617cb025f6a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:48.595595 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a593da1d-514b-4787-b3c3-1617cb025f6a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:48.695196 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9ff15ecc-6f3e-45cf-ac61-4a7b700167f9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:48.697486 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9ff15ecc-6f3e-45cf-ac61-4a7b700167f9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:48.732268 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ff15ecc-6f3e-45cf-ac61-4a7b700167f9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:48.732812 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ff15ecc-6f3e-45cf-ac61-4a7b700167f9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:48.733665 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ff15ecc-6f3e-45cf-ac61-4a7b700167f9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:48.734379 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ff15ecc-6f3e-45cf-ac61-4a7b700167f9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:49.090859 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:49.252822 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9ff15ecc-6f3e-45cf-ac61-4a7b700167f9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:49.267287 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9ff15ecc-6f3e-45cf-ac61-4a7b700167f9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1369 microversion: 2.1 time: 0.574079 Jul 12 12:00:49.267525 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1162/2477] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:48 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1369 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:00:49.279303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7be3b7aa-bee2-4316-a613-b3253a08ff3d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:49.280140 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7be3b7aa-bee2-4316-a613-b3253a08ff3d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:49.292895 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7be3b7aa-bee2-4316-a613-b3253a08ff3d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:49.293397 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7be3b7aa-bee2-4316-a613-b3253a08ff3d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:49.294203 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7be3b7aa-bee2-4316-a613-b3253a08ff3d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:49.299000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7be3b7aa-bee2-4316-a613-b3253a08ff3d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:49.803966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7be3b7aa-bee2-4316-a613-b3253a08ff3d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:49.817074 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7be3b7aa-bee2-4316-a613-b3253a08ff3d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1497 microversion: 2.1 time: 0.547575 Jul 12 12:00:49.820248 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1163/2478] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:49 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1497 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:49.827866 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5a10a2bd-9eb4-4d28-8b86-6ae6c7737d29 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:49.836885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5a10a2bd-9eb4-4d28-8b86-6ae6c7737d29 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:49.858137 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5a10a2bd-9eb4-4d28-8b86-6ae6c7737d29 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:49.858603 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5a10a2bd-9eb4-4d28-8b86-6ae6c7737d29 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:49.859445 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5a10a2bd-9eb4-4d28-8b86-6ae6c7737d29 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:49.859888 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5a10a2bd-9eb4-4d28-8b86-6ae6c7737d29 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:50.196613 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-a593da1d-514b-4787-b3c3-1617cb025f6a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'services' on Instance uuid b26b640d-3b19-492b-99f2-4c0cb3c10c25 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:00:50.222054 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a593da1d-514b-4787-b3c3-1617cb025f6a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 2424 microversion: 2.25 time: 1.689675 Jul 12 12:00:50.222578 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1316/2479] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:48 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 2424 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:50.259353 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3d12eb8e-d204-4738-9eaf-37cb7e68fa28 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:50.264063 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3d12eb8e-d204-4738-9eaf-37cb7e68fa28 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:50.265309 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3d12eb8e-d204-4738-9eaf-37cb7e68fa28 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:00:50.278831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d12eb8e-d204-4738-9eaf-37cb7e68fa28 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:50.279693 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d12eb8e-d204-4738-9eaf-37cb7e68fa28 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:50.280782 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d12eb8e-d204-4738-9eaf-37cb7e68fa28 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:50.289702 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3d12eb8e-d204-4738-9eaf-37cb7e68fa28 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:50.333761 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5a10a2bd-9eb4-4d28-8b86-6ae6c7737d29 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:50.364649 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5a10a2bd-9eb4-4d28-8b86-6ae6c7737d29 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.531485 Jul 12 12:00:50.376522 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1164/2480] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:49 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:50.383375 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7a7b068b-536a-40a9-b6c3-af5364daf624 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:50.384210 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7a7b068b-536a-40a9-b6c3-af5364daf624 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:50.400617 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a7b068b-536a-40a9-b6c3-af5364daf624 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:50.401550 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a7b068b-536a-40a9-b6c3-af5364daf624 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:50.402504 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a7b068b-536a-40a9-b6c3-af5364daf624 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:50.402995 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7a7b068b-536a-40a9-b6c3-af5364daf624 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:50.418797 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-3d12eb8e-d204-4738-9eaf-37cb7e68fa28 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:00:50.490464 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3d12eb8e-d204-4738-9eaf-37cb7e68fa28 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.251349 Jul 12 12:00:50.491785 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1317/2481] 10.222.0.50 () {58 vars in 1153 bytes} [Tue Jul 12 12:00:50 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:50.497274 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-025b0d04-929c-4c86-9e7f-dfacd43f27f6 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:50.498266 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-025b0d04-929c-4c86-9e7f-dfacd43f27f6 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:50.505123 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-025b0d04-929c-4c86-9e7f-dfacd43f27f6 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:50.505945 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-025b0d04-929c-4c86-9e7f-dfacd43f27f6 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:50.506976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-025b0d04-929c-4c86-9e7f-dfacd43f27f6 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:50.507649 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-025b0d04-929c-4c86-9e7f-dfacd43f27f6 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:50.958235 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-7a7b068b-536a-40a9-b6c3-af5364daf624 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'services' on Instance uuid b26b640d-3b19-492b-99f2-4c0cb3c10c25 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:00:51.014416 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7a7b068b-536a-40a9-b6c3-af5364daf624 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 2424 microversion: 2.25 time: 0.633296 Jul 12 12:00:51.030587 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1165/2482] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:00:50 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 2424 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:00:51.040710 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-04ead5ef-a199-4f5b-af67-1d9cfca40919 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:51.069843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-04ead5ef-a199-4f5b-af67-1d9cfca40919 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:51.070601 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-04ead5ef-a199-4f5b-af67-1d9cfca40919 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:51.224405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-04ead5ef-a199-4f5b-af67-1d9cfca40919 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Going to try to start instance {{(pid=125983) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 12:00:51.333020 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-04ead5ef-a199-4f5b-af67-1d9cfca40919 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "POST /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.299994 Jul 12 12:00:51.333982 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1166/2483] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 12:00:51 2022] POST /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 12:00:51.341216 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-878c2eb6-94bc-4f97-a870-14309a3f826f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:51.342394 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-878c2eb6-94bc-4f97-a870-14309a3f826f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:51.361201 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-878c2eb6-94bc-4f97-a870-14309a3f826f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:51.361557 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-878c2eb6-94bc-4f97-a870-14309a3f826f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:51.364608 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-878c2eb6-94bc-4f97-a870-14309a3f826f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:51.377194 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-878c2eb6-94bc-4f97-a870-14309a3f826f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:51.452904 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-025b0d04-929c-4c86-9e7f-dfacd43f27f6 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:51.493084 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-025b0d04-929c-4c86-9e7f-dfacd43f27f6 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1369 microversion: 2.1 time: 0.996949 Jul 12 12:00:51.495279 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1318/2484] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:50 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1369 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:51.506112 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2cb6b097-04fe-4c86-91b1-616796fa6421 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:51.510064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2cb6b097-04fe-4c86-91b1-616796fa6421 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:51.530187 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2cb6b097-04fe-4c86-91b1-616796fa6421 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:51.535944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2cb6b097-04fe-4c86-91b1-616796fa6421 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:51.537410 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2cb6b097-04fe-4c86-91b1-616796fa6421 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:51.538120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2cb6b097-04fe-4c86-91b1-616796fa6421 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:51.662727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-878c2eb6-94bc-4f97-a870-14309a3f826f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lazy-loading 'services' on Instance uuid b26b640d-3b19-492b-99f2-4c0cb3c10c25 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:00:51.925574 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-878c2eb6-94bc-4f97-a870-14309a3f826f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments/9298d697-4552-4737-9144-55145cfeea34" status: 202 len: 0 microversion: 2.25 time: 0.589592 Jul 12 12:00:51.930754 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1167/2485] 10.222.0.50 () {60 vars in 1456 bytes} [Tue Jul 12 12:00:51 2022] DELETE /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments/9298d697-4552-4737-9144-55145cfeea34 => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:00:51.986114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e8d46c86-544e-409c-a748-557078938b46 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:51.996966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e8d46c86-544e-409c-a748-557078938b46 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:52.008132 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8d46c86-544e-409c-a748-557078938b46 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:52.008812 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8d46c86-544e-409c-a748-557078938b46 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:52.009942 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8d46c86-544e-409c-a748-557078938b46 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:52.010554 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8d46c86-544e-409c-a748-557078938b46 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:52.603617 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2cb6b097-04fe-4c86-91b1-616796fa6421 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:52.614697 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2cb6b097-04fe-4c86-91b1-616796fa6421 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1506 microversion: 2.1 time: 1.118092 Jul 12 12:00:52.616128 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1319/2486] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:51 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1506 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:52.625984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-39950757-21b8-4daf-86ad-95eb9981ae6d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:52.628667 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-39950757-21b8-4daf-86ad-95eb9981ae6d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:52.671215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39950757-21b8-4daf-86ad-95eb9981ae6d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:52.673666 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39950757-21b8-4daf-86ad-95eb9981ae6d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:52.675900 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39950757-21b8-4daf-86ad-95eb9981ae6d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:52.676792 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39950757-21b8-4daf-86ad-95eb9981ae6d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:52.784183 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-39950757-21b8-4daf-86ad-95eb9981ae6d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.160838 Jul 12 12:00:52.785600 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1320/2487] 10.222.0.50 () {60 vars in 1342 bytes} [Tue Jul 12 12:00:52 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 12:00:52.809011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1c04557b-39bb-4bd7-aeb6-719a10b9cfdc tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:52.811596 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1c04557b-39bb-4bd7-aeb6-719a10b9cfdc tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:52.825143 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c04557b-39bb-4bd7-aeb6-719a10b9cfdc tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:52.832015 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c04557b-39bb-4bd7-aeb6-719a10b9cfdc tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:52.834370 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c04557b-39bb-4bd7-aeb6-719a10b9cfdc tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:52.834370 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c04557b-39bb-4bd7-aeb6-719a10b9cfdc tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:53.166241 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1c04557b-39bb-4bd7-aeb6-719a10b9cfdc tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:53.180767 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1c04557b-39bb-4bd7-aeb6-719a10b9cfdc tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1369 microversion: 2.1 time: 0.385622 Jul 12 12:00:53.196430 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1321/2488] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:52 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1369 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:53.633852 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-36bc112c-92a4-4e47-a6b8-fad4c66c5ed5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:53.634585 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-36bc112c-92a4-4e47-a6b8-fad4c66c5ed5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:53.644523 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:53.647788 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-36bc112c-92a4-4e47-a6b8-fad4c66c5ed5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:53.648728 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-36bc112c-92a4-4e47-a6b8-fad4c66c5ed5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:53.650149 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-36bc112c-92a4-4e47-a6b8-fad4c66c5ed5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:53.650838 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-36bc112c-92a4-4e47-a6b8-fad4c66c5ed5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:53.972142 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-36bc112c-92a4-4e47-a6b8-fad4c66c5ed5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:53.981523 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-36bc112c-92a4-4e47-a6b8-fad4c66c5ed5 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1506 microversion: 2.1 time: 0.351857 Jul 12 12:00:53.981794 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1322/2489] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:53 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:53.988424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e677d993-3ece-44ce-ae7c-16344943c856 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:53.998334 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e677d993-3ece-44ce-ae7c-16344943c856 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:54.018337 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e677d993-3ece-44ce-ae7c-16344943c856 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:54.018802 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e677d993-3ece-44ce-ae7c-16344943c856 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:54.019594 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e677d993-3ece-44ce-ae7c-16344943c856 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:54.020079 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e677d993-3ece-44ce-ae7c-16344943c856 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:54.088349 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e677d993-3ece-44ce-ae7c-16344943c856 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.097283 Jul 12 12:00:54.089055 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1323/2490] 10.222.0.50 () {60 vars in 1342 bytes} [Tue Jul 12 12:00:53 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 12:00:54.094285 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e8d46c86-544e-409c-a748-557078938b46 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:54.112988 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e8d46c86-544e-409c-a748-557078938b46 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 2.180760 Jul 12 12:00:54.116712 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1168/2491] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:51 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:54.200101 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-26f77eb1-7fb5-492e-b985-0a6fc6813c1e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:54.201090 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-26f77eb1-7fb5-492e-b985-0a6fc6813c1e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:54.207766 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26f77eb1-7fb5-492e-b985-0a6fc6813c1e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:54.208289 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26f77eb1-7fb5-492e-b985-0a6fc6813c1e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:54.209072 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26f77eb1-7fb5-492e-b985-0a6fc6813c1e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:54.209518 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26f77eb1-7fb5-492e-b985-0a6fc6813c1e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:54.447314 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-26f77eb1-7fb5-492e-b985-0a6fc6813c1e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:54.457049 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-26f77eb1-7fb5-492e-b985-0a6fc6813c1e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1369 microversion: 2.1 time: 0.260947 Jul 12 12:00:54.458118 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1324/2492] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:54 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1369 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:00:55.008399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d0303924-e81a-4115-9e1d-d89fcaeddf82 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:55.009071 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d0303924-e81a-4115-9e1d-d89fcaeddf82 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:55.020389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d0303924-e81a-4115-9e1d-d89fcaeddf82 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:55.021284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d0303924-e81a-4115-9e1d-d89fcaeddf82 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:55.022753 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d0303924-e81a-4115-9e1d-d89fcaeddf82 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:55.023647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d0303924-e81a-4115-9e1d-d89fcaeddf82 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:55.103255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5f8e8bf4-9a6c-4fed-ae98-65d68e7483b2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:55.104954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5f8e8bf4-9a6c-4fed-ae98-65d68e7483b2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:55.124191 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f8e8bf4-9a6c-4fed-ae98-65d68e7483b2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:55.124931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f8e8bf4-9a6c-4fed-ae98-65d68e7483b2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:55.126386 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f8e8bf4-9a6c-4fed-ae98-65d68e7483b2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:55.127010 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f8e8bf4-9a6c-4fed-ae98-65d68e7483b2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:55.134380 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:55.174803 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5f8e8bf4-9a6c-4fed-ae98-65d68e7483b2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075686 Jul 12 12:00:55.175977 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1325/2493] 10.222.0.50 () {60 vars in 1342 bytes} [Tue Jul 12 12:00:55 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 12:00:55.181758 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-95180702-5d76-4f60-af27-2731652b3a69 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:55.182391 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-95180702-5d76-4f60-af27-2731652b3a69 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:55.190395 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-95180702-5d76-4f60-af27-2731652b3a69 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:55.190843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-95180702-5d76-4f60-af27-2731652b3a69 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:55.191853 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-95180702-5d76-4f60-af27-2731652b3a69 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:55.193717 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-95180702-5d76-4f60-af27-2731652b3a69 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:55.421554 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d0303924-e81a-4115-9e1d-d89fcaeddf82 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:55.443493 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d0303924-e81a-4115-9e1d-d89fcaeddf82 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1506 microversion: 2.1 time: 0.439921 Jul 12 12:00:55.446751 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1169/2494] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:55 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:55.474888 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1eebaf9a-ed22-4cc9-ac3b-d8edd0f3d7e9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:55.487185 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1eebaf9a-ed22-4cc9-ac3b-d8edd0f3d7e9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:55.498618 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1eebaf9a-ed22-4cc9-ac3b-d8edd0f3d7e9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:55.499759 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1eebaf9a-ed22-4cc9-ac3b-d8edd0f3d7e9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:55.501408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1eebaf9a-ed22-4cc9-ac3b-d8edd0f3d7e9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:55.502411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1eebaf9a-ed22-4cc9-ac3b-d8edd0f3d7e9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:55.522728 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-95180702-5d76-4f60-af27-2731652b3a69 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:55.530935 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-95180702-5d76-4f60-af27-2731652b3a69 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.353631 Jul 12 12:00:55.543553 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1326/2495] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:55 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:55.992777 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1eebaf9a-ed22-4cc9-ac3b-d8edd0f3d7e9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:56.007881 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1eebaf9a-ed22-4cc9-ac3b-d8edd0f3d7e9 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1369 microversion: 2.1 time: 0.536689 Jul 12 12:00:56.009769 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1170/2496] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:55 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1369 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:00:56.189656 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-848860a0-b4d7-4233-a7fa-5bbead8b2bee tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:56.190771 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-848860a0-b4d7-4233-a7fa-5bbead8b2bee tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:56.218603 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-848860a0-b4d7-4233-a7fa-5bbead8b2bee tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:56.219085 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-848860a0-b4d7-4233-a7fa-5bbead8b2bee tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:56.219851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-848860a0-b4d7-4233-a7fa-5bbead8b2bee tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:56.220618 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-848860a0-b4d7-4233-a7fa-5bbead8b2bee tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:56.262331 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-848860a0-b4d7-4233-a7fa-5bbead8b2bee tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.078958 Jul 12 12:00:56.263712 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1327/2497] 10.222.0.50 () {60 vars in 1342 bytes} [Tue Jul 12 12:00:56 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 12:00:56.475810 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d2c721ba-7152-4588-a58f-12e33d9d7a8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:56.479651 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d2c721ba-7152-4588-a58f-12e33d9d7a8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:56.491449 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d2c721ba-7152-4588-a58f-12e33d9d7a8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:56.494057 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d2c721ba-7152-4588-a58f-12e33d9d7a8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:56.500295 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d2c721ba-7152-4588-a58f-12e33d9d7a8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:56.501116 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d2c721ba-7152-4588-a58f-12e33d9d7a8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:56.709417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-752040312", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "170348aa-5394-41be-88ac-54cf3cd1a3eb"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:00:56.724518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:00:56.819233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] validate_networks() for [('170348aa-5394-41be-88ac-54cf3cd1a3eb', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 12:00:57.081740 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d2c721ba-7152-4588-a58f-12e33d9d7a8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:57.097276 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d2c721ba-7152-4588-a58f-12e33d9d7a8c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1506 microversion: 2.1 time: 0.632786 Jul 12 12:00:57.100565 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1328/2498] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:56 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1506 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:57.108562 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3c46ca76-7be7-42c5-ace4-121c775d407c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:57.109560 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3c46ca76-7be7-42c5-ace4-121c775d407c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:57.130114 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c46ca76-7be7-42c5-ace4-121c775d407c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:57.132708 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c46ca76-7be7-42c5-ace4-121c775d407c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:57.133818 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c46ca76-7be7-42c5-ace4-121c775d407c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:57.135331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c46ca76-7be7-42c5-ace4-121c775d407c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:57.506409 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3c46ca76-7be7-42c5-ace4-121c775d407c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:57.518620 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3c46ca76-7be7-42c5-ace4-121c775d407c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.416608 Jul 12 12:00:57.529869 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1329/2499] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:57 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:57.535727 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f19d6694-c394-4d75-b222-b8e31e936926 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:57.536627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f19d6694-c394-4d75-b222-b8e31e936926 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:57.543776 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f19d6694-c394-4d75-b222-b8e31e936926 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:57.544833 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f19d6694-c394-4d75-b222-b8e31e936926 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:57.546134 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f19d6694-c394-4d75-b222-b8e31e936926 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:57.546854 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f19d6694-c394-4d75-b222-b8e31e936926 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:57.710319 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:00:57.711017 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:00:57.712482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:00:57.712977 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:00:57.715789 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:00:57.733521 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:57.734342 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:57.735622 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:57.736271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:57.770006 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Getting quotas for project f363c7937867459f989f28dfa05e2a43. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:00:57.782106 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Getting quotas for user bf94f6e3b43144a28378f2e272e1250d and project f363c7937867459f989f28dfa05e2a43. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:00:57.815453 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Going to run 2 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 12:00:57.815739 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f19d6694-c394-4d75-b222-b8e31e936926 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:57.819539 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: fa207c5e-e3a6-4510-a3ce-baa983af04e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:00:57.826602 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f19d6694-c394-4d75-b222-b8e31e936926 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1369 microversion: 2.1 time: 0.293139 Jul 12 12:00:57.827263 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1330/2500] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:57 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1369 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:57.838851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0b57160b-4af9-411d-8bbb-7e6305545b37 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:57.839993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0b57160b-4af9-411d-8bbb-7e6305545b37 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:57.860317 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b57160b-4af9-411d-8bbb-7e6305545b37 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:57.860813 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b57160b-4af9-411d-8bbb-7e6305545b37 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:57.862070 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b57160b-4af9-411d-8bbb-7e6305545b37 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:57.862960 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b57160b-4af9-411d-8bbb-7e6305545b37 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:57.881410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=fa207c5e-e3a6-4510-a3ce-baa983af04e2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:00:57.924947 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0b57160b-4af9-411d-8bbb-7e6305545b37 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.096529 Jul 12 12:00:57.928434 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1331/2501] 10.222.0.50 () {60 vars in 1342 bytes} [Tue Jul 12 12:00:57 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 12:00:57.982289 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-89670067-46fa-43bf-b487-7bed663bed46 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.546801 Jul 12 12:00:57.986974 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1171/2502] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 12:00:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 12:00:58.000964 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-291bd3b3-6f37-4913-a739-dd40bce42660 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:58.013660 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-291bd3b3-6f37-4913-a739-dd40bce42660 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:58.014636 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-291bd3b3-6f37-4913-a739-dd40bce42660 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Searching by: {'deleted': False, 'project_id': 'f363c7937867459f989f28dfa05e2a43'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:00:58.089586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-291bd3b3-6f37-4913-a739-dd40bce42660 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:58.090047 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-291bd3b3-6f37-4913-a739-dd40bce42660 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:58.090868 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-291bd3b3-6f37-4913-a739-dd40bce42660 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:58.091364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-291bd3b3-6f37-4913-a739-dd40bce42660 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:58.119417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-56ae0df6-1dc4-4bea-a07f-91aa3912ec2e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:58.120559 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-56ae0df6-1dc4-4bea-a07f-91aa3912ec2e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:58.152776 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56ae0df6-1dc4-4bea-a07f-91aa3912ec2e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:58.155254 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56ae0df6-1dc4-4bea-a07f-91aa3912ec2e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:58.155254 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56ae0df6-1dc4-4bea-a07f-91aa3912ec2e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:58.155750 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-56ae0df6-1dc4-4bea-a07f-91aa3912ec2e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:58.176568 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-291bd3b3-6f37-4913-a739-dd40bce42660 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.183382 Jul 12 12:00:58.177182 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1332/2503] 10.222.0.50 () {58 vars in 1124 bytes} [Tue Jul 12 12:00:57 2022] GET /compute/v2.1/servers => generated 675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:00:58.210457 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-af8fef6c-e7f3-4eee-a180-43075369fc6b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:58.211525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-af8fef6c-e7f3-4eee-a180-43075369fc6b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:58.376569 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-af8fef6c-e7f3-4eee-a180-43075369fc6b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:58.399571 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-af8fef6c-e7f3-4eee-a180-43075369fc6b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1219 microversion: 2.1 time: 0.202733 Jul 12 12:00:58.400507 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1333/2504] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:58 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1219 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:58.537310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0500de51-4855-4c5e-8a33-c1bd493e0dbf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:58.538839 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0500de51-4855-4c5e-8a33-c1bd493e0dbf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:58.550297 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0500de51-4855-4c5e-8a33-c1bd493e0dbf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:58.551137 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0500de51-4855-4c5e-8a33-c1bd493e0dbf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:58.552542 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0500de51-4855-4c5e-8a33-c1bd493e0dbf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:58.553381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0500de51-4855-4c5e-8a33-c1bd493e0dbf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:58.739050 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-56ae0df6-1dc4-4bea-a07f-91aa3912ec2e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:58.752555 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-56ae0df6-1dc4-4bea-a07f-91aa3912ec2e tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1506 microversion: 2.1 time: 0.638382 Jul 12 12:00:58.754014 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1172/2505] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:58 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1506 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:58.846666 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-736a3afe-a00a-40c1-a0d8-8b2d922cf636 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:58.847543 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-736a3afe-a00a-40c1-a0d8-8b2d922cf636 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:58.861411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-736a3afe-a00a-40c1-a0d8-8b2d922cf636 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:58.864735 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-736a3afe-a00a-40c1-a0d8-8b2d922cf636 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:58.866096 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-736a3afe-a00a-40c1-a0d8-8b2d922cf636 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:58.867611 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-736a3afe-a00a-40c1-a0d8-8b2d922cf636 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:58.951830 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0500de51-4855-4c5e-8a33-c1bd493e0dbf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:58.982676 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0500de51-4855-4c5e-8a33-c1bd493e0dbf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.446655 Jul 12 12:00:58.984443 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1334/2506] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:58 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:59.011225 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-90675e23-b435-4720-956c-66da98114264 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:59.016258 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-90675e23-b435-4720-956c-66da98114264 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:59.041871 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90675e23-b435-4720-956c-66da98114264 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:59.042940 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90675e23-b435-4720-956c-66da98114264 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:59.045054 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90675e23-b435-4720-956c-66da98114264 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:59.045521 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90675e23-b435-4720-956c-66da98114264 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:59.136006 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-90675e23-b435-4720-956c-66da98114264 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.141527 Jul 12 12:00:59.138868 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1335/2507] 10.222.0.50 () {60 vars in 1342 bytes} [Tue Jul 12 12:00:58 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 12:00:59.286065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-736a3afe-a00a-40c1-a0d8-8b2d922cf636 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:59.300242 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-736a3afe-a00a-40c1-a0d8-8b2d922cf636 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1369 microversion: 2.1 time: 0.459420 Jul 12 12:00:59.303620 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1173/2508] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:58 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1369 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:59.434757 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ac1c32f2-38ea-4b74-8a3b-6d60d369127c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:59.436756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ac1c32f2-38ea-4b74-8a3b-6d60d369127c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:59.624937 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ac1c32f2-38ea-4b74-8a3b-6d60d369127c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:00:59.643819 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ac1c32f2-38ea-4b74-8a3b-6d60d369127c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1219 microversion: 2.1 time: 0.217214 Jul 12 12:00:59.645907 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1336/2509] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:59 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1219 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:00:59.803795 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-472dfc6a-d520-40de-8d70-e7acab11519f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:00:59.808149 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-472dfc6a-d520-40de-8d70-e7acab11519f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:00:59.864289 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-472dfc6a-d520-40de-8d70-e7acab11519f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:59.867938 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-472dfc6a-d520-40de-8d70-e7acab11519f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:59.873084 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-472dfc6a-d520-40de-8d70-e7acab11519f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:00:59.874935 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-472dfc6a-d520-40de-8d70-e7acab11519f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:00:59.890819 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:00.019095 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-de3d4002-c31d-4b20-8947-2080989c86df tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:00.020882 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-de3d4002-c31d-4b20-8947-2080989c86df tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:00.036101 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de3d4002-c31d-4b20-8947-2080989c86df tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:00.036852 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de3d4002-c31d-4b20-8947-2080989c86df tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:00.038255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de3d4002-c31d-4b20-8947-2080989c86df tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:00.039340 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de3d4002-c31d-4b20-8947-2080989c86df tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:00.336122 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-de3d4002-c31d-4b20-8947-2080989c86df tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:00.351718 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-de3d4002-c31d-4b20-8947-2080989c86df tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.351281 Jul 12 12:01:00.353201 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1337/2510] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:59 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:00.358615 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e7951f9d-38ef-42bc-8941-286db987026a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:00.359707 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e7951f9d-38ef-42bc-8941-286db987026a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:00.370290 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e7951f9d-38ef-42bc-8941-286db987026a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:00.371267 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e7951f9d-38ef-42bc-8941-286db987026a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:00.372901 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e7951f9d-38ef-42bc-8941-286db987026a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:00.375312 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e7951f9d-38ef-42bc-8941-286db987026a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:00.485363 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e7951f9d-38ef-42bc-8941-286db987026a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.126288 Jul 12 12:01:00.487113 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1338/2511] 10.222.0.50 () {60 vars in 1342 bytes} [Tue Jul 12 12:01:00 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 12:01:00.502815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-84ac5de0-bd02-4169-bb30-a4078327872e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:00.503683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-84ac5de0-bd02-4169-bb30-a4078327872e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:00.522893 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84ac5de0-bd02-4169-bb30-a4078327872e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:00.524779 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84ac5de0-bd02-4169-bb30-a4078327872e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:00.527524 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84ac5de0-bd02-4169-bb30-a4078327872e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:00.528136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-84ac5de0-bd02-4169-bb30-a4078327872e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:00.691417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-472dfc6a-d520-40de-8d70-e7acab11519f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:00.705595 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-472dfc6a-d520-40de-8d70-e7acab11519f tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1510 microversion: 2.1 time: 0.933408 Jul 12 12:01:00.707966 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1174/2512] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:00:59 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1510 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:00.725794 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f27a2751-a338-429a-a40c-03435def4c26 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:00.726724 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f27a2751-a338-429a-a40c-03435def4c26 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:00.753881 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f27a2751-a338-429a-a40c-03435def4c26 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:00.754900 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f27a2751-a338-429a-a40c-03435def4c26 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:00.761490 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f27a2751-a338-429a-a40c-03435def4c26 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:00.762238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f27a2751-a338-429a-a40c-03435def4c26 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:01.014778 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-84ac5de0-bd02-4169-bb30-a4078327872e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:01.041659 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f27a2751-a338-429a-a40c-03435def4c26 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:01.053701 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f27a2751-a338-429a-a40c-03435def4c26 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1271 microversion: 2.1 time: 0.343069 Jul 12 12:01:01.055002 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-84ac5de0-bd02-4169-bb30-a4078327872e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1369 microversion: 2.1 time: 0.564747 Jul 12 12:01:01.057297 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1339/2513] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:00 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1369 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:01.067916 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1175/2514] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:00 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1271 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:01.071588 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5ae707d3-9095-4e27-aaa7-eda6ed1496b2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:01.078909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5ae707d3-9095-4e27-aaa7-eda6ed1496b2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:01.082302 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.compute.servers [None req-5ae707d3-9095-4e27-aaa7-eda6ed1496b2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Removing options 'limit' from query {{(pid=125984) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 12 12:01:01.092944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5ae707d3-9095-4e27-aaa7-eda6ed1496b2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:01:01.096694 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5ae707d3-9095-4e27-aaa7-eda6ed1496b2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:01.097505 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5ae707d3-9095-4e27-aaa7-eda6ed1496b2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:01.098780 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5ae707d3-9095-4e27-aaa7-eda6ed1496b2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:01.099974 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5ae707d3-9095-4e27-aaa7-eda6ed1496b2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:01.103389 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5ae707d3-9095-4e27-aaa7-eda6ed1496b2 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.044240 Jul 12 12:01:01.117944 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e37b504e-27dc-4ba0-ace3-5b2f07a5e09c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:01.119110 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e37b504e-27dc-4ba0-ace3-5b2f07a5e09c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:01.120754 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1340/2515] 10.222.0.50 () {58 vars in 1139 bytes} [Tue Jul 12 12:01:01 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 12:01:01.128965 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e37b504e-27dc-4ba0-ace3-5b2f07a5e09c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:01.129719 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e37b504e-27dc-4ba0-ace3-5b2f07a5e09c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:01.130678 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e37b504e-27dc-4ba0-ace3-5b2f07a5e09c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:01.131536 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e37b504e-27dc-4ba0-ace3-5b2f07a5e09c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:01.374008 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0ff28685-b0d8-4be7-8f9e-85a428f8b02b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:01.376158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0ff28685-b0d8-4be7-8f9e-85a428f8b02b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:01.406712 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ff28685-b0d8-4be7-8f9e-85a428f8b02b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:01.407773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ff28685-b0d8-4be7-8f9e-85a428f8b02b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:01.408627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ff28685-b0d8-4be7-8f9e-85a428f8b02b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:01.410869 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ff28685-b0d8-4be7-8f9e-85a428f8b02b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:01.589876 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e37b504e-27dc-4ba0-ace3-5b2f07a5e09c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:01.600072 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e37b504e-27dc-4ba0-ace3-5b2f07a5e09c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1510 microversion: 2.1 time: 0.486430 Jul 12 12:01:01.607770 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1176/2516] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:01 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1510 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:01.627512 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0c7505e0-1f86-4cb9-a4a2-57d3d56539c7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:01.633911 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0c7505e0-1f86-4cb9-a4a2-57d3d56539c7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:01.653228 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c7505e0-1f86-4cb9-a4a2-57d3d56539c7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:01.653623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c7505e0-1f86-4cb9-a4a2-57d3d56539c7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:01.654957 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c7505e0-1f86-4cb9-a4a2-57d3d56539c7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:01.655397 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0c7505e0-1f86-4cb9-a4a2-57d3d56539c7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:01.726705 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0c7505e0-1f86-4cb9-a4a2-57d3d56539c7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117487 Jul 12 12:01:01.727484 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1177/2517] 10.222.0.50 () {60 vars in 1342 bytes} [Tue Jul 12 12:01:01 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 12:01:01.736271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4fcb5fff-c33a-4e9f-8db9-94f59a7abd91 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:01.738207 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4fcb5fff-c33a-4e9f-8db9-94f59a7abd91 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:01.748627 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4fcb5fff-c33a-4e9f-8db9-94f59a7abd91 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:01.749343 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4fcb5fff-c33a-4e9f-8db9-94f59a7abd91 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:01.750337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4fcb5fff-c33a-4e9f-8db9-94f59a7abd91 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:01.751045 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4fcb5fff-c33a-4e9f-8db9-94f59a7abd91 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:01.769691 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0ff28685-b0d8-4be7-8f9e-85a428f8b02b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:01.785663 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0ff28685-b0d8-4be7-8f9e-85a428f8b02b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.418218 Jul 12 12:01:01.787192 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1341/2518] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:01 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:02.071351 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-c1c2ece7-bb38-4085-bd4e-7efaf633a797 req-3e88052f-6f06-425d-8bd3-b7af83378d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea153f9-9c62-4a41-a8be-4bdf4c5d3998", "name": "network-vif-plugged", "status": "completed", "tag": "019bd511-acab-4a0b-948a-24a1fb3e56ad"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:02.084311 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-c1c2ece7-bb38-4085-bd4e-7efaf633a797 req-3e88052f-6f06-425d-8bd3-b7af83378d87 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:02.085116 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-c1c2ece7-bb38-4085-bd4e-7efaf633a797 req-3e88052f-6f06-425d-8bd3-b7af83378d87 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:02.098943 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-c1c2ece7-bb38-4085-bd4e-7efaf633a797 req-3e88052f-6f06-425d-8bd3-b7af83378d87 service nova] Creating event network-vif-plugged:019bd511-acab-4a0b-948a-24a1fb3e56ad for instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 on n-h2-849104-4 Jul 12 12:01:02.106714 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-c1c2ece7-bb38-4085-bd4e-7efaf633a797 req-3e88052f-6f06-425d-8bd3-b7af83378d87 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038612 Jul 12 12:01:02.108992 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1342/2519] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:02.116064 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4d122dc5-d401-4915-a2e4-e66fa010c149 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:02.116771 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4d122dc5-d401-4915-a2e4-e66fa010c149 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:02.124668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4d122dc5-d401-4915-a2e4-e66fa010c149 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:02.125343 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4d122dc5-d401-4915-a2e4-e66fa010c149 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:02.126342 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4d122dc5-d401-4915-a2e4-e66fa010c149 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:02.127030 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4d122dc5-d401-4915-a2e4-e66fa010c149 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:02.215021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4d122dc5-d401-4915-a2e4-e66fa010c149 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:02.225148 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4d122dc5-d401-4915-a2e4-e66fa010c149 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1277 microversion: 2.1 time: 0.114057 Jul 12 12:01:02.232259 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1343/2520] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:02 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:02.237614 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2bbde67a-4b03-4d57-88ed-8fa560983a94 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:02.238259 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2bbde67a-4b03-4d57-88ed-8fa560983a94 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:02.247936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2bbde67a-4b03-4d57-88ed-8fa560983a94 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:02.247936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2bbde67a-4b03-4d57-88ed-8fa560983a94 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:02.248373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2bbde67a-4b03-4d57-88ed-8fa560983a94 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:02.248923 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2bbde67a-4b03-4d57-88ed-8fa560983a94 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:02.255003 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4fcb5fff-c33a-4e9f-8db9-94f59a7abd91 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:02.264376 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4fcb5fff-c33a-4e9f-8db9-94f59a7abd91 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 200 len: 1510 microversion: 2.1 time: 0.535609 Jul 12 12:01:02.264947 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1178/2521] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:01 2022] GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 1510 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:02.282569 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-dfb5aece-2376-41c9-a85c-9ca4c9d186c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:02.283595 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-dfb5aece-2376-41c9-a85c-9ca4c9d186c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:02.291880 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dfb5aece-2376-41c9-a85c-9ca4c9d186c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:02.293818 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dfb5aece-2376-41c9-a85c-9ca4c9d186c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:02.293818 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dfb5aece-2376-41c9-a85c-9ca4c9d186c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:02.294139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dfb5aece-2376-41c9-a85c-9ca4c9d186c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:02.408541 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2bbde67a-4b03-4d57-88ed-8fa560983a94 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:02.418572 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2bbde67a-4b03-4d57-88ed-8fa560983a94 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1369 microversion: 2.1 time: 0.184013 Jul 12 12:01:02.420143 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1344/2522] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:02 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:02.652707 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-dfb5aece-2376-41c9-a85c-9ca4c9d186c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:02.661071 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-dfb5aece-2376-41c9-a85c-9ca4c9d186c9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1511 microversion: 2.1 time: 0.384064 Jul 12 12:01:02.672051 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1179/2523] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:02 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:02.687505 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-90e11de2-80a8-4ad5-b138-bb9ece218fdb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:02.691864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-90e11de2-80a8-4ad5-b138-bb9ece218fdb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:02.693398 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-90e11de2-80a8-4ad5-b138-bb9ece218fdb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:01:02.754852 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2418b29f-e4a5-4f87-9441-4df6c470b6c3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:02.763097 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2418b29f-e4a5-4f87-9441-4df6c470b6c3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:02.781406 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2418b29f-e4a5-4f87-9441-4df6c470b6c3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:02.782567 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2418b29f-e4a5-4f87-9441-4df6c470b6c3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:02.784345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2418b29f-e4a5-4f87-9441-4df6c470b6c3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:02.785384 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2418b29f-e4a5-4f87-9441-4df6c470b6c3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:02.854610 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2418b29f-e4a5-4f87-9441-4df6c470b6c3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.118503 Jul 12 12:01:02.859904 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1180/2524] 10.222.0.50 () {60 vars in 1342 bytes} [Tue Jul 12 12:01:02 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:02.906848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f72cb794-aac2-4bb2-a2c3-24d3ec4ac3cd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:02.911244 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f72cb794-aac2-4bb2-a2c3-24d3ec4ac3cd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:02.941120 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f72cb794-aac2-4bb2-a2c3-24d3ec4ac3cd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:02.942580 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f72cb794-aac2-4bb2-a2c3-24d3ec4ac3cd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:02.947711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f72cb794-aac2-4bb2-a2c3-24d3ec4ac3cd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:02.949530 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90e11de2-80a8-4ad5-b138-bb9ece218fdb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:02.949860 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f72cb794-aac2-4bb2-a2c3-24d3ec4ac3cd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:02.953409 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90e11de2-80a8-4ad5-b138-bb9ece218fdb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:02.958428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90e11de2-80a8-4ad5-b138-bb9ece218fdb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:02.960483 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90e11de2-80a8-4ad5-b138-bb9ece218fdb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:03.194632 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-90e11de2-80a8-4ad5-b138-bb9ece218fdb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:01:03.339133 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:03.411331 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-90e11de2-80a8-4ad5-b138-bb9ece218fdb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.734269 Jul 12 12:01:03.418875 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1345/2525] 10.222.0.50 () {58 vars in 1153 bytes} [Tue Jul 12 12:01:02 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:03.424423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-39aeb59d-66ce-424a-9ba1-76941b34a0b2 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:03.426107 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-39aeb59d-66ce-424a-9ba1-76941b34a0b2 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:03.440356 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39aeb59d-66ce-424a-9ba1-76941b34a0b2 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:03.441136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39aeb59d-66ce-424a-9ba1-76941b34a0b2 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:03.442491 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39aeb59d-66ce-424a-9ba1-76941b34a0b2 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:03.443243 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39aeb59d-66ce-424a-9ba1-76941b34a0b2 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:03.565214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-39aeb59d-66ce-424a-9ba1-76941b34a0b2 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:03.576124 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-39aeb59d-66ce-424a-9ba1-76941b34a0b2 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1277 microversion: 2.1 time: 0.162096 Jul 12 12:01:03.577169 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1346/2526] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:03 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:03.593063 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-46f77e0b-5027-40f9-8306-aef888b417ed tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:03.593720 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-46f77e0b-5027-40f9-8306-aef888b417ed tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:03.602566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46f77e0b-5027-40f9-8306-aef888b417ed tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:03.603202 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46f77e0b-5027-40f9-8306-aef888b417ed tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:03.603992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46f77e0b-5027-40f9-8306-aef888b417ed tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:03.605172 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-46f77e0b-5027-40f9-8306-aef888b417ed tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:03.706868 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f72cb794-aac2-4bb2-a2c3-24d3ec4ac3cd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:03.717949 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f72cb794-aac2-4bb2-a2c3-24d3ec4ac3cd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.855001 Jul 12 12:01:03.728497 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1181/2527] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:02 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:03.738892 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c7ae52b1-33fe-47b8-8ea0-83f7af8b9432 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:03.740101 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c7ae52b1-33fe-47b8-8ea0-83f7af8b9432 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:03.751734 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c7ae52b1-33fe-47b8-8ea0-83f7af8b9432 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:03.755180 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c7ae52b1-33fe-47b8-8ea0-83f7af8b9432 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:03.756048 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c7ae52b1-33fe-47b8-8ea0-83f7af8b9432 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:03.757060 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c7ae52b1-33fe-47b8-8ea0-83f7af8b9432 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:03.905488 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-46f77e0b-5027-40f9-8306-aef888b417ed tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:03.924417 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-46f77e0b-5027-40f9-8306-aef888b417ed tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1510 microversion: 2.1 time: 0.346087 Jul 12 12:01:03.938166 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1347/2528] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:03 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1510 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:03.944715 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-51fa0c14-8419-453a-890e-ff0d4d3802a7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:03.945464 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-51fa0c14-8419-453a-890e-ff0d4d3802a7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:03.954335 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51fa0c14-8419-453a-890e-ff0d4d3802a7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:03.954891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51fa0c14-8419-453a-890e-ff0d4d3802a7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:03.956294 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51fa0c14-8419-453a-890e-ff0d4d3802a7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:03.956880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-51fa0c14-8419-453a-890e-ff0d4d3802a7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:04.270478 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-51fa0c14-8419-453a-890e-ff0d4d3802a7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:04.281009 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-51fa0c14-8419-453a-890e-ff0d4d3802a7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 200 len: 1510 microversion: 2.1 time: 0.341183 Jul 12 12:01:04.284085 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1348/2529] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:03 2022] GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:04.304149 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7c041edd-8732-4099-b3a4-3c5a929c9d86 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:04.305922 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7c041edd-8732-4099-b3a4-3c5a929c9d86 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:04.313798 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7c041edd-8732-4099-b3a4-3c5a929c9d86 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:04.314254 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7c041edd-8732-4099-b3a4-3c5a929c9d86 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:04.315062 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7c041edd-8732-4099-b3a4-3c5a929c9d86 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:04.315485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7c041edd-8732-4099-b3a4-3c5a929c9d86 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:04.605826 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7c041edd-8732-4099-b3a4-3c5a929c9d86 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:04.620244 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7c041edd-8732-4099-b3a4-3c5a929c9d86 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1511 microversion: 2.1 time: 0.323520 Jul 12 12:01:04.636733 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1349/2530] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:04 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:04.645048 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1c610621-0e97-4b2b-9d89-59c683f2e42a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:04.646475 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1c610621-0e97-4b2b-9d89-59c683f2e42a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:04.656337 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c610621-0e97-4b2b-9d89-59c683f2e42a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:04.657399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c610621-0e97-4b2b-9d89-59c683f2e42a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:04.658383 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c610621-0e97-4b2b-9d89-59c683f2e42a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:04.659201 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c610621-0e97-4b2b-9d89-59c683f2e42a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:04.861225 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1c610621-0e97-4b2b-9d89-59c683f2e42a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:04.884732 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1c610621-0e97-4b2b-9d89-59c683f2e42a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1319 microversion: 2.1 time: 0.246205 Jul 12 12:01:04.886370 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1350/2531] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:04 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:04.901754 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-29bbef72-ae66-4cc1-91bf-aca104be740d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:04.910125 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-29bbef72-ae66-4cc1-91bf-aca104be740d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:04.911978 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-29bbef72-ae66-4cc1-91bf-aca104be740d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:01:04.922700 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-29bbef72-ae66-4cc1-91bf-aca104be740d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:04.924873 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-29bbef72-ae66-4cc1-91bf-aca104be740d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:04.927501 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-29bbef72-ae66-4cc1-91bf-aca104be740d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:04.928668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-29bbef72-ae66-4cc1-91bf-aca104be740d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:04.973334 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c7ae52b1-33fe-47b8-8ea0-83f7af8b9432 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:04.985131 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c7ae52b1-33fe-47b8-8ea0-83f7af8b9432 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1369 microversion: 2.1 time: 1.255449 Jul 12 12:01:04.997427 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1182/2532] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:03 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1369 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:05.006614 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-29bbef72-ae66-4cc1-91bf-aca104be740d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:01:05.012575 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-084cd0b8-2a16-4ef1-805c-14e5e68469b6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:05.013242 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-084cd0b8-2a16-4ef1-805c-14e5e68469b6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:05.022822 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-084cd0b8-2a16-4ef1-805c-14e5e68469b6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:05.023295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-084cd0b8-2a16-4ef1-805c-14e5e68469b6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:05.024130 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-084cd0b8-2a16-4ef1-805c-14e5e68469b6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:05.024583 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-084cd0b8-2a16-4ef1-805c-14e5e68469b6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:05.083187 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-29bbef72-ae66-4cc1-91bf-aca104be740d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:05.093344 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-29bbef72-ae66-4cc1-91bf-aca104be740d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:05.094181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-29bbef72-ae66-4cc1-91bf-aca104be740d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:05.295167 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-29bbef72-ae66-4cc1-91bf-aca104be740d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 0.404897 Jul 12 12:01:05.296655 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1351/2533] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 12:01:04 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:05.317610 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-20a51b7f-0e88-4854-a8a2-10a71242c442 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:05.339318 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-20a51b7f-0e88-4854-a8a2-10a71242c442 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:05.347059 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-20a51b7f-0e88-4854-a8a2-10a71242c442 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:01:05.500791 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20a51b7f-0e88-4854-a8a2-10a71242c442 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:05.501794 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20a51b7f-0e88-4854-a8a2-10a71242c442 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:05.502485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20a51b7f-0e88-4854-a8a2-10a71242c442 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:05.503543 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-20a51b7f-0e88-4854-a8a2-10a71242c442 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:05.539030 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-20a51b7f-0e88-4854-a8a2-10a71242c442 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:01:05.598692 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-20a51b7f-0e88-4854-a8a2-10a71242c442 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.286539 Jul 12 12:01:05.612809 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1352/2534] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Jul 12 12:01:05 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:05.626353 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-31e01e1a-5ed1-4127-9ab2-956d877cb67d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:05.634535 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-31e01e1a-5ed1-4127-9ab2-956d877cb67d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:05.637486 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-31e01e1a-5ed1-4127-9ab2-956d877cb67d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:01:05.654598 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31e01e1a-5ed1-4127-9ab2-956d877cb67d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:05.655820 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31e01e1a-5ed1-4127-9ab2-956d877cb67d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:05.659215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31e01e1a-5ed1-4127-9ab2-956d877cb67d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:05.660549 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-31e01e1a-5ed1-4127-9ab2-956d877cb67d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:05.703702 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-084cd0b8-2a16-4ef1-805c-14e5e68469b6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:05.728571 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-084cd0b8-2a16-4ef1-805c-14e5e68469b6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.728011 Jul 12 12:01:05.730354 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1183/2535] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:04 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:05.860970 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-31e01e1a-5ed1-4127-9ab2-956d877cb67d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:01:05.912122 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e1b7e56b-25bb-442d-84c7-448c2dc13d55 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:05.913721 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e1b7e56b-25bb-442d-84c7-448c2dc13d55 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:05.941729 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1b7e56b-25bb-442d-84c7-448c2dc13d55 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:05.942997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1b7e56b-25bb-442d-84c7-448c2dc13d55 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:05.946416 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1b7e56b-25bb-442d-84c7-448c2dc13d55 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:05.950053 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e1b7e56b-25bb-442d-84c7-448c2dc13d55 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:05.983208 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-31e01e1a-5ed1-4127-9ab2-956d877cb67d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.366151 Jul 12 12:01:05.996761 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1353/2536] 10.222.0.50 () {58 vars in 1211 bytes} [Tue Jul 12 12:01:05 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:06.002954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ba0067e8-1895-4f17-bc2e-33cec79487a0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:06.008681 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ba0067e8-1895-4f17-bc2e-33cec79487a0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:06.009652 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ba0067e8-1895-4f17-bc2e-33cec79487a0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:01:06.018626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ba0067e8-1895-4f17-bc2e-33cec79487a0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:06.019136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ba0067e8-1895-4f17-bc2e-33cec79487a0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:06.020009 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ba0067e8-1895-4f17-bc2e-33cec79487a0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:06.020488 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ba0067e8-1895-4f17-bc2e-33cec79487a0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:06.187566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-ba0067e8-1895-4f17-bc2e-33cec79487a0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:01:06.291810 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ba0067e8-1895-4f17-bc2e-33cec79487a0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.292507 Jul 12 12:01:06.293299 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1354/2537] 10.222.0.50 () {58 vars in 1195 bytes} [Tue Jul 12 12:01:05 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:06.307505 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ccaeaec8-1334-4772-9943-aa1185cbfa4c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:06.308553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ccaeaec8-1334-4772-9943-aa1185cbfa4c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:06.322084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ccaeaec8-1334-4772-9943-aa1185cbfa4c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:06.322850 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ccaeaec8-1334-4772-9943-aa1185cbfa4c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:06.325559 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ccaeaec8-1334-4772-9943-aa1185cbfa4c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:06.326112 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ccaeaec8-1334-4772-9943-aa1185cbfa4c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:06.602206 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ccaeaec8-1334-4772-9943-aa1185cbfa4c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:06.619009 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ccaeaec8-1334-4772-9943-aa1185cbfa4c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1555 microversion: 2.1 time: 0.316542 Jul 12 12:01:06.621422 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1355/2538] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:06 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1555 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:06.629891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7582187a-8e95-4907-b7b6-dcfd63cd1f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:06.640149 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7582187a-8e95-4907-b7b6-dcfd63cd1f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:06.641510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7582187a-8e95-4907-b7b6-dcfd63cd1f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'name': '1726329593', 'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:01:06.650334 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7582187a-8e95-4907-b7b6-dcfd63cd1f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:06.651083 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7582187a-8e95-4907-b7b6-dcfd63cd1f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:06.651999 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7582187a-8e95-4907-b7b6-dcfd63cd1f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:06.652536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7582187a-8e95-4907-b7b6-dcfd63cd1f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:06.799121 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e1b7e56b-25bb-442d-84c7-448c2dc13d55 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:06.805853 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-7582187a-8e95-4907-b7b6-dcfd63cd1f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:01:06.818802 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e1b7e56b-25bb-442d-84c7-448c2dc13d55 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1319 microversion: 2.1 time: 0.912508 Jul 12 12:01:06.823305 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1184/2539] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:05 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1319 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:06.838484 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-06e922f6-7dcb-4426-ab5a-e0dc0d2638f5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:06.843118 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-06e922f6-7dcb-4426-ab5a-e0dc0d2638f5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:06.860846 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-06e922f6-7dcb-4426-ab5a-e0dc0d2638f5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:06.863966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-06e922f6-7dcb-4426-ab5a-e0dc0d2638f5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:06.867133 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-06e922f6-7dcb-4426-ab5a-e0dc0d2638f5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:06.870006 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-06e922f6-7dcb-4426-ab5a-e0dc0d2638f5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:07.006760 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7582187a-8e95-4907-b7b6-dcfd63cd1f73 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers?name=1726329593" status: 200 len: 346 microversion: 2.1 time: 0.383117 Jul 12 12:01:07.015723 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1356/2540] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Jul 12 12:01:06 2022] GET /compute/v2.1/servers?name=1726329593 => generated 346 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:07.021911 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2b42ba64-cf22-4b3b-8c56-17ac02ee4a16 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:07.022429 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2b42ba64-cf22-4b3b-8c56-17ac02ee4a16 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:07.034805 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2b42ba64-cf22-4b3b-8c56-17ac02ee4a16 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:07.035461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2b42ba64-cf22-4b3b-8c56-17ac02ee4a16 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:07.036362 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2b42ba64-cf22-4b3b-8c56-17ac02ee4a16 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:07.036814 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2b42ba64-cf22-4b3b-8c56-17ac02ee4a16 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:07.161341 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2b42ba64-cf22-4b3b-8c56-17ac02ee4a16 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144029 Jul 12 12:01:07.161960 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1357/2541] 10.222.0.50 () {58 vars in 1274 bytes} [Tue Jul 12 12:01:07 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:07.177436 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6cd1f91b-ed8d-4aab-b64a-037ae72ca13a tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:07.177436 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6cd1f91b-ed8d-4aab-b64a-037ae72ca13a tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:07.187158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6cd1f91b-ed8d-4aab-b64a-037ae72ca13a tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:07.192849 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6cd1f91b-ed8d-4aab-b64a-037ae72ca13a tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:07.197325 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6cd1f91b-ed8d-4aab-b64a-037ae72ca13a tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:07.197867 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6cd1f91b-ed8d-4aab-b64a-037ae72ca13a tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:07.555387 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6cd1f91b-ed8d-4aab-b64a-037ae72ca13a tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:07.576348 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6cd1f91b-ed8d-4aab-b64a-037ae72ca13a tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.413275 Jul 12 12:01:07.577152 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1358/2542] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:07 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:07.592511 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ecf7965a-b16c-4a58-b461-42a45cd93c17 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:07.598944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ecf7965a-b16c-4a58-b461-42a45cd93c17 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:07.599784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ecf7965a-b16c-4a58-b461-42a45cd93c17 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:01:07.606538 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ecf7965a-b16c-4a58-b461-42a45cd93c17 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:07.607576 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ecf7965a-b16c-4a58-b461-42a45cd93c17 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:07.608976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ecf7965a-b16c-4a58-b461-42a45cd93c17 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:07.609600 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ecf7965a-b16c-4a58-b461-42a45cd93c17 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:07.741876 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-ecf7965a-b16c-4a58-b461-42a45cd93c17 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:01:07.753346 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:07.801668 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=6 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:07.839493 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ecf7965a-b16c-4a58-b461-42a45cd93c17 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.260603 Jul 12 12:01:07.840750 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1359/2543] 10.222.0.50 () {58 vars in 1153 bytes} [Tue Jul 12 12:01:07 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:07.855972 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dd5cefaf-3b04-4dd8-92b7-5246dabd0fc1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:07.856953 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dd5cefaf-3b04-4dd8-92b7-5246dabd0fc1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:07.871094 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dd5cefaf-3b04-4dd8-92b7-5246dabd0fc1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:07.871716 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dd5cefaf-3b04-4dd8-92b7-5246dabd0fc1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:07.873601 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dd5cefaf-3b04-4dd8-92b7-5246dabd0fc1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:07.878242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dd5cefaf-3b04-4dd8-92b7-5246dabd0fc1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:07.956647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:08.235811 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-06e922f6-7dcb-4426-ab5a-e0dc0d2638f5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:08.280968 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-06e922f6-7dcb-4426-ab5a-e0dc0d2638f5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:08.300459 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-06e922f6-7dcb-4426-ab5a-e0dc0d2638f5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:08.303548 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-06e922f6-7dcb-4426-ab5a-e0dc0d2638f5 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 2951 microversion: 2.32 time: 1.477646 Jul 12 12:01:08.305588 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1185/2544] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:06 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 2951 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:08.323362 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2cb518a0-82c5-4e7b-bd04-0d83c32efbbc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:08.331327 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2cb518a0-82c5-4e7b-bd04-0d83c32efbbc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:08.332936 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2cb518a0-82c5-4e7b-bd04-0d83c32efbbc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-172632959', 'deleted': False, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:01:08.351230 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2cb518a0-82c5-4e7b-bd04-0d83c32efbbc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:08.352152 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2cb518a0-82c5-4e7b-bd04-0d83c32efbbc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:08.353704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2cb518a0-82c5-4e7b-bd04-0d83c32efbbc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:08.354594 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2cb518a0-82c5-4e7b-bd04-0d83c32efbbc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:08.354763 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dd5cefaf-3b04-4dd8-92b7-5246dabd0fc1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:08.369585 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dd5cefaf-3b04-4dd8-92b7-5246dabd0fc1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1319 microversion: 2.1 time: 0.526806 Jul 12 12:01:08.370412 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1360/2545] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:07 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:08.379740 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-3bfde6fc-a0fc-436b-9394-a455f0a915ed req-9a09b025-3dab-4ec8-801c-df4b040815de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa207c5e-e3a6-4510-a3ce-baa983af04e2", "tag": "d8563bab-3f1b-4f53-ac3f-28d8ccc417a0"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:08.401911 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-3bfde6fc-a0fc-436b-9394-a455f0a915ed req-9a09b025-3dab-4ec8-801c-df4b040815de service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:08.402364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-3bfde6fc-a0fc-436b-9394-a455f0a915ed req-9a09b025-3dab-4ec8-801c-df4b040815de service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:08.433150 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-3bfde6fc-a0fc-436b-9394-a455f0a915ed req-9a09b025-3dab-4ec8-801c-df4b040815de service nova] Creating event network-changed:d8563bab-3f1b-4f53-ac3f-28d8ccc417a0 for instance fa207c5e-e3a6-4510-a3ce-baa983af04e2 on n-h1-849104-4 Jul 12 12:01:08.448982 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-3bfde6fc-a0fc-436b-9394-a455f0a915ed req-9a09b025-3dab-4ec8-801c-df4b040815de service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077340 Jul 12 12:01:08.451939 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1361/2546] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:08.460066 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-765ad0b3-8336-4a03-b3dc-17fc4f58507e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:08.460661 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-765ad0b3-8336-4a03-b3dc-17fc4f58507e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:08.479670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-765ad0b3-8336-4a03-b3dc-17fc4f58507e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:08.480173 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-765ad0b3-8336-4a03-b3dc-17fc4f58507e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:08.480994 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-765ad0b3-8336-4a03-b3dc-17fc4f58507e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:08.481637 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-765ad0b3-8336-4a03-b3dc-17fc4f58507e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:08.543424 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.multi_cell_list [None req-2cb518a0-82c5-4e7b-bd04-0d83c32efbbc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:01:08.642355 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2cb518a0-82c5-4e7b-bd04-0d83c32efbbc tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-172632959" status: 200 len: 346 microversion: 2.1 time: 0.334053 Jul 12 12:01:08.645034 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1186/2547] 10.222.0.50 () {58 vars in 1227 bytes} [Tue Jul 12 12:01:08 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-172632959 => generated 346 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:08.651538 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-38de9e41-929b-44b8-a0dc-468920d23ff6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:08.652492 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-38de9e41-929b-44b8-a0dc-468920d23ff6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:08.681858 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-38de9e41-929b-44b8-a0dc-468920d23ff6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:08.682571 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-38de9e41-929b-44b8-a0dc-468920d23ff6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:08.683615 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-38de9e41-929b-44b8-a0dc-468920d23ff6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:08.684590 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-38de9e41-929b-44b8-a0dc-468920d23ff6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:08.775525 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-765ad0b3-8336-4a03-b3dc-17fc4f58507e tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.319896 Jul 12 12:01:08.776498 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1362/2548] 10.222.0.50 () {60 vars in 1315 bytes} [Tue Jul 12 12:01:08 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444/os-interface => generated 1830 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:08.781656 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c57dee54-08a0-4681-b519-6f8e196794a6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:08.782249 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c57dee54-08a0-4681-b519-6f8e196794a6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:08.796013 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c57dee54-08a0-4681-b519-6f8e196794a6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:08.796722 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c57dee54-08a0-4681-b519-6f8e196794a6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:08.798849 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c57dee54-08a0-4681-b519-6f8e196794a6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:08.799198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c57dee54-08a0-4681-b519-6f8e196794a6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:08.839628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c57dee54-08a0-4681-b519-6f8e196794a6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:01:09.027751 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c57dee54-08a0-4681-b519-6f8e196794a6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 204 len: 0 microversion: 2.1 time: 0.249322 Jul 12 12:01:09.029093 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1363/2549] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:01:08 2022] DELETE /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:01:09.039933 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0f4a8737-fb31-4800-b08c-bd8abea790e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:09.041323 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0f4a8737-fb31-4800-b08c-bd8abea790e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:09.050539 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f4a8737-fb31-4800-b08c-bd8abea790e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:09.051087 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f4a8737-fb31-4800-b08c-bd8abea790e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:09.052175 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f4a8737-fb31-4800-b08c-bd8abea790e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:09.053065 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f4a8737-fb31-4800-b08c-bd8abea790e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:09.319681 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-38de9e41-929b-44b8-a0dc-468920d23ff6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:09.330745 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-38de9e41-929b-44b8-a0dc-468920d23ff6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.684393 Jul 12 12:01:09.335968 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1187/2550] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:08 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:09.365551 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-4af982c4-81d5-473d-a159-ec4bc757139b req-2345ba14-a7d0-4eca-939f-4268f81ab189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea153f9-9c62-4a41-a8be-4bdf4c5d3998", "tag": "019bd511-acab-4a0b-948a-24a1fb3e56ad"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:09.381047 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4af982c4-81d5-473d-a159-ec4bc757139b req-2345ba14-a7d0-4eca-939f-4268f81ab189 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:09.383897 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4af982c4-81d5-473d-a159-ec4bc757139b req-2345ba14-a7d0-4eca-939f-4268f81ab189 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:09.394678 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0f4a8737-fb31-4800-b08c-bd8abea790e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:09.413606 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-4af982c4-81d5-473d-a159-ec4bc757139b req-2345ba14-a7d0-4eca-939f-4268f81ab189 service nova] Creating event network-changed:019bd511-acab-4a0b-948a-24a1fb3e56ad for instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 on n-h2-849104-4 Jul 12 12:01:09.414120 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0f4a8737-fb31-4800-b08c-bd8abea790e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1517 microversion: 2.1 time: 0.379942 Jul 12 12:01:09.415016 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1364/2551] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:09 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1517 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:09.427212 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e0a67f23-7522-4ce7-afc8-d043309168a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:09.428826 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-4af982c4-81d5-473d-a159-ec4bc757139b req-2345ba14-a7d0-4eca-939f-4268f81ab189 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067273 Jul 12 12:01:09.428961 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e0a67f23-7522-4ce7-afc8-d043309168a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:09.432863 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1188/2552] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:09.442919 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e0a67f23-7522-4ce7-afc8-d043309168a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:09.443533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e0a67f23-7522-4ce7-afc8-d043309168a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:09.444478 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e0a67f23-7522-4ce7-afc8-d043309168a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:09.444998 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e0a67f23-7522-4ce7-afc8-d043309168a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:09.687993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e0a67f23-7522-4ce7-afc8-d043309168a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:09.700807 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e0a67f23-7522-4ce7-afc8-d043309168a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1319 microversion: 2.1 time: 0.284498 Jul 12 12:01:09.701070 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1365/2553] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:09 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:10.373882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c38e70a6-80ac-45d9-8db5-4f967c14af74 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:10.379398 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c38e70a6-80ac-45d9-8db5-4f967c14af74 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:10.404480 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c38e70a6-80ac-45d9-8db5-4f967c14af74 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:10.406365 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c38e70a6-80ac-45d9-8db5-4f967c14af74 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:10.408262 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c38e70a6-80ac-45d9-8db5-4f967c14af74 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:10.410759 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c38e70a6-80ac-45d9-8db5-4f967c14af74 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:10.439095 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ca306991-fd72-445a-9f4d-3684b31076c3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:10.441521 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ca306991-fd72-445a-9f4d-3684b31076c3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:10.464317 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ca306991-fd72-445a-9f4d-3684b31076c3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:10.467268 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ca306991-fd72-445a-9f4d-3684b31076c3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:10.468433 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ca306991-fd72-445a-9f4d-3684b31076c3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:10.471011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ca306991-fd72-445a-9f4d-3684b31076c3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:10.969076 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c38e70a6-80ac-45d9-8db5-4f967c14af74 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:11.011341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ca306991-fd72-445a-9f4d-3684b31076c3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:11.022568 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c38e70a6-80ac-45d9-8db5-4f967c14af74 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.658476 Jul 12 12:01:11.024752 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1189/2554] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:10 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:11.056696 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-74b085d3-ca73-49a0-95e1-844f159e73dd req-53a5870d-3bc0-4657-8853-223154828655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0b4967-48f4-4e56-bba3-0a557acec63a", "tag": "b2d2b002-ad9c-4c29-96c1-bda0e501b993"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:11.076349 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ca306991-fd72-445a-9f4d-3684b31076c3 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1517 microversion: 2.1 time: 0.637020 Jul 12 12:01:11.096178 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1366/2555] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:10 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1517 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:11.101429 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-74b085d3-ca73-49a0-95e1-844f159e73dd req-53a5870d-3bc0-4657-8853-223154828655 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:11.103702 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-74b085d3-ca73-49a0-95e1-844f159e73dd req-53a5870d-3bc0-4657-8853-223154828655 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:11.119270 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a49eae42-bd26-47e4-99f1-4743624ed5ca tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:11.121185 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a49eae42-bd26-47e4-99f1-4743624ed5ca tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:11.151268 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-74b085d3-ca73-49a0-95e1-844f159e73dd req-53a5870d-3bc0-4657-8853-223154828655 service nova] Creating event network-changed:b2d2b002-ad9c-4c29-96c1-bda0e501b993 for instance 3d0b4967-48f4-4e56-bba3-0a557acec63a on n-h1-849104-4 Jul 12 12:01:11.157518 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a49eae42-bd26-47e4-99f1-4743624ed5ca tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:11.158101 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a49eae42-bd26-47e4-99f1-4743624ed5ca tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:11.159132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a49eae42-bd26-47e4-99f1-4743624ed5ca tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:11.159636 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a49eae42-bd26-47e4-99f1-4743624ed5ca tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:11.210495 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-74b085d3-ca73-49a0-95e1-844f159e73dd req-53a5870d-3bc0-4657-8853-223154828655 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175649 Jul 12 12:01:11.222795 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1190/2556] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:12.052215 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-dbe036d2-69b2-4121-a98d-04ff0b27b0fa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:12.053024 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-dbe036d2-69b2-4121-a98d-04ff0b27b0fa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:12.076934 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dbe036d2-69b2-4121-a98d-04ff0b27b0fa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:12.077459 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dbe036d2-69b2-4121-a98d-04ff0b27b0fa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:12.082372 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dbe036d2-69b2-4121-a98d-04ff0b27b0fa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:12.086376 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dbe036d2-69b2-4121-a98d-04ff0b27b0fa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:12.592894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a49eae42-bd26-47e4-99f1-4743624ed5ca tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:12.643285 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a49eae42-bd26-47e4-99f1-4743624ed5ca tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1319 microversion: 2.1 time: 1.559261 Jul 12 12:01:12.661814 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1367/2557] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:11 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1319 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:12.677092 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-39946ccb-bd5a-4f55-9204-830263ca92e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:12.678495 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-39946ccb-bd5a-4f55-9204-830263ca92e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:12.701215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39946ccb-bd5a-4f55-9204-830263ca92e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:12.702418 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39946ccb-bd5a-4f55-9204-830263ca92e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:12.703929 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39946ccb-bd5a-4f55-9204-830263ca92e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:12.704772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39946ccb-bd5a-4f55-9204-830263ca92e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:12.823290 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-dbe036d2-69b2-4121-a98d-04ff0b27b0fa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:12.831021 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:12.842822 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-dbe036d2-69b2-4121-a98d-04ff0b27b0fa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.795736 Jul 12 12:01:12.844304 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1191/2558] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:12 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:13.336904 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-39946ccb-bd5a-4f55-9204-830263ca92e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:13.351086 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-39946ccb-bd5a-4f55-9204-830263ca92e6 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1517 microversion: 2.1 time: 0.687561 Jul 12 12:01:13.353062 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1368/2559] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:12 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1517 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:13.688812 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b0aa1660-cda4-41fa-b8d2-5228cda98272 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:13.691870 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b0aa1660-cda4-41fa-b8d2-5228cda98272 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:13.765746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b0aa1660-cda4-41fa-b8d2-5228cda98272 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:13.766594 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b0aa1660-cda4-41fa-b8d2-5228cda98272 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:13.767839 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b0aa1660-cda4-41fa-b8d2-5228cda98272 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:13.770056 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b0aa1660-cda4-41fa-b8d2-5228cda98272 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:13.877214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a9c8bdca-0735-4f86-8fbc-9ad3d52a0776 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:13.878742 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a9c8bdca-0735-4f86-8fbc-9ad3d52a0776 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:13.895331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:13.903316 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a9c8bdca-0735-4f86-8fbc-9ad3d52a0776 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:13.904348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a9c8bdca-0735-4f86-8fbc-9ad3d52a0776 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:13.921428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a9c8bdca-0735-4f86-8fbc-9ad3d52a0776 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:13.947975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a9c8bdca-0735-4f86-8fbc-9ad3d52a0776 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:14.427310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a9c8bdca-0735-4f86-8fbc-9ad3d52a0776 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:14.460749 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a9c8bdca-0735-4f86-8fbc-9ad3d52a0776 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.591803 Jul 12 12:01:14.477466 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1369/2560] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:13 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:14.495664 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-d80a503e-372b-47a2-982a-787ea92a9e5f req-8d9e1899-b6e6-4ab7-83b2-9a388b5eef1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8ece58-3fc8-42d8-b049-038b865159ae", "name": "network-vif-deleted", "tag": "4398a787-b528-4504-953e-274211d152cb"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:14.552150 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d80a503e-372b-47a2-982a-787ea92a9e5f req-8d9e1899-b6e6-4ab7-83b2-9a388b5eef1b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:14.559403 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d80a503e-372b-47a2-982a-787ea92a9e5f req-8d9e1899-b6e6-4ab7-83b2-9a388b5eef1b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:14.632757 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-d80a503e-372b-47a2-982a-787ea92a9e5f req-8d9e1899-b6e6-4ab7-83b2-9a388b5eef1b service nova] Creating event network-vif-deleted:4398a787-b528-4504-953e-274211d152cb for instance 5d8ece58-3fc8-42d8-b049-038b865159ae on n-h2-849104-4 Jul 12 12:01:14.655474 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-d80a503e-372b-47a2-982a-787ea92a9e5f req-8d9e1899-b6e6-4ab7-83b2-9a388b5eef1b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180483 Jul 12 12:01:14.658104 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1370/2561] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:14.672289 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a9a0b819-d503-4951-9675-f69e2febe3d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:14.685470 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b0aa1660-cda4-41fa-b8d2-5228cda98272 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:14.687553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a9a0b819-d503-4951-9675-f69e2febe3d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:14.696909 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b0aa1660-cda4-41fa-b8d2-5228cda98272 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1319 microversion: 2.1 time: 1.025604 Jul 12 12:01:14.700981 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1192/2562] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:13 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1319 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:14.714628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a9a0b819-d503-4951-9675-f69e2febe3d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:14.715351 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a9a0b819-d503-4951-9675-f69e2febe3d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:14.734358 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a9a0b819-d503-4951-9675-f69e2febe3d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:14.738333 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a9a0b819-d503-4951-9675-f69e2febe3d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:14.877593 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a9a0b819-d503-4951-9675-f69e2febe3d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:14.879267 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a9a0b819-d503-4951-9675-f69e2febe3d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:14.880962 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-a9a0b819-d503-4951-9675-f69e2febe3d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lazy-loading 'fault' on Instance uuid 5d8ece58-3fc8-42d8-b049-038b865159ae {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:01:15.054229 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a9a0b819-d503-4951-9675-f69e2febe3d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:15.070270 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a9a0b819-d503-4951-9675-f69e2febe3d7 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 200 len: 1311 microversion: 2.1 time: 0.409544 Jul 12 12:01:15.071573 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1371/2563] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:14 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 1311 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:15.347294 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-8a804d52-c7da-40eb-b658-f19b40f68d02 req-3c113678-74c2-438d-b6e2-2204c2fd09ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa207c5e-e3a6-4510-a3ce-baa983af04e2", "name": "network-vif-plugged", "status": "completed", "tag": "d8563bab-3f1b-4f53-ac3f-28d8ccc417a0"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:15.359582 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-8a804d52-c7da-40eb-b658-f19b40f68d02 req-3c113678-74c2-438d-b6e2-2204c2fd09ad service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:15.360054 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-8a804d52-c7da-40eb-b658-f19b40f68d02 req-3c113678-74c2-438d-b6e2-2204c2fd09ad service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:15.389620 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-8a804d52-c7da-40eb-b658-f19b40f68d02 req-3c113678-74c2-438d-b6e2-2204c2fd09ad service nova] Creating event network-vif-plugged:d8563bab-3f1b-4f53-ac3f-28d8ccc417a0 for instance fa207c5e-e3a6-4510-a3ce-baa983af04e2 on n-h1-849104-4 Jul 12 12:01:15.399828 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-8a804d52-c7da-40eb-b658-f19b40f68d02 req-3c113678-74c2-438d-b6e2-2204c2fd09ad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056113 Jul 12 12:01:15.401322 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1193/2564] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:15.485715 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cb7b0430-8a7f-45e0-b9ec-c91ec60c0e42 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:15.486587 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cb7b0430-8a7f-45e0-b9ec-c91ec60c0e42 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:15.489153 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:15.499773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb7b0430-8a7f-45e0-b9ec-c91ec60c0e42 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:15.500301 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb7b0430-8a7f-45e0-b9ec-c91ec60c0e42 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:15.501341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb7b0430-8a7f-45e0-b9ec-c91ec60c0e42 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:15.501787 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cb7b0430-8a7f-45e0-b9ec-c91ec60c0e42 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:15.727137 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-87ba694d-2cf9-4820-b3b1-d8851376ee7d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:15.727137 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-87ba694d-2cf9-4820-b3b1-d8851376ee7d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:15.738510 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-87ba694d-2cf9-4820-b3b1-d8851376ee7d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:15.738897 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-87ba694d-2cf9-4820-b3b1-d8851376ee7d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:15.739689 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-87ba694d-2cf9-4820-b3b1-d8851376ee7d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:15.740238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-87ba694d-2cf9-4820-b3b1-d8851376ee7d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:15.791011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cb7b0430-8a7f-45e0-b9ec-c91ec60c0e42 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:15.801562 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cb7b0430-8a7f-45e0-b9ec-c91ec60c0e42 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.319825 Jul 12 12:01:15.802955 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1372/2565] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:15 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:15.945162 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-87ba694d-2cf9-4820-b3b1-d8851376ee7d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:15.959377 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-87ba694d-2cf9-4820-b3b1-d8851376ee7d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1319 microversion: 2.1 time: 0.244160 Jul 12 12:01:15.983480 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1194/2566] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:15 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:16.095421 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0f6c479e-24f9-4255-b517-12aab230b98d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:16.097041 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0f6c479e-24f9-4255-b517-12aab230b98d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 5d8ece58-3fc8-42d8-b049-038b865159ae] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:16.107987 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0f6c479e-24f9-4255-b517-12aab230b98d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:16.108327 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0f6c479e-24f9-4255-b517-12aab230b98d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:16.109875 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0f6c479e-24f9-4255-b517-12aab230b98d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:16.110641 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0f6c479e-24f9-4255-b517-12aab230b98d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:16.147873 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-0f6c479e-24f9-4255-b517-12aab230b98d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] HTTP exception thrown: Instance 5d8ece58-3fc8-42d8-b049-038b865159ae could not be found. Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0f6c479e-24f9-4255-b517-12aab230b98d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Request method failure captured: Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae HTTP/1.1 Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWILI-LaUuSmnodro6Yyvobsb3MGTtJ_xzuwKHmpu43p3qTMUTGndjTLdP9PAXgfXZD4x2BTJU9hf6DH1-YWJemq-kzxOuILhoXYRGfyA0rsQHXrM-M4QI_LC0fzMYEiua1sR2Hty5tvCp0GXzcI6mdTb5OJWji7OBA5Ar6gkcamJVg Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 56c52b6ceeb64ea4a313ee77b0161dde Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ListServerFiltersTestJSON-1750084143 Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56c52b6ceeb64ea4a313ee77b0161dde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56c52b6ceeb64ea4a313ee77b0161dde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/56c52b6ceeb64ea4a313ee77b0161dde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_56c52b6ceeb64ea4a313ee77b0161dde", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ListServerFiltersTestJSON-1750084143 Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 56c52b6ceeb64ea4a313ee77b0161dde Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1750084143 Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ListServerFiltersTestJSON-1750084143-project Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 1094ce20b0b14bd5883a82846c482842 Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ListServerFiltersTestJSON-1750084143-project Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 5d8ece58-3fc8-42d8-b049-038b865159ae could not be found. Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '5d8ece58-3fc8-42d8-b049-038b865159ae'} Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8ece58-3fc8-42d8-b049-038b865159ae could not be found. Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8ece58-3fc8-42d8-b049-038b865159ae could not be found. Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:01:16.151222 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:01:16.157730 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:16.157730 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:01:16.157730 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:01:16.157730 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:01:16.157730 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:01:16.157730 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8ece58-3fc8-42d8-b049-038b865159ae could not be found. Jul 12 12:01:16.157730 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:01:16.157730 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0f6c479e-24f9-4255-b517-12aab230b98d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Returning 404 to user: Instance 5d8ece58-3fc8-42d8-b049-038b865159ae could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:01:16.157730 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0f6c479e-24f9-4255-b517-12aab230b98d tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae" status: 404 len: 111 microversion: 2.1 time: 0.069533 Jul 12 12:01:16.161487 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1195/2567] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:16 2022] GET /compute/v2.1/servers/5d8ece58-3fc8-42d8-b049-038b865159ae => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 12:01:16.172167 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-99389577-4109-4ff1-9fd3-d482cf04f283 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:16.173031 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-99389577-4109-4ff1-9fd3-d482cf04f283 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:16.182964 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99389577-4109-4ff1-9fd3-d482cf04f283 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:16.183407 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99389577-4109-4ff1-9fd3-d482cf04f283 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:16.184433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99389577-4109-4ff1-9fd3-d482cf04f283 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:16.185419 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-99389577-4109-4ff1-9fd3-d482cf04f283 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:16.234619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-99389577-4109-4ff1-9fd3-d482cf04f283 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:01:16.254152 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-479899071", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "f4ac0726-e839-448f-a6d9-960e0dc48281"}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:16.353137 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] validate_networks() for [('f4ac0726-e839-448f-a6d9-960e0dc48281', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 12:01:16.358224 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-99389577-4109-4ff1-9fd3-d482cf04f283 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 204 len: 0 microversion: 2.1 time: 0.194506 Jul 12 12:01:16.362473 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1196/2568] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:01:16 2022] DELETE /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:01:16.369135 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a5918ea9-6084-4973-be42-9bdb9382df95 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:16.370105 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a5918ea9-6084-4973-be42-9bdb9382df95 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:16.379362 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5918ea9-6084-4973-be42-9bdb9382df95 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:16.380677 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5918ea9-6084-4973-be42-9bdb9382df95 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:16.381480 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5918ea9-6084-4973-be42-9bdb9382df95 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:16.381921 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5918ea9-6084-4973-be42-9bdb9382df95 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:16.714296 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a5918ea9-6084-4973-be42-9bdb9382df95 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:16.737059 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a5918ea9-6084-4973-be42-9bdb9382df95 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 200 len: 1516 microversion: 2.1 time: 0.369350 Jul 12 12:01:16.752615 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1197/2569] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:16 2022] GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 1516 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:16.823818 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d96a1aa0-8a38-4cf9-a1ad-d0e3252e0d53 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:16.825345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d96a1aa0-8a38-4cf9-a1ad-d0e3252e0d53 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:16.838512 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d96a1aa0-8a38-4cf9-a1ad-d0e3252e0d53 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:16.839276 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d96a1aa0-8a38-4cf9-a1ad-d0e3252e0d53 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:16.840507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d96a1aa0-8a38-4cf9-a1ad-d0e3252e0d53 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:16.841207 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d96a1aa0-8a38-4cf9-a1ad-d0e3252e0d53 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:16.954861 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:01:16.957066 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:01:16.958052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:01:16.958937 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:01:16.959617 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:01:16.979131 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:16.979812 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:16.981735 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:16.981735 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:16.991566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=19 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:17.015454 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Getting quotas for project b4d3ca9b6340438c998a53df6dd73496. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:01:17.023874 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Getting quotas for user 7302f396799e41a28b8dec72fb3fc6db and project b4d3ca9b6340438c998a53df6dd73496. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:01:17.050055 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 12:01:17.052450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:01:17.152580 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9702af35-14b6-42af-8c57-a767ad1d087f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.135191 Jul 12 12:01:17.154643 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1373/2570] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 12:01:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 12:01:17.159679 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-94803be7-15f4-4f67-979d-b5ee862aebfb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:17.160831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-94803be7-15f4-4f67-979d-b5ee862aebfb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:17.176320 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94803be7-15f4-4f67-979d-b5ee862aebfb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:17.177033 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94803be7-15f4-4f67-979d-b5ee862aebfb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:17.178087 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94803be7-15f4-4f67-979d-b5ee862aebfb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:17.178748 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-94803be7-15f4-4f67-979d-b5ee862aebfb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:17.209082 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d96a1aa0-8a38-4cf9-a1ad-d0e3252e0d53 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:17.222879 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d96a1aa0-8a38-4cf9-a1ad-d0e3252e0d53 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.406633 Jul 12 12:01:17.227791 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1198/2571] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:16 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:17.238272 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-207ad820-5d84-499c-8dc7-8d25cd969715 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:17.238996 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-207ad820-5d84-499c-8dc7-8d25cd969715 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:17.409268 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-207ad820-5d84-499c-8dc7-8d25cd969715 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:17.421303 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-207ad820-5d84-499c-8dc7-8d25cd969715 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1217 microversion: 2.1 time: 0.192012 Jul 12 12:01:17.424483 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1199/2572] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:17 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1217 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:17.505748 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-94803be7-15f4-4f67-979d-b5ee862aebfb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:17.535327 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-94803be7-15f4-4f67-979d-b5ee862aebfb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1319 microversion: 2.1 time: 0.379078 Jul 12 12:01:17.555543 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1374/2573] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:17 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:17.790612 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-489dbb6d-723e-4be4-953f-6b20bad65753 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:17.798154 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-489dbb6d-723e-4be4-953f-6b20bad65753 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:17.816475 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-489dbb6d-723e-4be4-953f-6b20bad65753 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:17.821681 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-489dbb6d-723e-4be4-953f-6b20bad65753 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:17.825515 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-489dbb6d-723e-4be4-953f-6b20bad65753 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:17.827743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-489dbb6d-723e-4be4-953f-6b20bad65753 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:18.241020 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-10e423ef-b187-45df-a7f9-c7ccf3fb44bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:18.242052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-10e423ef-b187-45df-a7f9-c7ccf3fb44bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:18.250998 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-10e423ef-b187-45df-a7f9-c7ccf3fb44bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:18.251552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-10e423ef-b187-45df-a7f9-c7ccf3fb44bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:18.252638 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-10e423ef-b187-45df-a7f9-c7ccf3fb44bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:18.253169 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-10e423ef-b187-45df-a7f9-c7ccf3fb44bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:18.263345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-489dbb6d-723e-4be4-953f-6b20bad65753 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:18.278822 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-489dbb6d-723e-4be4-953f-6b20bad65753 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 200 len: 1516 microversion: 2.1 time: 0.509310 Jul 12 12:01:18.279608 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1200/2574] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:17 2022] GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 1516 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:18.451448 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f1de0d55-6424-4b7f-b37a-09c010c151d8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:18.459518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f1de0d55-6424-4b7f-b37a-09c010c151d8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:18.474756 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:18.478740 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f1de0d55-6424-4b7f-b37a-09c010c151d8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:18.479735 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f1de0d55-6424-4b7f-b37a-09c010c151d8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:18.481043 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f1de0d55-6424-4b7f-b37a-09c010c151d8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:18.484586 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f1de0d55-6424-4b7f-b37a-09c010c151d8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:18.604905 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-10e423ef-b187-45df-a7f9-c7ccf3fb44bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:18.616614 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-10e423ef-b187-45df-a7f9-c7ccf3fb44bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.379576 Jul 12 12:01:18.619405 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1375/2575] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:18 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:18.625080 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-db3af837-f396-4717-8c78-9a696f1e1ec8 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:18.626019 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-db3af837-f396-4717-8c78-9a696f1e1ec8 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:18.639883 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db3af837-f396-4717-8c78-9a696f1e1ec8 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:18.641810 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db3af837-f396-4717-8c78-9a696f1e1ec8 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:18.643345 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db3af837-f396-4717-8c78-9a696f1e1ec8 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:18.643993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db3af837-f396-4717-8c78-9a696f1e1ec8 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:18.786670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f1de0d55-6424-4b7f-b37a-09c010c151d8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:18.796204 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f1de0d55-6424-4b7f-b37a-09c010c151d8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1213 microversion: 2.1 time: 0.352106 Jul 12 12:01:18.801100 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1201/2576] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:18 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1213 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:18.818187 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-3d953641-2644-457c-a334-70725e81d032 req-326bdecc-b06e-4039-bd3c-6ac2b0e63d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0b4967-48f4-4e56-bba3-0a557acec63a", "name": "network-vif-plugged", "status": "completed", "tag": "b2d2b002-ad9c-4c29-96c1-bda0e501b993"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:18.839265 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-3d953641-2644-457c-a334-70725e81d032 req-326bdecc-b06e-4039-bd3c-6ac2b0e63d21 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:18.840782 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-3d953641-2644-457c-a334-70725e81d032 req-326bdecc-b06e-4039-bd3c-6ac2b0e63d21 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:18.855042 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-3d953641-2644-457c-a334-70725e81d032 req-326bdecc-b06e-4039-bd3c-6ac2b0e63d21 service nova] Creating event network-vif-plugged:b2d2b002-ad9c-4c29-96c1-bda0e501b993 for instance 3d0b4967-48f4-4e56-bba3-0a557acec63a on n-h1-849104-4 Jul 12 12:01:18.861179 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-3d953641-2644-457c-a334-70725e81d032 req-326bdecc-b06e-4039-bd3c-6ac2b0e63d21 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057437 Jul 12 12:01:18.862481 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1202/2577] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:18.928927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-db3af837-f396-4717-8c78-9a696f1e1ec8 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:18.945307 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-db3af837-f396-4717-8c78-9a696f1e1ec8 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1319 microversion: 2.1 time: 0.324418 Jul 12 12:01:18.945914 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1376/2578] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:18 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:19.253786 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-15c64bfd-9837-4abb-a612-b09aec65845e req-72767c5a-5a31-4fab-8466-3db66bca6619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e337b451-c995-432f-bfcf-c81b435abb3e", "name": "network-vif-deleted", "tag": "a157f95c-3c36-4800-916f-7c7808bedeae"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:19.279391 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-15c64bfd-9837-4abb-a612-b09aec65845e req-72767c5a-5a31-4fab-8466-3db66bca6619 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:19.280417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-15c64bfd-9837-4abb-a612-b09aec65845e req-72767c5a-5a31-4fab-8466-3db66bca6619 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:19.303282 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9a831be8-7819-4cf4-ab4a-5a2f4bc0fe31 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:19.304998 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9a831be8-7819-4cf4-ab4a-5a2f4bc0fe31 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:19.308964 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-15c64bfd-9837-4abb-a612-b09aec65845e req-72767c5a-5a31-4fab-8466-3db66bca6619 service nova] Creating event network-vif-deleted:a157f95c-3c36-4800-916f-7c7808bedeae for instance e337b451-c995-432f-bfcf-c81b435abb3e on n-h1-849104-4 Jul 12 12:01:19.321451 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-15c64bfd-9837-4abb-a612-b09aec65845e req-72767c5a-5a31-4fab-8466-3db66bca6619 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075110 Jul 12 12:01:19.325921 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1203/2579] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:19.327612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9a831be8-7819-4cf4-ab4a-5a2f4bc0fe31 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:19.329222 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9a831be8-7819-4cf4-ab4a-5a2f4bc0fe31 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:19.331528 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9a831be8-7819-4cf4-ab4a-5a2f4bc0fe31 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:19.332625 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9a831be8-7819-4cf4-ab4a-5a2f4bc0fe31 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:19.359786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:19.434128 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9a831be8-7819-4cf4-ab4a-5a2f4bc0fe31 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:19.451751 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9a831be8-7819-4cf4-ab4a-5a2f4bc0fe31 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 200 len: 1306 microversion: 2.1 time: 0.156817 Jul 12 12:01:19.453606 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1377/2580] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:19 2022] GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 1306 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:19.647400 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-632eccfd-f7b5-49bb-a19e-01202a46400c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:19.649752 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-632eccfd-f7b5-49bb-a19e-01202a46400c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:19.665858 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-632eccfd-f7b5-49bb-a19e-01202a46400c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:19.665858 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-632eccfd-f7b5-49bb-a19e-01202a46400c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:19.666720 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-632eccfd-f7b5-49bb-a19e-01202a46400c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:19.667755 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-632eccfd-f7b5-49bb-a19e-01202a46400c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:19.830911 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a62fdf17-6d0e-4a67-bf48-0add43779a15 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:19.833572 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a62fdf17-6d0e-4a67-bf48-0add43779a15 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:19.848232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a62fdf17-6d0e-4a67-bf48-0add43779a15 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:19.849307 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a62fdf17-6d0e-4a67-bf48-0add43779a15 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:19.856272 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a62fdf17-6d0e-4a67-bf48-0add43779a15 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:19.858796 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a62fdf17-6d0e-4a67-bf48-0add43779a15 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:19.965453 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-632eccfd-f7b5-49bb-a19e-01202a46400c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:19.986642 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-632eccfd-f7b5-49bb-a19e-01202a46400c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1506 microversion: 2.1 time: 0.355076 Jul 12 12:01:19.987838 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1204/2581] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:19 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:19.992941 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1707c3d7-2dde-45af-b4d3-65686ddfa478 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:19.993958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1707c3d7-2dde-45af-b4d3-65686ddfa478 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:20.017696 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1707c3d7-2dde-45af-b4d3-65686ddfa478 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:20.019635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1707c3d7-2dde-45af-b4d3-65686ddfa478 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:20.021156 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1707c3d7-2dde-45af-b4d3-65686ddfa478 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:20.025553 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1707c3d7-2dde-45af-b4d3-65686ddfa478 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:20.187324 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a62fdf17-6d0e-4a67-bf48-0add43779a15 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:20.223503 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a62fdf17-6d0e-4a67-bf48-0add43779a15 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1277 microversion: 2.1 time: 0.403802 Jul 12 12:01:20.236700 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1378/2582] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:19 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1277 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:20.419654 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1707c3d7-2dde-45af-b4d3-65686ddfa478 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:20.428755 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1707c3d7-2dde-45af-b4d3-65686ddfa478 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1319 microversion: 2.1 time: 0.439469 Jul 12 12:01:20.430247 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1205/2583] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:19 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:20.479709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-973f5fd2-0d37-4c60-89d6-68fe1e38a3fa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:20.482842 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-973f5fd2-0d37-4c60-89d6-68fe1e38a3fa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: e337b451-c995-432f-bfcf-c81b435abb3e] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:20.490433 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-973f5fd2-0d37-4c60-89d6-68fe1e38a3fa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:20.491140 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-973f5fd2-0d37-4c60-89d6-68fe1e38a3fa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:20.492129 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-973f5fd2-0d37-4c60-89d6-68fe1e38a3fa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:20.492815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-973f5fd2-0d37-4c60-89d6-68fe1e38a3fa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:20.510625 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-973f5fd2-0d37-4c60-89d6-68fe1e38a3fa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] HTTP exception thrown: Instance e337b451-c995-432f-bfcf-c81b435abb3e could not be found. Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-973f5fd2-0d37-4c60-89d6-68fe1e38a3fa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Request method failure captured: Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e HTTP/1.1 Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWILI-LaUuSmnodro6Yyvobsb3MGTtJ_xzuwKHmpu43p3qTMUTGndjTLdP9PAXgfXZD4x2BTJU9hf6DH1-YWJemq-kzxOuILhoXYRGfyA0rsQHXrM-M4QI_LC0fzMYEiua1sR2Hty5tvCp0GXzcI6mdTb5OJWji7OBA5Ar6gkcamJVg Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 56c52b6ceeb64ea4a313ee77b0161dde Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ListServerFiltersTestJSON-1750084143 Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56c52b6ceeb64ea4a313ee77b0161dde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56c52b6ceeb64ea4a313ee77b0161dde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/56c52b6ceeb64ea4a313ee77b0161dde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_56c52b6ceeb64ea4a313ee77b0161dde", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ListServerFiltersTestJSON-1750084143 Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 56c52b6ceeb64ea4a313ee77b0161dde Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1750084143 Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ListServerFiltersTestJSON-1750084143-project Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 1094ce20b0b14bd5883a82846c482842 Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ListServerFiltersTestJSON-1750084143-project Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance e337b451-c995-432f-bfcf-c81b435abb3e could not be found. Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'e337b451-c995-432f-bfcf-c81b435abb3e'} Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e337b451-c995-432f-bfcf-c81b435abb3e could not be found. Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e337b451-c995-432f-bfcf-c81b435abb3e could not be found. Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:01:20.515090 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:20.523502 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:20.523502 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:01:20.523502 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:01:20.523502 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:01:20.523502 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:01:20.523502 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e337b451-c995-432f-bfcf-c81b435abb3e could not be found. Jul 12 12:01:20.523502 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:20.526542 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-973f5fd2-0d37-4c60-89d6-68fe1e38a3fa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Returning 404 to user: Instance e337b451-c995-432f-bfcf-c81b435abb3e could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:01:20.527659 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-973f5fd2-0d37-4c60-89d6-68fe1e38a3fa tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e" status: 404 len: 111 microversion: 2.1 time: 0.054728 Jul 12 12:01:20.537135 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ff20d537-932f-41b4-88d0-2ea05364eef9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:20.537964 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ff20d537-932f-41b4-88d0-2ea05364eef9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:20.541000 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1379/2584] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:20 2022] GET /compute/v2.1/servers/e337b451-c995-432f-bfcf-c81b435abb3e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 12:01:20.544924 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff20d537-932f-41b4-88d0-2ea05364eef9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:20.545995 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff20d537-932f-41b4-88d0-2ea05364eef9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:20.547182 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff20d537-932f-41b4-88d0-2ea05364eef9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:20.547948 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff20d537-932f-41b4-88d0-2ea05364eef9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:20.595841 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ff20d537-932f-41b4-88d0-2ea05364eef9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:01:20.722133 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:20.735513 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ff20d537-932f-41b4-88d0-2ea05364eef9 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 204 len: 0 microversion: 2.1 time: 0.196857 Jul 12 12:01:20.749494 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e190bb3a-c9f6-4c67-9072-2590cc8b004c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:20.750887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e190bb3a-c9f6-4c67-9072-2590cc8b004c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:20.751876 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1206/2585] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:01:20 2022] DELETE /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:01:20.758931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e190bb3a-c9f6-4c67-9072-2590cc8b004c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:20.759553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e190bb3a-c9f6-4c67-9072-2590cc8b004c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:20.760552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e190bb3a-c9f6-4c67-9072-2590cc8b004c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:20.761060 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e190bb3a-c9f6-4c67-9072-2590cc8b004c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:21.021307 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-60041c6b-57e4-43c8-9a4f-d1f73faf7747 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:21.022635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-60041c6b-57e4-43c8-9a4f-d1f73faf7747 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:21.039493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60041c6b-57e4-43c8-9a4f-d1f73faf7747 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:21.040071 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60041c6b-57e4-43c8-9a4f-d1f73faf7747 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:21.042637 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60041c6b-57e4-43c8-9a4f-d1f73faf7747 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:21.043608 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-60041c6b-57e4-43c8-9a4f-d1f73faf7747 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:21.052497 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e190bb3a-c9f6-4c67-9072-2590cc8b004c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:21.066935 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e190bb3a-c9f6-4c67-9072-2590cc8b004c tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1516 microversion: 2.1 time: 0.323364 Jul 12 12:01:21.069286 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1380/2586] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:20 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1516 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:21.251848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-30b4b6e0-487b-4881-8d70-15a65347675d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:21.252734 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-30b4b6e0-487b-4881-8d70-15a65347675d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:21.261690 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-30b4b6e0-487b-4881-8d70-15a65347675d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:21.262236 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-30b4b6e0-487b-4881-8d70-15a65347675d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:21.264119 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-30b4b6e0-487b-4881-8d70-15a65347675d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:21.264640 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-30b4b6e0-487b-4881-8d70-15a65347675d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:21.292956 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-60041c6b-57e4-43c8-9a4f-d1f73faf7747 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:21.310298 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-60041c6b-57e4-43c8-9a4f-d1f73faf7747 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1486 microversion: 2.1 time: 0.297729 Jul 12 12:01:21.312071 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1207/2587] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:21 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1486 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:21.453089 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8d664669-3b13-4306-8665-a324661f76e3 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:21.456720 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8d664669-3b13-4306-8665-a324661f76e3 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:21.479855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8d664669-3b13-4306-8665-a324661f76e3 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:21.485866 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8d664669-3b13-4306-8665-a324661f76e3 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:21.496832 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8d664669-3b13-4306-8665-a324661f76e3 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:21.496832 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8d664669-3b13-4306-8665-a324661f76e3 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:21.631594 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-30b4b6e0-487b-4881-8d70-15a65347675d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:21.650336 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-30b4b6e0-487b-4881-8d70-15a65347675d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1317 microversion: 2.1 time: 0.395698 Jul 12 12:01:21.660078 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1381/2588] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:21 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:21.696648 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1879949898", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:21.770977 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8d664669-3b13-4306-8665-a324661f76e3 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:21.774455 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:21.781498 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] validate_networks() for [('2962b434-7039-41ae-a66b-582cb340c07b', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 12:01:21.782474 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8d664669-3b13-4306-8665-a324661f76e3 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 200 len: 1508 microversion: 2.1 time: 0.338507 Jul 12 12:01:21.797720 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1208/2589] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:21 2022] GET /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:21.803159 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-681c99d9-9c85-40b6-924c-d92d84692423 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:21.804145 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-681c99d9-9c85-40b6-924c-d92d84692423 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: fa207c5e-e3a6-4510-a3ce-baa983af04e2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:21.811793 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-681c99d9-9c85-40b6-924c-d92d84692423 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:21.813267 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-681c99d9-9c85-40b6-924c-d92d84692423 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:21.814144 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-681c99d9-9c85-40b6-924c-d92d84692423 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:21.814580 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-681c99d9-9c85-40b6-924c-d92d84692423 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:22.004430 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-681c99d9-9c85-40b6-924c-d92d84692423 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:22.012933 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-681c99d9-9c85-40b6-924c-d92d84692423 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/fa207c5e-e3a6-4510-a3ce-baa983af04e2" status: 200 len: 1507 microversion: 2.1 time: 0.213881 Jul 12 12:01:22.024294 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1209/2590] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:21 2022] GET /compute/v2.1/servers/fa207c5e-e3a6-4510-a3ce-baa983af04e2 => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:22.030077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7f2c0201-05e3-4cf4-8ca9-2afc1996f04c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:22.031074 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7f2c0201-05e3-4cf4-8ca9-2afc1996f04c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: fa207c5e-e3a6-4510-a3ce-baa983af04e2] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:22.040653 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7f2c0201-05e3-4cf4-8ca9-2afc1996f04c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:22.041305 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7f2c0201-05e3-4cf4-8ca9-2afc1996f04c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:22.042581 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7f2c0201-05e3-4cf4-8ca9-2afc1996f04c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:22.043304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7f2c0201-05e3-4cf4-8ca9-2afc1996f04c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:22.097625 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7f2c0201-05e3-4cf4-8ca9-2afc1996f04c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: fa207c5e-e3a6-4510-a3ce-baa983af04e2] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:01:22.254694 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7f2c0201-05e3-4cf4-8ca9-2afc1996f04c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fa207c5e-e3a6-4510-a3ce-baa983af04e2" status: 204 len: 0 microversion: 2.1 time: 0.228189 Jul 12 12:01:22.255393 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1210/2591] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:01:22 2022] DELETE /compute/v2.1/servers/fa207c5e-e3a6-4510-a3ce-baa983af04e2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:01:22.262526 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4d64a4e0-7a2e-4f17-81d2-7c1f0d6a7deb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:22.264090 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4d64a4e0-7a2e-4f17-81d2-7c1f0d6a7deb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:22.274177 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4d64a4e0-7a2e-4f17-81d2-7c1f0d6a7deb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:22.274799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4d64a4e0-7a2e-4f17-81d2-7c1f0d6a7deb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:22.276298 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4d64a4e0-7a2e-4f17-81d2-7c1f0d6a7deb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:22.281075 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4d64a4e0-7a2e-4f17-81d2-7c1f0d6a7deb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:22.331566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:01:22.332113 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:01:22.332510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:01:22.332921 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:01:22.333367 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:01:22.343250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:22.343699 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:22.344531 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:22.344966 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:22.364926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Getting quotas for project 9c2da0a7a8cc49eaa09a6aff6f977dae. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:01:22.373620 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Getting quotas for user 4731a65ac69548eaaa6ccb9049662968 and project 9c2da0a7a8cc49eaa09a6aff6f977dae. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:01:22.403333 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 12:01:22.405589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:01:22.473931 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d2847f7a-2271-4e60-8733-51eb63bfe57e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.781487 Jul 12 12:01:22.474473 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4d64a4e0-7a2e-4f17-81d2-7c1f0d6a7deb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:22.477335 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1382/2592] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 12:01:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 12:01:22.490385 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-04cbe296-65cf-46c7-a9ac-0ec6c9314c25 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:22.490610 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4d64a4e0-7a2e-4f17-81d2-7c1f0d6a7deb tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1516 microversion: 2.1 time: 0.233645 Jul 12 12:01:22.491053 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1211/2593] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:22 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1516 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:22.492628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-04cbe296-65cf-46c7-a9ac-0ec6c9314c25 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:22.496869 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a2a61256-4459-432c-a768-10188368e127 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:22.498272 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a2a61256-4459-432c-a768-10188368e127 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:22.525107 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04cbe296-65cf-46c7-a9ac-0ec6c9314c25 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:22.525735 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04cbe296-65cf-46c7-a9ac-0ec6c9314c25 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:22.526733 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04cbe296-65cf-46c7-a9ac-0ec6c9314c25 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:22.527039 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04cbe296-65cf-46c7-a9ac-0ec6c9314c25 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:22.569435 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-04cbe296-65cf-46c7-a9ac-0ec6c9314c25 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 3d0b4967-48f4-4e56-bba3-0a557acec63a] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:01:22.606165 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a2a61256-4459-432c-a768-10188368e127 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:22.615152 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a2a61256-4459-432c-a768-10188368e127 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1214 microversion: 2.1 time: 0.122940 Jul 12 12:01:22.620485 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1212/2594] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:22 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1214 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:22.678157 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2f927828-679a-4722-9962-5a83ceaac8a8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:22.679046 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2f927828-679a-4722-9962-5a83ceaac8a8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:22.696410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2f927828-679a-4722-9962-5a83ceaac8a8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:22.697057 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2f927828-679a-4722-9962-5a83ceaac8a8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:22.697856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2f927828-679a-4722-9962-5a83ceaac8a8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:22.698439 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2f927828-679a-4722-9962-5a83ceaac8a8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:22.720196 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-04cbe296-65cf-46c7-a9ac-0ec6c9314c25 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a" status: 204 len: 0 microversion: 2.1 time: 0.239646 Jul 12 12:01:22.721224 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1383/2595] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:01:22 2022] DELETE /compute/v2.1/servers/3d0b4967-48f4-4e56-bba3-0a557acec63a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:01:22.959312 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2f927828-679a-4722-9962-5a83ceaac8a8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:22.968081 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2f927828-679a-4722-9962-5a83ceaac8a8 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1317 microversion: 2.1 time: 0.295289 Jul 12 12:01:22.972594 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1213/2596] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:22 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:22.979622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-311428822", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "170348aa-5394-41be-88ac-54cf3cd1a3eb"}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:23.067951 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] validate_networks() for [('170348aa-5394-41be-88ac-54cf3cd1a3eb', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 12:01:23.510545 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3ef800cf-e38f-4a46-b0a6-2c31ff376328 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:23.513500 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3ef800cf-e38f-4a46-b0a6-2c31ff376328 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:23.533536 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3ef800cf-e38f-4a46-b0a6-2c31ff376328 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:23.534234 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3ef800cf-e38f-4a46-b0a6-2c31ff376328 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:23.536217 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3ef800cf-e38f-4a46-b0a6-2c31ff376328 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:23.548868 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3ef800cf-e38f-4a46-b0a6-2c31ff376328 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:23.731116 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3ef800cf-e38f-4a46-b0a6-2c31ff376328 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1094ce20b0b14bd5883a82846c482842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c52b6ceeb64ea4a313ee77b0161dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:23.745158 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3ef800cf-e38f-4a46-b0a6-2c31ff376328 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 200 len: 1474 microversion: 2.1 time: 0.237857 Jul 12 12:01:23.757348 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1214/2597] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:23 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 1474 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:23.762303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d1815637-b8c6-4b26-9d82-2f5faaa53fcf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:23.764463 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d1815637-b8c6-4b26-9d82-2f5faaa53fcf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:23.771725 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d1815637-b8c6-4b26-9d82-2f5faaa53fcf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:23.772500 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d1815637-b8c6-4b26-9d82-2f5faaa53fcf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:23.773459 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d1815637-b8c6-4b26-9d82-2f5faaa53fcf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:23.774061 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d1815637-b8c6-4b26-9d82-2f5faaa53fcf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:23.866405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d1815637-b8c6-4b26-9d82-2f5faaa53fcf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:23.875875 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d1815637-b8c6-4b26-9d82-2f5faaa53fcf tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1218 microversion: 2.1 time: 0.117207 Jul 12 12:01:23.885904 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1215/2598] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:23 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:23.892597 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-a1a2e6b4-0cab-40d7-8c25-a727fa38dc9a req-f0ebd282-2173-4250-9193-98d78e80b9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b09df1e-5829-4233-af64-e442475c1c1c", "name": "network-vif-deleted", "tag": "c9dea8ad-c9b6-4ead-9f6e-94271da2c995"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:23.902257 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-a1a2e6b4-0cab-40d7-8c25-a727fa38dc9a req-f0ebd282-2173-4250-9193-98d78e80b9d5 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:23.907446 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-a1a2e6b4-0cab-40d7-8c25-a727fa38dc9a req-f0ebd282-2173-4250-9193-98d78e80b9d5 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:23.928172 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-a1a2e6b4-0cab-40d7-8c25-a727fa38dc9a req-f0ebd282-2173-4250-9193-98d78e80b9d5 service nova] Creating event network-vif-deleted:c9dea8ad-c9b6-4ead-9f6e-94271da2c995 for instance 3b09df1e-5829-4233-af64-e442475c1c1c on n-h2-849104-4 Jul 12 12:01:23.949558 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-a1a2e6b4-0cab-40d7-8c25-a727fa38dc9a req-f0ebd282-2173-4250-9193-98d78e80b9d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061983 Jul 12 12:01:23.956137 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1216/2599] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:23.994155 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:01:23.994721 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:01:23.995052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:01:23.995472 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:01:23.995890 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:01:23.998568 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-746944e4-dc96-41b8-a791-3a86eca1cc62 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:23.999690 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-746944e4-dc96-41b8-a791-3a86eca1cc62 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:24.007362 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:24.007970 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:24.008921 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:24.009459 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:24.011273 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-746944e4-dc96-41b8-a791-3a86eca1cc62 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:24.011982 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-746944e4-dc96-41b8-a791-3a86eca1cc62 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:24.013742 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-746944e4-dc96-41b8-a791-3a86eca1cc62 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:24.014290 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-746944e4-dc96-41b8-a791-3a86eca1cc62 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:24.035113 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Getting quotas for project f363c7937867459f989f28dfa05e2a43. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:01:24.043568 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Getting quotas for user bf94f6e3b43144a28378f2e272e1250d and project f363c7937867459f989f28dfa05e2a43. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:01:24.070333 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Going to run 2 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 12:01:24.074412 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 5962be6e-d556-49ee-bc2f-8132b8a1ffc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:01:24.126336 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=5962be6e-d556-49ee-bc2f-8132b8a1ffc5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:01:24.211242 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-746944e4-dc96-41b8-a791-3a86eca1cc62 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:24.216225 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dfb6e2be-545b-46cf-bc5a-015b2a48a44b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.250500 Jul 12 12:01:24.221689 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1384/2600] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 12:01:22 2022] POST /compute/v2.1/servers => generated 32 bytes in 1257 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 12 12:01:24.225384 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-746944e4-dc96-41b8-a791-3a86eca1cc62 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1317 microversion: 2.1 time: 0.233137 Jul 12 12:01:24.226407 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1217/2601] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:23 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:24.230601 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-30584d84-d8b5-4749-b0f8-7ee3b269b433 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:24.244448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-30584d84-d8b5-4749-b0f8-7ee3b269b433 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:24.246010 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-30584d84-d8b5-4749-b0f8-7ee3b269b433 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Searching by: {'deleted': False, 'project_id': 'f363c7937867459f989f28dfa05e2a43'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:01:24.286450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-30584d84-d8b5-4749-b0f8-7ee3b269b433 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:24.288571 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-30584d84-d8b5-4749-b0f8-7ee3b269b433 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:24.289845 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-30584d84-d8b5-4749-b0f8-7ee3b269b433 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:24.291685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-30584d84-d8b5-4749-b0f8-7ee3b269b433 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:24.338017 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.multi_cell_list [None req-30584d84-d8b5-4749-b0f8-7ee3b269b433 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=125984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:01:24.389316 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-30584d84-d8b5-4749-b0f8-7ee3b269b433 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.163364 Jul 12 12:01:24.396455 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1385/2602] 10.222.0.50 () {58 vars in 1124 bytes} [Tue Jul 12 12:01:24 2022] GET /compute/v2.1/servers => generated 1333 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:24.404760 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-43841930-b784-47df-94ed-a4d3d35266f7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:24.406022 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-43841930-b784-47df-94ed-a4d3d35266f7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:24.582133 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-43841930-b784-47df-94ed-a4d3d35266f7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:24.599363 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-43841930-b784-47df-94ed-a4d3d35266f7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1217 microversion: 2.1 time: 0.197634 Jul 12 12:01:24.605997 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1218/2603] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:24 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1217 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:24.765966 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cfd9d485-f6a6-4e12-ae8b-c4c7415734d0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:24.766273 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cfd9d485-f6a6-4e12-ae8b-c4c7415734d0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] [instance: 3b09df1e-5829-4233-af64-e442475c1c1c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:24.784839 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cfd9d485-f6a6-4e12-ae8b-c4c7415734d0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:24.785622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cfd9d485-f6a6-4e12-ae8b-c4c7415734d0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:24.786554 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cfd9d485-f6a6-4e12-ae8b-c4c7415734d0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:24.786996 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cfd9d485-f6a6-4e12-ae8b-c4c7415734d0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:24.828790 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-cfd9d485-f6a6-4e12-ae8b-c4c7415734d0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] HTTP exception thrown: Instance 3b09df1e-5829-4233-af64-e442475c1c1c could not be found. Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cfd9d485-f6a6-4e12-ae8b-c4c7415734d0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Request method failure captured: Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c HTTP/1.1 Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWILI-LaUuSmnodro6Yyvobsb3MGTtJ_xzuwKHmpu43p3qTMUTGndjTLdP9PAXgfXZD4x2BTJU9hf6DH1-YWJemq-kzxOuILhoXYRGfyA0rsQHXrM-M4QI_LC0fzMYEiua1sR2Hty5tvCp0GXzcI6mdTb5OJWji7OBA5Ar6gkcamJVg Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 56c52b6ceeb64ea4a313ee77b0161dde Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ListServerFiltersTestJSON-1750084143 Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56c52b6ceeb64ea4a313ee77b0161dde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56c52b6ceeb64ea4a313ee77b0161dde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/56c52b6ceeb64ea4a313ee77b0161dde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_56c52b6ceeb64ea4a313ee77b0161dde", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ListServerFiltersTestJSON-1750084143 Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 56c52b6ceeb64ea4a313ee77b0161dde Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1750084143 Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ListServerFiltersTestJSON-1750084143-project Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 1094ce20b0b14bd5883a82846c482842 Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ListServerFiltersTestJSON-1750084143-project Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 3b09df1e-5829-4233-af64-e442475c1c1c could not be found. Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '3b09df1e-5829-4233-af64-e442475c1c1c'} Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b09df1e-5829-4233-af64-e442475c1c1c could not be found. Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b09df1e-5829-4233-af64-e442475c1c1c could not be found. Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:01:24.839808 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:24.844846 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:24.844846 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:01:24.844846 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:01:24.844846 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:01:24.844846 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:01:24.844846 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b09df1e-5829-4233-af64-e442475c1c1c could not be found. Jul 12 12:01:24.844846 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:24.849671 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cfd9d485-f6a6-4e12-ae8b-c4c7415734d0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] Returning 404 to user: Instance 3b09df1e-5829-4233-af64-e442475c1c1c could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:01:24.851257 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cfd9d485-f6a6-4e12-ae8b-c4c7415734d0 tempest-ListServerFiltersTestJSON-1750084143 tempest-ListServerFiltersTestJSON-1750084143-project] 10.222.0.50 "GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c" status: 404 len: 111 microversion: 2.1 time: 0.090512 Jul 12 12:01:24.852056 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1386/2604] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:24 2022] GET /compute/v2.1/servers/3b09df1e-5829-4233-af64-e442475c1c1c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 12:01:24.895319 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fb071019-ec4d-4b08-a2a8-f0a6f0cd5e43 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:24.895941 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fb071019-ec4d-4b08-a2a8-f0a6f0cd5e43 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:24.913179 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fb071019-ec4d-4b08-a2a8-f0a6f0cd5e43 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:24.913652 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fb071019-ec4d-4b08-a2a8-f0a6f0cd5e43 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:24.914566 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fb071019-ec4d-4b08-a2a8-f0a6f0cd5e43 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:24.922335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fb071019-ec4d-4b08-a2a8-f0a6f0cd5e43 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:25.006954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-16be85c7-6ecc-4223-b242-2987064d65ca req-d80dad1b-51af-4c28-ac5e-81cb841b47ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd4cf5e-cd93-4202-815d-87eb5305f5ee", "tag": "59c136a8-69e4-4426-bca5-83e039980105"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:25.034768 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-16be85c7-6ecc-4223-b242-2987064d65ca req-d80dad1b-51af-4c28-ac5e-81cb841b47ac service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:25.036380 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-16be85c7-6ecc-4223-b242-2987064d65ca req-d80dad1b-51af-4c28-ac5e-81cb841b47ac service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:25.092568 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-16be85c7-6ecc-4223-b242-2987064d65ca req-d80dad1b-51af-4c28-ac5e-81cb841b47ac service nova] Creating event network-changed:59c136a8-69e4-4426-bca5-83e039980105 for instance 5cd4cf5e-cd93-4202-815d-87eb5305f5ee on n-h2-849104-4 Jul 12 12:01:25.106072 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-16be85c7-6ecc-4223-b242-2987064d65ca req-d80dad1b-51af-4c28-ac5e-81cb841b47ac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109960 Jul 12 12:01:25.108573 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1387/2605] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:01:25.156788 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fb071019-ec4d-4b08-a2a8-f0a6f0cd5e43 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:25.204664 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fb071019-ec4d-4b08-a2a8-f0a6f0cd5e43 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1210 microversion: 2.1 time: 0.296018 Jul 12 12:01:25.206179 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1219/2606] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:24 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1210 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:25.244234 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f45f9e57-fbf7-401e-a79f-149bb6d28220 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:25.245410 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f45f9e57-fbf7-401e-a79f-149bb6d28220 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:25.261713 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45f9e57-fbf7-401e-a79f-149bb6d28220 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:25.263767 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45f9e57-fbf7-401e-a79f-149bb6d28220 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:25.265992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45f9e57-fbf7-401e-a79f-149bb6d28220 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:25.269625 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45f9e57-fbf7-401e-a79f-149bb6d28220 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:25.626637 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5759bea0-fc52-47fe-a38a-8ccb7ecfcbfe tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:25.627993 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5759bea0-fc52-47fe-a38a-8ccb7ecfcbfe tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:25.658905 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5759bea0-fc52-47fe-a38a-8ccb7ecfcbfe tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:25.659534 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5759bea0-fc52-47fe-a38a-8ccb7ecfcbfe tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:25.660647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5759bea0-fc52-47fe-a38a-8ccb7ecfcbfe tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:25.661636 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5759bea0-fc52-47fe-a38a-8ccb7ecfcbfe tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:25.964385 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5759bea0-fc52-47fe-a38a-8ccb7ecfcbfe tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:25.980738 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5759bea0-fc52-47fe-a38a-8ccb7ecfcbfe tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1221 microversion: 2.1 time: 0.359032 Jul 12 12:01:25.983985 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1220/2607] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:25 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1221 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:26.087932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f45f9e57-fbf7-401e-a79f-149bb6d28220 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:26.120406 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f45f9e57-fbf7-401e-a79f-149bb6d28220 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1317 microversion: 2.1 time: 0.878974 Jul 12 12:01:26.121341 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1388/2608] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:25 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1317 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:26.223635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1206ba37-e89d-4443-b6a8-c19412c1ada8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:26.224565 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1206ba37-e89d-4443-b6a8-c19412c1ada8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:26.237739 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1206ba37-e89d-4443-b6a8-c19412c1ada8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:26.241850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1206ba37-e89d-4443-b6a8-c19412c1ada8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:26.243112 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1206ba37-e89d-4443-b6a8-c19412c1ada8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:26.243792 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1206ba37-e89d-4443-b6a8-c19412c1ada8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:26.641310 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1206ba37-e89d-4443-b6a8-c19412c1ada8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:26.674840 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1206ba37-e89d-4443-b6a8-c19412c1ada8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1272 microversion: 2.1 time: 0.442495 Jul 12 12:01:26.676240 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1221/2609] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:26 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1272 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:27.010132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-13b0c39e-db8f-449b-bc27-0ad52a711bf0 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:27.013671 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-13b0c39e-db8f-449b-bc27-0ad52a711bf0 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:27.031556 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-13b0c39e-db8f-449b-bc27-0ad52a711bf0 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:27.032357 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-13b0c39e-db8f-449b-bc27-0ad52a711bf0 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:27.034619 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-13b0c39e-db8f-449b-bc27-0ad52a711bf0 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:27.036150 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-13b0c39e-db8f-449b-bc27-0ad52a711bf0 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:27.145205 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c066df68-fe70-4ef7-98fb-5cef9d64d100 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:27.146019 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c066df68-fe70-4ef7-98fb-5cef9d64d100 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:27.160980 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c066df68-fe70-4ef7-98fb-5cef9d64d100 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:27.162204 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c066df68-fe70-4ef7-98fb-5cef9d64d100 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:27.163525 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c066df68-fe70-4ef7-98fb-5cef9d64d100 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:27.164394 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c066df68-fe70-4ef7-98fb-5cef9d64d100 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:27.233997 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-13b0c39e-db8f-449b-bc27-0ad52a711bf0 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:27.247782 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-13b0c39e-db8f-449b-bc27-0ad52a711bf0 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1277 microversion: 2.1 time: 0.242512 Jul 12 12:01:27.249131 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1389/2610] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:27 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:27.335100 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-7e588ca3-1e6e-46a1-95b9-32265b7baf40 req-5007309f-8a93-4cc3-85c9-1b6da9822b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa207c5e-e3a6-4510-a3ce-baa983af04e2", "name": "network-vif-deleted", "tag": "d8563bab-3f1b-4f53-ac3f-28d8ccc417a0"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:27.374631 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-7e588ca3-1e6e-46a1-95b9-32265b7baf40 req-5007309f-8a93-4cc3-85c9-1b6da9822b90 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:27.375861 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-7e588ca3-1e6e-46a1-95b9-32265b7baf40 req-5007309f-8a93-4cc3-85c9-1b6da9822b90 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:27.411713 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-7e588ca3-1e6e-46a1-95b9-32265b7baf40 req-5007309f-8a93-4cc3-85c9-1b6da9822b90 service nova] Creating event network-vif-deleted:d8563bab-3f1b-4f53-ac3f-28d8ccc417a0 for instance fa207c5e-e3a6-4510-a3ce-baa983af04e2 on n-h1-849104-4 Jul 12 12:01:27.424447 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-7e588ca3-1e6e-46a1-95b9-32265b7baf40 req-5007309f-8a93-4cc3-85c9-1b6da9822b90 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090201 Jul 12 12:01:27.427027 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1390/2611] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:01:27.592722 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c066df68-fe70-4ef7-98fb-5cef9d64d100 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:27.605754 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c066df68-fe70-4ef7-98fb-5cef9d64d100 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1317 microversion: 2.1 time: 0.467280 Jul 12 12:01:27.606698 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1222/2612] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:27 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:27.693579 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0db4de03-0bd3-45c8-9d41-06875cd57f4c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:27.694286 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0db4de03-0bd3-45c8-9d41-06875cd57f4c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:27.706761 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0db4de03-0bd3-45c8-9d41-06875cd57f4c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:27.707216 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0db4de03-0bd3-45c8-9d41-06875cd57f4c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:27.712449 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0db4de03-0bd3-45c8-9d41-06875cd57f4c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:27.713053 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0db4de03-0bd3-45c8-9d41-06875cd57f4c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:28.271649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ea2561d0-5c84-4936-ba0d-20d3a13c671e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:28.272879 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ea2561d0-5c84-4936-ba0d-20d3a13c671e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:28.288263 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ea2561d0-5c84-4936-ba0d-20d3a13c671e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:28.289209 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ea2561d0-5c84-4936-ba0d-20d3a13c671e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:28.290303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ea2561d0-5c84-4936-ba0d-20d3a13c671e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:28.291019 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ea2561d0-5c84-4936-ba0d-20d3a13c671e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:28.564491 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0db4de03-0bd3-45c8-9d41-06875cd57f4c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:28.577233 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0db4de03-0bd3-45c8-9d41-06875cd57f4c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1314 microversion: 2.1 time: 0.889040 Jul 12 12:01:28.578380 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1391/2613] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:27 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:28.619283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ea2561d0-5c84-4936-ba0d-20d3a13c671e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:28.629025 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f7313aa4-a657-481d-92ed-25394c0fa40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:28.629740 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f7313aa4-a657-481d-92ed-25394c0fa40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:28.633059 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:28.643282 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f7313aa4-a657-481d-92ed-25394c0fa40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:28.643963 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f7313aa4-a657-481d-92ed-25394c0fa40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:28.644880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f7313aa4-a657-481d-92ed-25394c0fa40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:28.645470 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f7313aa4-a657-481d-92ed-25394c0fa40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:28.655714 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ea2561d0-5c84-4936-ba0d-20d3a13c671e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1275 microversion: 2.1 time: 0.387819 Jul 12 12:01:28.673836 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1223/2614] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:28 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1275 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:29.461371 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-4615e5a4-aa6c-4539-8d42-d90f6eaaa653 req-72879393-bfd9-43d0-bed9-30c51e1e6927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0b4967-48f4-4e56-bba3-0a557acec63a", "name": "network-vif-deleted", "tag": "b2d2b002-ad9c-4c29-96c1-bda0e501b993"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:29.478467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4615e5a4-aa6c-4539-8d42-d90f6eaaa653 req-72879393-bfd9-43d0-bed9-30c51e1e6927 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:29.480765 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-4615e5a4-aa6c-4539-8d42-d90f6eaaa653 req-72879393-bfd9-43d0-bed9-30c51e1e6927 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:29.499248 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-4615e5a4-aa6c-4539-8d42-d90f6eaaa653 req-72879393-bfd9-43d0-bed9-30c51e1e6927 service nova] Creating event network-vif-deleted:b2d2b002-ad9c-4c29-96c1-bda0e501b993 for instance 3d0b4967-48f4-4e56-bba3-0a557acec63a on n-h1-849104-4 Jul 12 12:01:29.505708 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-4615e5a4-aa6c-4539-8d42-d90f6eaaa653 req-72879393-bfd9-43d0-bed9-30c51e1e6927 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048545 Jul 12 12:01:29.506964 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1224/2615] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:29.570267 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f7313aa4-a657-481d-92ed-25394c0fa40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:29.590330 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f7313aa4-a657-481d-92ed-25394c0fa40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1317 microversion: 2.1 time: 0.965367 Jul 12 12:01:29.590936 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1392/2616] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:28 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1317 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:29.641259 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7ae67009-e8c4-4b66-a0ef-86db91272b3d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:29.642580 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7ae67009-e8c4-4b66-a0ef-86db91272b3d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:29.677691 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7ae67009-e8c4-4b66-a0ef-86db91272b3d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:29.678383 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7ae67009-e8c4-4b66-a0ef-86db91272b3d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:29.679216 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7ae67009-e8c4-4b66-a0ef-86db91272b3d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:29.680386 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7ae67009-e8c4-4b66-a0ef-86db91272b3d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:29.681430 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b544443f-069c-4a68-8a20-c3bec4355a02 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:29.682187 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b544443f-069c-4a68-8a20-c3bec4355a02 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:29.691745 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b544443f-069c-4a68-8a20-c3bec4355a02 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:29.694288 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b544443f-069c-4a68-8a20-c3bec4355a02 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:29.695116 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b544443f-069c-4a68-8a20-c3bec4355a02 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:29.695686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b544443f-069c-4a68-8a20-c3bec4355a02 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:29.915179 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b544443f-069c-4a68-8a20-c3bec4355a02 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:29.966756 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b544443f-069c-4a68-8a20-c3bec4355a02 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1275 microversion: 2.1 time: 0.287763 Jul 12 12:01:29.978437 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1393/2617] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:29 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1275 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:30.210311 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7ae67009-e8c4-4b66-a0ef-86db91272b3d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:30.236111 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7ae67009-e8c4-4b66-a0ef-86db91272b3d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1314 microversion: 2.1 time: 0.618224 Jul 12 12:01:30.242245 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1225/2618] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:29 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:30.624772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-50cdea74-5e05-4f26-8219-cdf6d9a6e880 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:30.636056 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-50cdea74-5e05-4f26-8219-cdf6d9a6e880 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:30.680666 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-50cdea74-5e05-4f26-8219-cdf6d9a6e880 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:30.686177 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-50cdea74-5e05-4f26-8219-cdf6d9a6e880 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:30.687617 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-50cdea74-5e05-4f26-8219-cdf6d9a6e880 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:30.688310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-50cdea74-5e05-4f26-8219-cdf6d9a6e880 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:30.996772 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ede3c470-841b-4120-96ec-26b8c95128e1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:30.998327 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ede3c470-841b-4120-96ec-26b8c95128e1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:31.014392 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ede3c470-841b-4120-96ec-26b8c95128e1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:31.015105 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ede3c470-841b-4120-96ec-26b8c95128e1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:31.016070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ede3c470-841b-4120-96ec-26b8c95128e1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:31.016678 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ede3c470-841b-4120-96ec-26b8c95128e1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:31.136282 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ede3c470-841b-4120-96ec-26b8c95128e1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:31.150003 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ede3c470-841b-4120-96ec-26b8c95128e1 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1275 microversion: 2.1 time: 0.159086 Jul 12 12:01:31.160742 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1226/2619] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:30 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:31.237660 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-50cdea74-5e05-4f26-8219-cdf6d9a6e880 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:31.274351 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8309fd39-6e42-45d2-a7ef-1449e4e97d3c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:31.277059 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8309fd39-6e42-45d2-a7ef-1449e4e97d3c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:31.307413 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8309fd39-6e42-45d2-a7ef-1449e4e97d3c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:31.308161 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8309fd39-6e42-45d2-a7ef-1449e4e97d3c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:31.312882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8309fd39-6e42-45d2-a7ef-1449e4e97d3c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:31.313601 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8309fd39-6e42-45d2-a7ef-1449e4e97d3c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:31.324603 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-50cdea74-5e05-4f26-8219-cdf6d9a6e880 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1317 microversion: 2.1 time: 0.708360 Jul 12 12:01:31.326225 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1394/2620] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:30 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1317 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:31.329137 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:31.345177 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-8cf02f5e-c559-42de-ab16-47b4627682ff req-2c7bd531-92cd-4a22-9d50-36fa9911e521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e6138b-cb03-4d22-85cb-648fc991cd77", "tag": "96e36a3f-9966-4f6e-b737-3fa8ad4f51d2"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:31.368046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-8cf02f5e-c559-42de-ab16-47b4627682ff req-2c7bd531-92cd-4a22-9d50-36fa9911e521 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:31.368523 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-8cf02f5e-c559-42de-ab16-47b4627682ff req-2c7bd531-92cd-4a22-9d50-36fa9911e521 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:31.385779 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-8cf02f5e-c559-42de-ab16-47b4627682ff req-2c7bd531-92cd-4a22-9d50-36fa9911e521 service nova] Creating event network-changed:96e36a3f-9966-4f6e-b737-3fa8ad4f51d2 for instance f6e6138b-cb03-4d22-85cb-648fc991cd77 on n-h1-849104-4 Jul 12 12:01:31.395358 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-8cf02f5e-c559-42de-ab16-47b4627682ff req-2c7bd531-92cd-4a22-9d50-36fa9911e521 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062245 Jul 12 12:01:31.397439 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1395/2621] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:31.535331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-4d16e438-e4ac-490b-b3e3-ee9e1cf51362 req-addfb545-7c8d-44c2-afac-b7aed4170a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5962be6e-d556-49ee-bc2f-8132b8a1ffc5", "tag": "3481c369-0810-4ae0-8594-04e0ea8df9e6"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:31.568125 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-4d16e438-e4ac-490b-b3e3-ee9e1cf51362 req-addfb545-7c8d-44c2-afac-b7aed4170a3d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:31.579416 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-4d16e438-e4ac-490b-b3e3-ee9e1cf51362 req-addfb545-7c8d-44c2-afac-b7aed4170a3d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:31.636576 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-4d16e438-e4ac-490b-b3e3-ee9e1cf51362 req-addfb545-7c8d-44c2-afac-b7aed4170a3d service nova] Creating event network-changed:3481c369-0810-4ae0-8594-04e0ea8df9e6 for instance 5962be6e-d556-49ee-bc2f-8132b8a1ffc5 on n-h1-849104-4 Jul 12 12:01:31.651344 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-4d16e438-e4ac-490b-b3e3-ee9e1cf51362 req-addfb545-7c8d-44c2-afac-b7aed4170a3d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120467 Jul 12 12:01:31.655190 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1396/2622] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:01:31.728134 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8309fd39-6e42-45d2-a7ef-1449e4e97d3c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:31.740807 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8309fd39-6e42-45d2-a7ef-1449e4e97d3c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1314 microversion: 2.1 time: 0.485461 Jul 12 12:01:31.741408 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1227/2623] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:31 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:32.174741 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-aba5fcb7-94f1-4820-8da7-d5a77208053c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:32.175936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-aba5fcb7-94f1-4820-8da7-d5a77208053c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:32.191929 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-aba5fcb7-94f1-4820-8da7-d5a77208053c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:32.192785 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-aba5fcb7-94f1-4820-8da7-d5a77208053c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:32.194181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-aba5fcb7-94f1-4820-8da7-d5a77208053c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:32.194986 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-aba5fcb7-94f1-4820-8da7-d5a77208053c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:32.225517 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:32.347194 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8f90fa7d-1ab5-4507-b0e3-b1a70186a29c tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:32.348352 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8f90fa7d-1ab5-4507-b0e3-b1a70186a29c tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:32.361166 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8f90fa7d-1ab5-4507-b0e3-b1a70186a29c tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:32.362012 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8f90fa7d-1ab5-4507-b0e3-b1a70186a29c tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:32.364079 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8f90fa7d-1ab5-4507-b0e3-b1a70186a29c tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:32.365119 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8f90fa7d-1ab5-4507-b0e3-b1a70186a29c tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:32.662801 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8f90fa7d-1ab5-4507-b0e3-b1a70186a29c tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:32.674206 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8f90fa7d-1ab5-4507-b0e3-b1a70186a29c tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1317 microversion: 2.1 time: 0.334454 Jul 12 12:01:32.674810 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1228/2624] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:32 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:32.773214 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-eb87b1e6-2b07-4b5d-9d95-d04db7789e21 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:32.774000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-eb87b1e6-2b07-4b5d-9d95-d04db7789e21 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:32.781702 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb87b1e6-2b07-4b5d-9d95-d04db7789e21 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:32.785294 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-aba5fcb7-94f1-4820-8da7-d5a77208053c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:32.786532 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb87b1e6-2b07-4b5d-9d95-d04db7789e21 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:32.787549 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb87b1e6-2b07-4b5d-9d95-d04db7789e21 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:32.788193 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb87b1e6-2b07-4b5d-9d95-d04db7789e21 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:32.802891 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-aba5fcb7-94f1-4820-8da7-d5a77208053c tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1317 microversion: 2.1 time: 0.635247 Jul 12 12:01:32.805719 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1397/2625] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:32 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1317 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:32.994574 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-9bb49c10-bb11-49ee-935e-25be68b4158a req-06c717a5-a0b1-4278-b472-8d2a0204e03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd4cf5e-cd93-4202-815d-87eb5305f5ee", "name": "network-vif-plugged", "status": "completed", "tag": "59c136a8-69e4-4426-bca5-83e039980105"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:33.021823 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-9bb49c10-bb11-49ee-935e-25be68b4158a req-06c717a5-a0b1-4278-b472-8d2a0204e03a service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:33.022478 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-9bb49c10-bb11-49ee-935e-25be68b4158a req-06c717a5-a0b1-4278-b472-8d2a0204e03a service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:33.056409 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-9bb49c10-bb11-49ee-935e-25be68b4158a req-06c717a5-a0b1-4278-b472-8d2a0204e03a service nova] Creating event network-vif-plugged:59c136a8-69e4-4426-bca5-83e039980105 for instance 5cd4cf5e-cd93-4202-815d-87eb5305f5ee on n-h2-849104-4 Jul 12 12:01:33.069634 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-9bb49c10-bb11-49ee-935e-25be68b4158a req-06c717a5-a0b1-4278-b472-8d2a0204e03a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078480 Jul 12 12:01:33.070299 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1398/2626] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:01:33.359872 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eb87b1e6-2b07-4b5d-9d95-d04db7789e21 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:33.371191 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-eb87b1e6-2b07-4b5d-9d95-d04db7789e21 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1314 microversion: 2.1 time: 0.607329 Jul 12 12:01:33.384997 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1229/2627] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:32 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:33.695340 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bc76949e-2718-4910-b158-3deb7e16cdbd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:33.697773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bc76949e-2718-4910-b158-3deb7e16cdbd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:33.709387 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc76949e-2718-4910-b158-3deb7e16cdbd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:33.710120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc76949e-2718-4910-b158-3deb7e16cdbd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:33.711302 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc76949e-2718-4910-b158-3deb7e16cdbd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:33.712683 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc76949e-2718-4910-b158-3deb7e16cdbd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:33.834285 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-05215463-0d7d-4d61-88fd-bfcf0722895b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:33.836411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-05215463-0d7d-4d61-88fd-bfcf0722895b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:33.856698 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-05215463-0d7d-4d61-88fd-bfcf0722895b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:33.857164 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-05215463-0d7d-4d61-88fd-bfcf0722895b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:33.858279 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-05215463-0d7d-4d61-88fd-bfcf0722895b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:33.863023 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-05215463-0d7d-4d61-88fd-bfcf0722895b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:34.058953 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=18 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:34.078545 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bc76949e-2718-4910-b158-3deb7e16cdbd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:34.093824 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bc76949e-2718-4910-b158-3deb7e16cdbd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1317 microversion: 2.1 time: 0.402967 Jul 12 12:01:34.113341 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1399/2628] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:33 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:34.120763 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-7590012f-a0b3-4a82-814f-8a1e5aee5430 req-c50d502d-5a95-455d-822c-7726e785780c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ecf5a1-c911-4b95-9e61-296a93042f4b", "tag": "9646633f-3d63-4d10-aa22-81ed1fee065e"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:34.136236 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-7590012f-a0b3-4a82-814f-8a1e5aee5430 req-c50d502d-5a95-455d-822c-7726e785780c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:34.137287 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-7590012f-a0b3-4a82-814f-8a1e5aee5430 req-c50d502d-5a95-455d-822c-7726e785780c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:34.162675 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-7590012f-a0b3-4a82-814f-8a1e5aee5430 req-c50d502d-5a95-455d-822c-7726e785780c service nova] Creating event network-changed:9646633f-3d63-4d10-aa22-81ed1fee065e for instance 05ecf5a1-c911-4b95-9e61-296a93042f4b on n-h2-849104-4 Jul 12 12:01:34.173294 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-7590012f-a0b3-4a82-814f-8a1e5aee5430 req-c50d502d-5a95-455d-822c-7726e785780c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058258 Jul 12 12:01:34.174482 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1400/2629] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:34.349630 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-05215463-0d7d-4d61-88fd-bfcf0722895b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:34.366472 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-05215463-0d7d-4d61-88fd-bfcf0722895b tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1317 microversion: 2.1 time: 0.545428 Jul 12 12:01:34.367623 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1230/2630] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:33 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:34.392787 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=7 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:34.397742 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-04aaf8f1-ad47-4bb5-9bbe-87f4afefa854 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:34.398496 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-04aaf8f1-ad47-4bb5-9bbe-87f4afefa854 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:34.426102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04aaf8f1-ad47-4bb5-9bbe-87f4afefa854 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:34.427134 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04aaf8f1-ad47-4bb5-9bbe-87f4afefa854 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:34.428247 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04aaf8f1-ad47-4bb5-9bbe-87f4afefa854 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:34.429054 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-04aaf8f1-ad47-4bb5-9bbe-87f4afefa854 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:34.654971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-04aaf8f1-ad47-4bb5-9bbe-87f4afefa854 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:34.675871 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-04aaf8f1-ad47-4bb5-9bbe-87f4afefa854 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1314 microversion: 2.1 time: 0.287355 Jul 12 12:01:34.677517 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1401/2631] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:34 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:35.115232 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-39a465a3-9551-402a-a3ca-f03a9a7c8522 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:35.116153 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-39a465a3-9551-402a-a3ca-f03a9a7c8522 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:35.118906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=6 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:35.129806 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-39a465a3-9551-402a-a3ca-f03a9a7c8522 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:35.136936 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-39a465a3-9551-402a-a3ca-f03a9a7c8522 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:35.138616 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-39a465a3-9551-402a-a3ca-f03a9a7c8522 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:35.139286 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-39a465a3-9551-402a-a3ca-f03a9a7c8522 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:35.388125 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-004d3d4f-eef3-4b41-bb86-ac60d54fc41d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:35.389017 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-004d3d4f-eef3-4b41-bb86-ac60d54fc41d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:35.412909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-004d3d4f-eef3-4b41-bb86-ac60d54fc41d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:35.413877 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-004d3d4f-eef3-4b41-bb86-ac60d54fc41d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:35.415913 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-004d3d4f-eef3-4b41-bb86-ac60d54fc41d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:35.417091 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-004d3d4f-eef3-4b41-bb86-ac60d54fc41d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:35.826278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-39a465a3-9551-402a-a3ca-f03a9a7c8522 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:35.844684 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-39a465a3-9551-402a-a3ca-f03a9a7c8522 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1317 microversion: 2.1 time: 0.732842 Jul 12 12:01:35.858585 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1231/2632] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:35 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1317 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:35.864893 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2028815e-5b4c-4f89-bcba-a4aba748dfe0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:35.866169 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2028815e-5b4c-4f89-bcba-a4aba748dfe0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:35.883029 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2028815e-5b4c-4f89-bcba-a4aba748dfe0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:35.884856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2028815e-5b4c-4f89-bcba-a4aba748dfe0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:35.885938 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2028815e-5b4c-4f89-bcba-a4aba748dfe0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:35.886391 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2028815e-5b4c-4f89-bcba-a4aba748dfe0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:35.911738 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-004d3d4f-eef3-4b41-bb86-ac60d54fc41d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:35.927028 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-004d3d4f-eef3-4b41-bb86-ac60d54fc41d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1317 microversion: 2.1 time: 0.545252 Jul 12 12:01:35.937173 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1402/2633] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:35 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1317 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:36.204829 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2028815e-5b4c-4f89-bcba-a4aba748dfe0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:36.214543 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2028815e-5b4c-4f89-bcba-a4aba748dfe0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1314 microversion: 2.1 time: 0.356251 Jul 12 12:01:36.216170 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1232/2634] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:35 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:36.880551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-831b50c9-1aff-4ece-9d92-f48f606a69f5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:36.887964 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-831b50c9-1aff-4ece-9d92-f48f606a69f5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:36.908356 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-831b50c9-1aff-4ece-9d92-f48f606a69f5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:36.909109 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-831b50c9-1aff-4ece-9d92-f48f606a69f5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:36.910101 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-831b50c9-1aff-4ece-9d92-f48f606a69f5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:36.912373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-831b50c9-1aff-4ece-9d92-f48f606a69f5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:36.923061 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-73175916", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "c11f1e67-c837-46a3-8b49-fe30b3169d9e"}], "block_device_mapping_v2": [{"uuid": "3a06c5d0-a644-4115-ac01-2a39cfbf8ed7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:37.037784 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] validate_networks() for [('c11f1e67-c837-46a3-8b49-fe30b3169d9e', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 12:01:37.194253 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-831b50c9-1aff-4ece-9d92-f48f606a69f5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:37.217149 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-831b50c9-1aff-4ece-9d92-f48f606a69f5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1507 microversion: 2.1 time: 0.353122 Jul 12 12:01:37.219142 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1403/2635] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:36 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1507 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:37.229271 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-43407268-4396-4966-9793-5993c92977eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:37.232896 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-43407268-4396-4966-9793-5993c92977eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:37.252111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43407268-4396-4966-9793-5993c92977eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:37.252111 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43407268-4396-4966-9793-5993c92977eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:37.253682 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43407268-4396-4966-9793-5993c92977eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:37.255377 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43407268-4396-4966-9793-5993c92977eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:37.593292 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-43407268-4396-4966-9793-5993c92977eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:37.604929 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-43407268-4396-4966-9793-5993c92977eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1317 microversion: 2.1 time: 0.383834 Jul 12 12:01:37.608858 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1404/2636] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:37 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:37.614992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-4feca1b6-d36e-452d-9d35-9b63935e943a req-61179493-141e-4f07-a6ef-7c00d4e0c401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5962be6e-d556-49ee-bc2f-8132b8a1ffc5", "name": "network-vif-plugged", "status": "completed", "tag": "3481c369-0810-4ae0-8594-04e0ea8df9e6"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:37.625068 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-4feca1b6-d36e-452d-9d35-9b63935e943a req-61179493-141e-4f07-a6ef-7c00d4e0c401 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:37.625822 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-4feca1b6-d36e-452d-9d35-9b63935e943a req-61179493-141e-4f07-a6ef-7c00d4e0c401 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:37.639920 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-4feca1b6-d36e-452d-9d35-9b63935e943a req-61179493-141e-4f07-a6ef-7c00d4e0c401 service nova] Creating event network-vif-plugged:3481c369-0810-4ae0-8594-04e0ea8df9e6 for instance 5962be6e-d556-49ee-bc2f-8132b8a1ffc5 on n-h1-849104-4 Jul 12 12:01:37.646431 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-4feca1b6-d36e-452d-9d35-9b63935e943a req-61179493-141e-4f07-a6ef-7c00d4e0c401 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035810 Jul 12 12:01:37.647050 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1405/2637] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:37.669622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0de68fa7-1deb-493f-9278-46a70413cdf2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:37.670800 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0de68fa7-1deb-493f-9278-46a70413cdf2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:37.701315 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0de68fa7-1deb-493f-9278-46a70413cdf2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:37.701911 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0de68fa7-1deb-493f-9278-46a70413cdf2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:37.702821 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0de68fa7-1deb-493f-9278-46a70413cdf2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:37.703374 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0de68fa7-1deb-493f-9278-46a70413cdf2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:38.121728 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0de68fa7-1deb-493f-9278-46a70413cdf2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:38.134856 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0de68fa7-1deb-493f-9278-46a70413cdf2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1507 microversion: 2.1 time: 0.485961 Jul 12 12:01:38.136257 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1406/2638] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:37 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:38.145044 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-88d9a531-1e77-4649-bdb7-18317f81fb71 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:38.146340 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-88d9a531-1e77-4649-bdb7-18317f81fb71 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:38.155659 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-88d9a531-1e77-4649-bdb7-18317f81fb71 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:38.156156 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-88d9a531-1e77-4649-bdb7-18317f81fb71 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:38.161637 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-88d9a531-1e77-4649-bdb7-18317f81fb71 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:38.164936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-88d9a531-1e77-4649-bdb7-18317f81fb71 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:38.274032 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:01:38.275065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:01:38.275750 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:01:38.276682 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:01:38.277456 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:01:38.300188 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:38.300988 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:38.303642 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:38.304720 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:38.354691 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Getting quotas for project 29fd5f6c853549a794c75ebff736ccf4. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:01:38.362698 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Getting quotas for user ae0b32f84b7146d49338e7a2c06bc579 and project 29fd5f6c853549a794c75ebff736ccf4. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:01:38.423536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-88d9a531-1e77-4649-bdb7-18317f81fb71 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:38.433402 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-88d9a531-1e77-4649-bdb7-18317f81fb71 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1314 microversion: 2.1 time: 0.295859 Jul 12 12:01:38.434860 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1407/2639] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:38 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:38.449462 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "OS-DCF:diskConfig": "AUTO"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:38.466552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:38.474185 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:38.475119 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:38.476667 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:38.477797 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:38.486629 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 12:01:38.488756 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3a06c5d0-a644-4115-ac01-2a39cfbf8ed7',volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:01:38.621194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:01:38.621786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:01:38.622137 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:01:38.622546 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:01:38.625792 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:01:38.728567 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:38.739120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:38.739698 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:38.740831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:38.741867 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:38.778001 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a59a2c77-ba0a-4864-accc-ff596f40a229 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "POST /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee/action" status: 202 len: 1109 microversion: 2.1 time: 0.332640 Jul 12 12:01:38.780012 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1408/2640] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 12:01:38 2022] POST /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee/action => generated 1109 bytes in 345 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 12 12:01:38.802295 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5f10af37-0e77-4a81-893c-4679c923f729 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:38.803935 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5f10af37-0e77-4a81-893c-4679c923f729 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:38.819206 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f10af37-0e77-4a81-893c-4679c923f729 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:38.820927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f10af37-0e77-4a81-893c-4679c923f729 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:38.822534 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f10af37-0e77-4a81-893c-4679c923f729 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:38.823552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5f10af37-0e77-4a81-893c-4679c923f729 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:38.876789 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cb3bcb09-4264-4e7b-8f41-9993d5ba249d tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.964059 Jul 12 12:01:38.881594 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1233/2641] 10.222.0.50 () {62 vars in 1187 bytes} [Tue Jul 12 12:01:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 12 12:01:38.901979 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0e7e0ead-1125-4908-9097-434ab1c99957 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:38.904195 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0e7e0ead-1125-4908-9097-434ab1c99957 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:38.924245 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0e7e0ead-1125-4908-9097-434ab1c99957 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:38.925440 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0e7e0ead-1125-4908-9097-434ab1c99957 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:38.927004 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0e7e0ead-1125-4908-9097-434ab1c99957 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:38.928017 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0e7e0ead-1125-4908-9097-434ab1c99957 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:39.120300 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5f10af37-0e77-4a81-893c-4679c923f729 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:39.133080 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5f10af37-0e77-4a81-893c-4679c923f729 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1317 microversion: 2.1 time: 0.337963 Jul 12 12:01:39.134687 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1409/2642] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:38 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:39.150201 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d1ab10d8-c872-427f-8292-388625186a22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:39.151153 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d1ab10d8-c872-427f-8292-388625186a22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:39.269876 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d1ab10d8-c872-427f-8292-388625186a22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:39.284957 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d1ab10d8-c872-427f-8292-388625186a22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:39.290019 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d1ab10d8-c872-427f-8292-388625186a22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:39.295116 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d1ab10d8-c872-427f-8292-388625186a22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1102 microversion: 2.25 time: 0.146760 Jul 12 12:01:39.297102 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1410/2643] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:39 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1102 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:39.462266 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9bea8426-0169-45a2-8bb8-785d535b4fda tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:39.463072 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9bea8426-0169-45a2-8bb8-785d535b4fda tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:39.473830 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9bea8426-0169-45a2-8bb8-785d535b4fda tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:39.473830 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9bea8426-0169-45a2-8bb8-785d535b4fda tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:39.474790 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9bea8426-0169-45a2-8bb8-785d535b4fda tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:39.488619 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9bea8426-0169-45a2-8bb8-785d535b4fda tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:39.554878 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0e7e0ead-1125-4908-9097-434ab1c99957 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:39.571683 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0e7e0ead-1125-4908-9097-434ab1c99957 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.687607 Jul 12 12:01:39.576839 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1234/2644] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:38 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:39.673891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9bea8426-0169-45a2-8bb8-785d535b4fda tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:39.683798 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9bea8426-0169-45a2-8bb8-785d535b4fda tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1314 microversion: 2.1 time: 0.235798 Jul 12 12:01:39.685042 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1411/2645] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:39 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:40.040933 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-a714eedc-8e02-4b76-9b06-d6ba1983dcf5 req-62ac0d9e-1451-4786-8213-3f3b379325dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e6138b-cb03-4d22-85cb-648fc991cd77", "name": "network-vif-plugged", "status": "completed", "tag": "96e36a3f-9966-4f6e-b737-3fa8ad4f51d2"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:40.052581 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-a714eedc-8e02-4b76-9b06-d6ba1983dcf5 req-62ac0d9e-1451-4786-8213-3f3b379325dd service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:40.053566 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-a714eedc-8e02-4b76-9b06-d6ba1983dcf5 req-62ac0d9e-1451-4786-8213-3f3b379325dd service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:40.093210 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-a714eedc-8e02-4b76-9b06-d6ba1983dcf5 req-62ac0d9e-1451-4786-8213-3f3b379325dd service nova] Creating event network-vif-plugged:96e36a3f-9966-4f6e-b737-3fa8ad4f51d2 for instance f6e6138b-cb03-4d22-85cb-648fc991cd77 on n-h1-849104-4 Jul 12 12:01:40.104758 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-a714eedc-8e02-4b76-9b06-d6ba1983dcf5 req-62ac0d9e-1451-4786-8213-3f3b379325dd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067560 Jul 12 12:01:40.105662 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1235/2646] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:40.152460 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2eb6f932-925c-4cea-b830-3f57cfd91090 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:40.153663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2eb6f932-925c-4cea-b830-3f57cfd91090 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:40.165234 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2eb6f932-925c-4cea-b830-3f57cfd91090 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:40.175685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2eb6f932-925c-4cea-b830-3f57cfd91090 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:40.177036 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2eb6f932-925c-4cea-b830-3f57cfd91090 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:40.177551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2eb6f932-925c-4cea-b830-3f57cfd91090 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:40.322864 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d85897d2-410c-4523-8069-e13252087ca1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:40.330453 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d85897d2-410c-4523-8069-e13252087ca1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:40.354199 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d85897d2-410c-4523-8069-e13252087ca1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:40.354915 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d85897d2-410c-4523-8069-e13252087ca1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:40.356345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d85897d2-410c-4523-8069-e13252087ca1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:40.358843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d85897d2-410c-4523-8069-e13252087ca1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:40.606975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2eb6f932-925c-4cea-b830-3f57cfd91090 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:40.634245 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2eb6f932-925c-4cea-b830-3f57cfd91090 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1317 microversion: 2.1 time: 0.485758 Jul 12 12:01:40.645656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d85897d2-410c-4523-8069-e13252087ca1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:40.651930 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1412/2647] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:40 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:40.660847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-af9dbd32-f376-49c7-aaaf-dc9b16577efe tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:40.661672 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-af9dbd32-f376-49c7-aaaf-dc9b16577efe tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:40.671783 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d85897d2-410c-4523-8069-e13252087ca1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:40.672485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af9dbd32-f376-49c7-aaaf-dc9b16577efe tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:40.673253 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af9dbd32-f376-49c7-aaaf-dc9b16577efe tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:40.673854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d85897d2-410c-4523-8069-e13252087ca1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:40.674844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af9dbd32-f376-49c7-aaaf-dc9b16577efe tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:40.675179 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d85897d2-410c-4523-8069-e13252087ca1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1231 microversion: 2.25 time: 0.359579 Jul 12 12:01:40.675616 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-af9dbd32-f376-49c7-aaaf-dc9b16577efe tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:40.675837 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1236/2648] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:40 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1231 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:01:40.703967 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c2162861-7777-4cb8-8fef-fd6170055893 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:40.704656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c2162861-7777-4cb8-8fef-fd6170055893 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:40.725120 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2162861-7777-4cb8-8fef-fd6170055893 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:40.725793 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2162861-7777-4cb8-8fef-fd6170055893 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:40.726680 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2162861-7777-4cb8-8fef-fd6170055893 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:40.727351 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2162861-7777-4cb8-8fef-fd6170055893 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:40.943999 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-af9dbd32-f376-49c7-aaaf-dc9b16577efe tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:40.957548 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-af9dbd32-f376-49c7-aaaf-dc9b16577efe tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.303062 Jul 12 12:01:40.958132 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1413/2649] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:40 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:41.061092 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c2162861-7777-4cb8-8fef-fd6170055893 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:41.080524 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c2162861-7777-4cb8-8fef-fd6170055893 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1314 microversion: 2.1 time: 0.380895 Jul 12 12:01:41.083158 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1237/2650] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:40 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:41.654996 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-454f58b1-74b9-45fb-b6c0-94d981abd29e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:41.656500 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-454f58b1-74b9-45fb-b6c0-94d981abd29e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:41.671417 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-454f58b1-74b9-45fb-b6c0-94d981abd29e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:41.680908 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-454f58b1-74b9-45fb-b6c0-94d981abd29e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:41.682061 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-454f58b1-74b9-45fb-b6c0-94d981abd29e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:41.682976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-454f58b1-74b9-45fb-b6c0-94d981abd29e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:41.698106 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d7d54bcc-4e4d-41d3-b00b-e631d4c88861 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:41.699343 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d7d54bcc-4e4d-41d3-b00b-e631d4c88861 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:41.722179 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7d54bcc-4e4d-41d3-b00b-e631d4c88861 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:41.722820 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7d54bcc-4e4d-41d3-b00b-e631d4c88861 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:41.723734 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7d54bcc-4e4d-41d3-b00b-e631d4c88861 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:41.724622 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7d54bcc-4e4d-41d3-b00b-e631d4c88861 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:42.033068 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-454f58b1-74b9-45fb-b6c0-94d981abd29e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:42.042045 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-454f58b1-74b9-45fb-b6c0-94d981abd29e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1317 microversion: 2.1 time: 0.391597 Jul 12 12:01:42.042813 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1414/2651] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:41 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:42.073884 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-49d76560-0306-4055-8d33-6532e47e7966 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:42.078120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-49d76560-0306-4055-8d33-6532e47e7966 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:42.088246 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-49d76560-0306-4055-8d33-6532e47e7966 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:42.089300 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-49d76560-0306-4055-8d33-6532e47e7966 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:42.091624 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-49d76560-0306-4055-8d33-6532e47e7966 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:42.092967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-49d76560-0306-4055-8d33-6532e47e7966 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:42.108836 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:42.446820 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-49d76560-0306-4055-8d33-6532e47e7966 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:42.458990 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d7d54bcc-4e4d-41d3-b00b-e631d4c88861 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:42.484614 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-49d76560-0306-4055-8d33-6532e47e7966 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.429102 Jul 12 12:01:42.487263 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d7d54bcc-4e4d-41d3-b00b-e631d4c88861 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:42.488820 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1415/2652] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:42 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:42.508750 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d7d54bcc-4e4d-41d3-b00b-e631d4c88861 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:42.516483 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d7d54bcc-4e4d-41d3-b00b-e631d4c88861 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1291 microversion: 2.25 time: 0.819051 Jul 12 12:01:42.517335 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1238/2653] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:41 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1291 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:42.519880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5d754c9d-baef-47c1-894d-a60faf94cb7c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:42.520915 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5d754c9d-baef-47c1-894d-a60faf94cb7c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:42.579989 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5d754c9d-baef-47c1-894d-a60faf94cb7c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:42.580824 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5d754c9d-baef-47c1-894d-a60faf94cb7c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:42.595438 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5d754c9d-baef-47c1-894d-a60faf94cb7c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:42.596166 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5d754c9d-baef-47c1-894d-a60faf94cb7c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:42.962887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5d754c9d-baef-47c1-894d-a60faf94cb7c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:42.978111 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5d754c9d-baef-47c1-894d-a60faf94cb7c tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1500 microversion: 2.1 time: 0.487393 Jul 12 12:01:42.978718 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1416/2654] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:42 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1500 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:42.987570 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-a6b54dd0-e5d4-4ffd-80bf-9fb5e91d5e06 req-3ec45978-2989-4768-909f-f144235eb7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ecf5a1-c911-4b95-9e61-296a93042f4b", "name": "network-vif-plugged", "status": "completed", "tag": "9646633f-3d63-4d10-aa22-81ed1fee065e"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:43.008113 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-a6b54dd0-e5d4-4ffd-80bf-9fb5e91d5e06 req-3ec45978-2989-4768-909f-f144235eb7b9 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:43.013442 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-a6b54dd0-e5d4-4ffd-80bf-9fb5e91d5e06 req-3ec45978-2989-4768-909f-f144235eb7b9 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:43.042795 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-a6b54dd0-e5d4-4ffd-80bf-9fb5e91d5e06 req-3ec45978-2989-4768-909f-f144235eb7b9 service nova] Creating event network-vif-plugged:9646633f-3d63-4d10-aa22-81ed1fee065e for instance 05ecf5a1-c911-4b95-9e61-296a93042f4b on n-h2-849104-4 Jul 12 12:01:43.051888 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-a6b54dd0-e5d4-4ffd-80bf-9fb5e91d5e06 req-3ec45978-2989-4768-909f-f144235eb7b9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068974 Jul 12 12:01:43.061199 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1417/2655] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:43.076136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d0a4b298-d798-48db-b454-9a2465b1b8a2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:43.078216 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d0a4b298-d798-48db-b454-9a2465b1b8a2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:43.089503 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0a4b298-d798-48db-b454-9a2465b1b8a2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:43.090441 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0a4b298-d798-48db-b454-9a2465b1b8a2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:43.092485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0a4b298-d798-48db-b454-9a2465b1b8a2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:43.093581 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d0a4b298-d798-48db-b454-9a2465b1b8a2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:43.159206 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-d0a4b298-d798-48db-b454-9a2465b1b8a2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lazy-loading 'flavor' on Instance uuid f6e6138b-cb03-4d22-85cb-648fc991cd77 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:01:43.181622 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1963519940", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "5495b5de-14ae-442a-bf1f-dcd088cd7e1e"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:43.296544 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] validate_networks() for [('5495b5de-14ae-442a-bf1f-dcd088cd7e1e', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 12:01:43.353900 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d0a4b298-d798-48db-b454-9a2465b1b8a2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "POST /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77/action" status: 200 len: 32 microversion: 2.1 time: 0.290560 Jul 12 12:01:43.355111 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1418/2656] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 12:01:43 2022] POST /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77/action => generated 32 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 12:01:43.389779 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-48e8f864-64ce-4a00-831d-e36515159c3d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:43.395322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-48e8f864-64ce-4a00-831d-e36515159c3d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:43.441189 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-48e8f864-64ce-4a00-831d-e36515159c3d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:43.441898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-48e8f864-64ce-4a00-831d-e36515159c3d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:43.468125 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-48e8f864-64ce-4a00-831d-e36515159c3d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:43.469127 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-48e8f864-64ce-4a00-831d-e36515159c3d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:43.880399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-48e8f864-64ce-4a00-831d-e36515159c3d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:43.889888 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-48e8f864-64ce-4a00-831d-e36515159c3d tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1317 microversion: 2.1 time: 0.533143 Jul 12 12:01:43.901806 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1419/2657] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:43 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:43.907717 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-72ca0b64-d35c-4004-94c4-7f966043b09d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:43.908633 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-72ca0b64-d35c-4004-94c4-7f966043b09d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:43.915685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-72ca0b64-d35c-4004-94c4-7f966043b09d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:43.916447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-72ca0b64-d35c-4004-94c4-7f966043b09d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:43.917416 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-72ca0b64-d35c-4004-94c4-7f966043b09d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:43.918024 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-72ca0b64-d35c-4004-94c4-7f966043b09d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:44.256552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-72ca0b64-d35c-4004-94c4-7f966043b09d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:44.282272 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-72ca0b64-d35c-4004-94c4-7f966043b09d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.378801 Jul 12 12:01:44.289280 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1420/2658] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:43 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:44.297750 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bc9b8857-83e1-4c27-8317-32cf79fcddb2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:44.299305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bc9b8857-83e1-4c27-8317-32cf79fcddb2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:44.309224 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc9b8857-83e1-4c27-8317-32cf79fcddb2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:44.310422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc9b8857-83e1-4c27-8317-32cf79fcddb2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:44.311625 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc9b8857-83e1-4c27-8317-32cf79fcddb2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:44.312345 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bc9b8857-83e1-4c27-8317-32cf79fcddb2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:44.875313 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bc9b8857-83e1-4c27-8317-32cf79fcddb2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:44.905181 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bc9b8857-83e1-4c27-8317-32cf79fcddb2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.613930 Jul 12 12:01:44.910293 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1421/2659] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:44 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:44.931388 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6d7bd761-1c3a-4ee0-932a-45096944d5fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:44.932533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6d7bd761-1c3a-4ee0-932a-45096944d5fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:44.968319 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d7bd761-1c3a-4ee0-932a-45096944d5fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:44.972355 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d7bd761-1c3a-4ee0-932a-45096944d5fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:44.979052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d7bd761-1c3a-4ee0-932a-45096944d5fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:44.982553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6d7bd761-1c3a-4ee0-932a-45096944d5fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:45.003430 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:01:45.005626 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:01:45.006755 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:01:45.007876 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:01:45.008911 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:01:45.062557 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:45.063416 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:45.065016 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:45.069207 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:45.170884 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Getting quotas for project f630a8015def485db0ac46681a162960. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:01:45.191038 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Getting quotas for user f0c8a66c40024ed4b583cf187350a9e0 and project f630a8015def485db0ac46681a162960. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:01:45.203269 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:45.237942 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Going to run 3 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 12:01:45.241324 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: deab1788-4378-44fc-8c70-3f3e04bf5e35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:01:45.305284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 21a370a2-ee60-46d7-8b18-3f5bf976e8bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=deab1788-4378-44fc-8c70-3f3e04bf5e35,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:01:45.417134 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6d7bd761-1c3a-4ee0-932a-45096944d5fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:45.428022 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=21a370a2-ee60-46d7-8b18-3f5bf976e8bc,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:01:45.446317 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6d7bd761-1c3a-4ee0-932a-45096944d5fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:45.447932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6d7bd761-1c3a-4ee0-932a-45096944d5fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:45.453901 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6d7bd761-1c3a-4ee0-932a-45096944d5fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1291 microversion: 2.25 time: 0.538980 Jul 12 12:01:45.465318 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1422/2660] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:44 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1291 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:45.471242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-09287084-7621-4400-afde-806e71fe24ad tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:45.471868 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-09287084-7621-4400-afde-806e71fe24ad tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:45.487915 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-09287084-7621-4400-afde-806e71fe24ad tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:45.488412 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-09287084-7621-4400-afde-806e71fe24ad tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:45.489210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-09287084-7621-4400-afde-806e71fe24ad tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:45.490096 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-09287084-7621-4400-afde-806e71fe24ad tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:45.594274 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-55b13951-e450-4c3e-9666-c52e56b0c319 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.750124 Jul 12 12:01:45.600319 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1239/2661] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 12:01:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 12:01:45.605321 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-18c6c099-8179-4827-aeb2-a69aa572e733 req-a7fb6b49-1985-4080-8d3c-61b2b990b13c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6834c01a-284c-47fc-8939-403833f0ebd8", "tag": "5ac103df-1ff9-40af-8256-5349b52e1acc"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:45.617737 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-18c6c099-8179-4827-aeb2-a69aa572e733 req-a7fb6b49-1985-4080-8d3c-61b2b990b13c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:45.618757 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-18c6c099-8179-4827-aeb2-a69aa572e733 req-a7fb6b49-1985-4080-8d3c-61b2b990b13c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:45.638792 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-18c6c099-8179-4827-aeb2-a69aa572e733 req-a7fb6b49-1985-4080-8d3c-61b2b990b13c service nova] Creating event network-changed:5ac103df-1ff9-40af-8256-5349b52e1acc for instance 6834c01a-284c-47fc-8939-403833f0ebd8 on n-h1-849104-4 Jul 12 12:01:45.644702 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-18c6c099-8179-4827-aeb2-a69aa572e733 req-a7fb6b49-1985-4080-8d3c-61b2b990b13c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043026 Jul 12 12:01:45.645900 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1240/2662] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:45.653557 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1c017752-41c9-41c0-8e86-770ff961a1b0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:45.654500 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1c017752-41c9-41c0-8e86-770ff961a1b0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:45.664444 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1c017752-41c9-41c0-8e86-770ff961a1b0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:45.665076 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1c017752-41c9-41c0-8e86-770ff961a1b0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:45.666316 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1c017752-41c9-41c0-8e86-770ff961a1b0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:45.666920 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1c017752-41c9-41c0-8e86-770ff961a1b0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:45.803698 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-09287084-7621-4400-afde-806e71fe24ad tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:45.817313 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-09287084-7621-4400-afde-806e71fe24ad tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 200 len: 1505 microversion: 2.1 time: 0.358222 Jul 12 12:01:45.818220 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1423/2663] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:45 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:45.823777 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bb399b91-515e-4d5a-abaf-161a96f23c97 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:45.835612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bb399b91-515e-4d5a-abaf-161a96f23c97 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:45.836520 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bb399b91-515e-4d5a-abaf-161a96f23c97 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Searching by: {'deleted': False, 'project_id': 'f630a8015def485db0ac46681a162960'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:01:45.885932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bb399b91-515e-4d5a-abaf-161a96f23c97 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:45.886398 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bb399b91-515e-4d5a-abaf-161a96f23c97 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:45.892685 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bb399b91-515e-4d5a-abaf-161a96f23c97 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:45.893780 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bb399b91-515e-4d5a-abaf-161a96f23c97 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:45.941455 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bb399b91-515e-4d5a-abaf-161a96f23c97 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.122143 Jul 12 12:01:45.942060 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1424/2664] 10.222.0.50 () {58 vars in 1124 bytes} [Tue Jul 12 12:01:45 2022] GET /compute/v2.1/servers => generated 1018 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:45.970213 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-da53fe4c-72c3-49f2-89bf-af5ecb3db2b5 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:45.973277 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-da53fe4c-72c3-49f2-89bf-af5ecb3db2b5 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 5962be6e-d556-49ee-bc2f-8132b8a1ffc5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:45.988627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da53fe4c-72c3-49f2-89bf-af5ecb3db2b5 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:45.992671 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da53fe4c-72c3-49f2-89bf-af5ecb3db2b5 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:45.993719 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da53fe4c-72c3-49f2-89bf-af5ecb3db2b5 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:45.996552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-da53fe4c-72c3-49f2-89bf-af5ecb3db2b5 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:46.209128 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1c017752-41c9-41c0-8e86-770ff961a1b0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:46.224451 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1c017752-41c9-41c0-8e86-770ff961a1b0 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.576995 Jul 12 12:01:46.225054 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1241/2665] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:45 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:46.254264 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-16766f32-b55d-4ca0-80df-e75e52d5becf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:46.255114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-16766f32-b55d-4ca0-80df-e75e52d5becf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:46.279148 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16766f32-b55d-4ca0-80df-e75e52d5becf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:46.279940 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16766f32-b55d-4ca0-80df-e75e52d5becf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:46.294595 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16766f32-b55d-4ca0-80df-e75e52d5becf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:46.297141 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16766f32-b55d-4ca0-80df-e75e52d5becf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:46.318597 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-da53fe4c-72c3-49f2-89bf-af5ecb3db2b5 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:46.330276 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-da53fe4c-72c3-49f2-89bf-af5ecb3db2b5 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5" status: 200 len: 1506 microversion: 2.1 time: 0.367944 Jul 12 12:01:46.332928 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1425/2666] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:45 2022] GET /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5 => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:46.369435 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-65ac1ebe-5bce-4978-b9e2-2e1134593a07 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:46.372297 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-65ac1ebe-5bce-4978-b9e2-2e1134593a07 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:46.517450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-65ac1ebe-5bce-4978-b9e2-2e1134593a07 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:46.527364 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-65ac1ebe-5bce-4978-b9e2-2e1134593a07 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1223 microversion: 2.1 time: 0.177496 Jul 12 12:01:46.528084 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1426/2667] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:46 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1223 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:46.558644 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-76afd46f-abe6-4ae7-897b-dde6840d17a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:46.565471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-76afd46f-abe6-4ae7-897b-dde6840d17a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 5962be6e-d556-49ee-bc2f-8132b8a1ffc5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:46.576428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76afd46f-abe6-4ae7-897b-dde6840d17a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:46.577864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76afd46f-abe6-4ae7-897b-dde6840d17a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:46.581038 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76afd46f-abe6-4ae7-897b-dde6840d17a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:46.581994 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-76afd46f-abe6-4ae7-897b-dde6840d17a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:46.645541 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-76afd46f-abe6-4ae7-897b-dde6840d17a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 5962be6e-d556-49ee-bc2f-8132b8a1ffc5] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:01:46.653321 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-16766f32-b55d-4ca0-80df-e75e52d5becf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:46.661558 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-16766f32-b55d-4ca0-80df-e75e52d5becf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.435426 Jul 12 12:01:46.673308 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1242/2668] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:46 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:46.682303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d37d5c8f-f589-4f89-8775-a27f14f2de3a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:46.684004 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d37d5c8f-f589-4f89-8775-a27f14f2de3a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:46.692769 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d37d5c8f-f589-4f89-8775-a27f14f2de3a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:46.693881 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d37d5c8f-f589-4f89-8775-a27f14f2de3a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:46.695091 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d37d5c8f-f589-4f89-8775-a27f14f2de3a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:46.697406 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d37d5c8f-f589-4f89-8775-a27f14f2de3a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:46.804410 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-76afd46f-abe6-4ae7-897b-dde6840d17a7 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5" status: 204 len: 0 microversion: 2.1 time: 0.265678 Jul 12 12:01:46.805346 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1427/2669] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:01:46 2022] DELETE /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:01:46.817211 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-26509d6f-52d9-4c1d-960b-1645f69ac6eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:46.818256 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-26509d6f-52d9-4c1d-960b-1645f69ac6eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:46.827448 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26509d6f-52d9-4c1d-960b-1645f69ac6eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:46.828230 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26509d6f-52d9-4c1d-960b-1645f69ac6eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:46.829278 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26509d6f-52d9-4c1d-960b-1645f69ac6eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:46.829927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-26509d6f-52d9-4c1d-960b-1645f69ac6eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:46.862576 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-26509d6f-52d9-4c1d-960b-1645f69ac6eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:01:46.965201 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:47.026854 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-26509d6f-52d9-4c1d-960b-1645f69ac6eb tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "DELETE /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 204 len: 0 microversion: 2.1 time: 0.215904 Jul 12 12:01:47.029722 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1428/2670] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:01:46 2022] DELETE /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:01:47.048694 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9f3f8c10-6b1f-423a-ad9c-6369cc4e45c4 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:47.050959 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9f3f8c10-6b1f-423a-ad9c-6369cc4e45c4 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 5962be6e-d556-49ee-bc2f-8132b8a1ffc5] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:47.068336 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9f3f8c10-6b1f-423a-ad9c-6369cc4e45c4 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:47.069099 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9f3f8c10-6b1f-423a-ad9c-6369cc4e45c4 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:47.070442 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9f3f8c10-6b1f-423a-ad9c-6369cc4e45c4 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:47.071972 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9f3f8c10-6b1f-423a-ad9c-6369cc4e45c4 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:47.116710 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d37d5c8f-f589-4f89-8775-a27f14f2de3a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:47.127575 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d37d5c8f-f589-4f89-8775-a27f14f2de3a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:47.129411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d37d5c8f-f589-4f89-8775-a27f14f2de3a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:47.130818 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d37d5c8f-f589-4f89-8775-a27f14f2de3a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1291 microversion: 2.25 time: 0.456101 Jul 12 12:01:47.131986 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1243/2671] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:46 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1291 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:47.243626 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a35163fb-4f5d-46c0-8619-f90028c6f1da tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:47.244626 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a35163fb-4f5d-46c0-8619-f90028c6f1da tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:47.263427 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a35163fb-4f5d-46c0-8619-f90028c6f1da tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:47.264343 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a35163fb-4f5d-46c0-8619-f90028c6f1da tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:47.266335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a35163fb-4f5d-46c0-8619-f90028c6f1da tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:47.267338 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a35163fb-4f5d-46c0-8619-f90028c6f1da tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:47.335983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9f3f8c10-6b1f-423a-ad9c-6369cc4e45c4 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:47.346359 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9f3f8c10-6b1f-423a-ad9c-6369cc4e45c4 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5" status: 200 len: 1512 microversion: 2.1 time: 0.311384 Jul 12 12:01:47.346971 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1429/2672] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:47 2022] GET /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5 => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:47.508378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a35163fb-4f5d-46c0-8619-f90028c6f1da tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:47.517636 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a35163fb-4f5d-46c0-8619-f90028c6f1da tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.278850 Jul 12 12:01:47.518222 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1244/2673] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:47 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:47.546770 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-542b6cc4-16aa-4412-879e-7d33388c49a4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:47.548874 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-542b6cc4-16aa-4412-879e-7d33388c49a4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:47.559895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-542b6cc4-16aa-4412-879e-7d33388c49a4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:47.560406 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-542b6cc4-16aa-4412-879e-7d33388c49a4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:47.561772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-542b6cc4-16aa-4412-879e-7d33388c49a4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:47.562566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-542b6cc4-16aa-4412-879e-7d33388c49a4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:47.660311 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-542b6cc4-16aa-4412-879e-7d33388c49a4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:47.675772 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-542b6cc4-16aa-4412-879e-7d33388c49a4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1227 microversion: 2.1 time: 0.131767 Jul 12 12:01:47.675772 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1430/2674] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:47 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1227 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:47.692317 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0b23b1ea-eb07-4a77-b987-d8641499ea1d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:47.694031 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0b23b1ea-eb07-4a77-b987-d8641499ea1d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:47.707501 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0b23b1ea-eb07-4a77-b987-d8641499ea1d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:47.708692 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0b23b1ea-eb07-4a77-b987-d8641499ea1d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:47.709744 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0b23b1ea-eb07-4a77-b987-d8641499ea1d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:47.712500 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0b23b1ea-eb07-4a77-b987-d8641499ea1d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:47.950892 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0b23b1ea-eb07-4a77-b987-d8641499ea1d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:47.980109 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0b23b1ea-eb07-4a77-b987-d8641499ea1d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.298798 Jul 12 12:01:47.982268 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1245/2675] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:47 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:48.158918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9b6cb14d-a209-4594-b7bd-b77ebd63f379 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:48.164349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9b6cb14d-a209-4594-b7bd-b77ebd63f379 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:48.227019 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9b6cb14d-a209-4594-b7bd-b77ebd63f379 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:48.232739 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9b6cb14d-a209-4594-b7bd-b77ebd63f379 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:48.233690 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9b6cb14d-a209-4594-b7bd-b77ebd63f379 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:48.234527 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9b6cb14d-a209-4594-b7bd-b77ebd63f379 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:48.381944 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-245bb1ea-56fd-44a6-bff3-fc51498b8f6e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:48.383148 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-245bb1ea-56fd-44a6-bff3-fc51498b8f6e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 5962be6e-d556-49ee-bc2f-8132b8a1ffc5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:48.467792 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-245bb1ea-56fd-44a6-bff3-fc51498b8f6e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:48.470767 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-245bb1ea-56fd-44a6-bff3-fc51498b8f6e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:48.480188 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-245bb1ea-56fd-44a6-bff3-fc51498b8f6e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:48.487092 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-245bb1ea-56fd-44a6-bff3-fc51498b8f6e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:48.581219 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:48.970369 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-245bb1ea-56fd-44a6-bff3-fc51498b8f6e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:48.996394 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-245bb1ea-56fd-44a6-bff3-fc51498b8f6e tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5" status: 200 len: 1512 microversion: 2.1 time: 0.628316 Jul 12 12:01:48.996996 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1246/2676] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:48 2022] GET /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5 => generated 1512 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:49.003786 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-85f3d6e4-ed6d-4ca2-9db0-0634b3f14fc4 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:49.013485 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-85f3d6e4-ed6d-4ca2-9db0-0634b3f14fc4 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:49.029708 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-85f3d6e4-ed6d-4ca2-9db0-0634b3f14fc4 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:49.030390 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-85f3d6e4-ed6d-4ca2-9db0-0634b3f14fc4 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:49.038606 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-85f3d6e4-ed6d-4ca2-9db0-0634b3f14fc4 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:49.039653 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-85f3d6e4-ed6d-4ca2-9db0-0634b3f14fc4 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:49.055225 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9b6cb14d-a209-4594-b7bd-b77ebd63f379 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:49.065084 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9b6cb14d-a209-4594-b7bd-b77ebd63f379 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:49.070688 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9b6cb14d-a209-4594-b7bd-b77ebd63f379 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:49.077547 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9b6cb14d-a209-4594-b7bd-b77ebd63f379 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1291 microversion: 2.25 time: 0.930568 Jul 12 12:01:49.078426 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1431/2677] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:48 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1291 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:49.086462 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d6945234-8c5a-4e1e-a38a-ed1500f209ba tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:49.116989 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d6945234-8c5a-4e1e-a38a-ed1500f209ba tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:49.125215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:49.177670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6945234-8c5a-4e1e-a38a-ed1500f209ba tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:49.183409 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6945234-8c5a-4e1e-a38a-ed1500f209ba tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:49.189848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6945234-8c5a-4e1e-a38a-ed1500f209ba tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:49.193267 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d6945234-8c5a-4e1e-a38a-ed1500f209ba tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:49.410413 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d6945234-8c5a-4e1e-a38a-ed1500f209ba tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:49.422258 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d6945234-8c5a-4e1e-a38a-ed1500f209ba tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1275 microversion: 2.1 time: 0.342427 Jul 12 12:01:49.432409 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1432/2678] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:49 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1275 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:49.442408 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6c06b082-8e08-45b4-81b4-29f851499099 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:49.443314 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6c06b082-8e08-45b4-81b4-29f851499099 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:49.478472 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c06b082-8e08-45b4-81b4-29f851499099 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:49.484251 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c06b082-8e08-45b4-81b4-29f851499099 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:49.485999 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c06b082-8e08-45b4-81b4-29f851499099 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:49.493085 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6c06b082-8e08-45b4-81b4-29f851499099 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:49.960210 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-85f3d6e4-ed6d-4ca2-9db0-0634b3f14fc4 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:49.983290 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-85f3d6e4-ed6d-4ca2-9db0-0634b3f14fc4 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.984846 Jul 12 12:01:49.984487 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1247/2679] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:48 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:50.014843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7c36d7ec-63ab-4629-a4e6-e7c93d8d0391 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:50.015635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7c36d7ec-63ab-4629-a4e6-e7c93d8d0391 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 5962be6e-d556-49ee-bc2f-8132b8a1ffc5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:50.026183 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c36d7ec-63ab-4629-a4e6-e7c93d8d0391 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:50.032621 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c36d7ec-63ab-4629-a4e6-e7c93d8d0391 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:50.039433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c36d7ec-63ab-4629-a4e6-e7c93d8d0391 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:50.041697 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7c36d7ec-63ab-4629-a4e6-e7c93d8d0391 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:50.546690 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6c06b082-8e08-45b4-81b4-29f851499099 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:50.570288 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6c06b082-8e08-45b4-81b4-29f851499099 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 1.135574 Jul 12 12:01:50.580792 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1433/2680] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:49 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:50.599056 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fb46af50-d12e-445f-9341-9d43943f58ff tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:50.601362 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fb46af50-d12e-445f-9341-9d43943f58ff tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:50.629846 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb46af50-d12e-445f-9341-9d43943f58ff tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:50.630690 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb46af50-d12e-445f-9341-9d43943f58ff tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:50.632146 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb46af50-d12e-445f-9341-9d43943f58ff tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:50.633238 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb46af50-d12e-445f-9341-9d43943f58ff tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:50.734336 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7c36d7ec-63ab-4629-a4e6-e7c93d8d0391 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:50.742729 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7c36d7ec-63ab-4629-a4e6-e7c93d8d0391 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5" status: 200 len: 1512 microversion: 2.1 time: 0.731784 Jul 12 12:01:50.754847 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1248/2681] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:50 2022] GET /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5 => generated 1512 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:50.765417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-02de1596-bb1b-498f-b72f-98718fe0b34e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:50.766433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-02de1596-bb1b-498f-b72f-98718fe0b34e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:50.777216 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02de1596-bb1b-498f-b72f-98718fe0b34e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:50.779251 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02de1596-bb1b-498f-b72f-98718fe0b34e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:50.780793 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02de1596-bb1b-498f-b72f-98718fe0b34e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:50.781649 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02de1596-bb1b-498f-b72f-98718fe0b34e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:50.974005 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-02de1596-bb1b-498f-b72f-98718fe0b34e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:50.992129 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-02de1596-bb1b-498f-b72f-98718fe0b34e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1281 microversion: 2.1 time: 0.225403 Jul 12 12:01:50.993047 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1249/2682] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:50 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1281 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:51.002061 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1f07d596-67f0-42ca-908a-f142a9f03ae8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:51.002705 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1f07d596-67f0-42ca-908a-f142a9f03ae8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:51.016216 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f07d596-67f0-42ca-908a-f142a9f03ae8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:51.016571 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f07d596-67f0-42ca-908a-f142a9f03ae8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:51.017408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f07d596-67f0-42ca-908a-f142a9f03ae8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:51.017857 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f07d596-67f0-42ca-908a-f142a9f03ae8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:51.069092 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fb46af50-d12e-445f-9341-9d43943f58ff tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:51.084999 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fb46af50-d12e-445f-9341-9d43943f58ff tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:51.087123 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fb46af50-d12e-445f-9341-9d43943f58ff tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:51.089441 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fb46af50-d12e-445f-9341-9d43943f58ff tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1291 microversion: 2.25 time: 0.507054 Jul 12 12:01:51.094335 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1434/2683] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:50 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1291 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:51.105055 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-b99add23-d291-4e60-9be4-13327aeed308 req-ff21fc69-01d7-40c6-8e47-5540a028e263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5962be6e-d556-49ee-bc2f-8132b8a1ffc5", "name": "network-vif-deleted", "tag": "3481c369-0810-4ae0-8594-04e0ea8df9e6"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:51.126314 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b99add23-d291-4e60-9be4-13327aeed308 req-ff21fc69-01d7-40c6-8e47-5540a028e263 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:51.126708 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b99add23-d291-4e60-9be4-13327aeed308 req-ff21fc69-01d7-40c6-8e47-5540a028e263 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:51.157383 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-b99add23-d291-4e60-9be4-13327aeed308 req-ff21fc69-01d7-40c6-8e47-5540a028e263 service nova] Creating event network-vif-deleted:3481c369-0810-4ae0-8594-04e0ea8df9e6 for instance 5962be6e-d556-49ee-bc2f-8132b8a1ffc5 on n-h1-849104-4 Jul 12 12:01:51.166389 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-b99add23-d291-4e60-9be4-13327aeed308 req-ff21fc69-01d7-40c6-8e47-5540a028e263 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070436 Jul 12 12:01:51.167434 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1435/2684] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:51.602933 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b32b973d-bce1-4ce6-a585-2b2d8730e6d3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:51.603902 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b32b973d-bce1-4ce6-a585-2b2d8730e6d3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:51.612535 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b32b973d-bce1-4ce6-a585-2b2d8730e6d3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:51.612987 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b32b973d-bce1-4ce6-a585-2b2d8730e6d3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:51.613775 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b32b973d-bce1-4ce6-a585-2b2d8730e6d3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:51.614219 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b32b973d-bce1-4ce6-a585-2b2d8730e6d3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:51.730389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1f07d596-67f0-42ca-908a-f142a9f03ae8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:51.742929 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1f07d596-67f0-42ca-908a-f142a9f03ae8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.746135 Jul 12 12:01:51.754708 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1250/2685] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:50 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:51.762025 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d2b46e79-f92d-4181-b988-f76cf9fd5d58 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:51.763427 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d2b46e79-f92d-4181-b988-f76cf9fd5d58 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 5962be6e-d556-49ee-bc2f-8132b8a1ffc5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:51.771849 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d2b46e79-f92d-4181-b988-f76cf9fd5d58 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:51.772809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d2b46e79-f92d-4181-b988-f76cf9fd5d58 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:51.774259 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d2b46e79-f92d-4181-b988-f76cf9fd5d58 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:51.775273 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d2b46e79-f92d-4181-b988-f76cf9fd5d58 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:51.842516 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d2b46e79-f92d-4181-b988-f76cf9fd5d58 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:51.842973 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d2b46e79-f92d-4181-b988-f76cf9fd5d58 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:51.843730 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-d2b46e79-f92d-4181-b988-f76cf9fd5d58 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lazy-loading 'fault' on Instance uuid 5962be6e-d556-49ee-bc2f-8132b8a1ffc5 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:01:51.852646 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b32b973d-bce1-4ce6-a585-2b2d8730e6d3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:51.866277 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b32b973d-bce1-4ce6-a585-2b2d8730e6d3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.271251 Jul 12 12:01:51.867531 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1436/2686] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:51 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:51.945130 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d2b46e79-f92d-4181-b988-f76cf9fd5d58 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf94f6e3b43144a28378f2e272e1250d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f363c7937867459f989f28dfa05e2a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:51.953664 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d2b46e79-f92d-4181-b988-f76cf9fd5d58 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5" status: 200 len: 1307 microversion: 2.1 time: 0.195928 Jul 12 12:01:51.954633 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1251/2687] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:51 2022] GET /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5 => generated 1307 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:52.014376 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2733b2fe-7d12-4897-9f53-f7a02e14f4e8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:52.015006 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2733b2fe-7d12-4897-9f53-f7a02e14f4e8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:52.022586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2733b2fe-7d12-4897-9f53-f7a02e14f4e8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:52.023056 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2733b2fe-7d12-4897-9f53-f7a02e14f4e8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:52.024399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2733b2fe-7d12-4897-9f53-f7a02e14f4e8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:52.025221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2733b2fe-7d12-4897-9f53-f7a02e14f4e8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:52.108473 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2733b2fe-7d12-4897-9f53-f7a02e14f4e8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:52.115033 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2864d9df-7750-4e95-81e7-0b8fe13187f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:52.115684 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2864d9df-7750-4e95-81e7-0b8fe13187f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:52.122240 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2733b2fe-7d12-4897-9f53-f7a02e14f4e8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1281 microversion: 2.1 time: 0.110889 Jul 12 12:01:52.124074 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1437/2688] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:52 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1281 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:52.124958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2864d9df-7750-4e95-81e7-0b8fe13187f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:52.125509 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2864d9df-7750-4e95-81e7-0b8fe13187f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:52.126327 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2864d9df-7750-4e95-81e7-0b8fe13187f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:52.126776 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2864d9df-7750-4e95-81e7-0b8fe13187f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:52.455394 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2864d9df-7750-4e95-81e7-0b8fe13187f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:52.469338 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2864d9df-7750-4e95-81e7-0b8fe13187f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:52.471206 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2864d9df-7750-4e95-81e7-0b8fe13187f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:52.473275 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2864d9df-7750-4e95-81e7-0b8fe13187f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1279 microversion: 2.25 time: 0.363229 Jul 12 12:01:52.474676 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1252/2689] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:52 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1279 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:01:52.762764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-73573f12-7800-4ad4-8a17-1cac1a6b35f1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:52.765399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-73573f12-7800-4ad4-8a17-1cac1a6b35f1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:52.781924 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-73573f12-7800-4ad4-8a17-1cac1a6b35f1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:52.782634 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-73573f12-7800-4ad4-8a17-1cac1a6b35f1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:52.783657 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-73573f12-7800-4ad4-8a17-1cac1a6b35f1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:52.784293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-73573f12-7800-4ad4-8a17-1cac1a6b35f1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:52.898254 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e9cb937e-9852-4ab1-bd30-ad66e8a1ef89 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:52.899142 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e9cb937e-9852-4ab1-bd30-ad66e8a1ef89 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:52.916715 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9cb937e-9852-4ab1-bd30-ad66e8a1ef89 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:52.917784 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9cb937e-9852-4ab1-bd30-ad66e8a1ef89 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:52.919950 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9cb937e-9852-4ab1-bd30-ad66e8a1ef89 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:52.920688 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e9cb937e-9852-4ab1-bd30-ad66e8a1ef89 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:53.280976 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e9cb937e-9852-4ab1-bd30-ad66e8a1ef89 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:53.291525 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e9cb937e-9852-4ab1-bd30-ad66e8a1ef89 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.409986 Jul 12 12:01:53.292143 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1253/2690] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:52 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:53.310060 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2d484905-3b14-4761-ab58-275871dd604a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:53.311820 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2d484905-3b14-4761-ab58-275871dd604a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 5962be6e-d556-49ee-bc2f-8132b8a1ffc5] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:53.322529 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d484905-3b14-4761-ab58-275871dd604a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:53.323828 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d484905-3b14-4761-ab58-275871dd604a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:53.325896 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d484905-3b14-4761-ab58-275871dd604a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:53.326613 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2d484905-3b14-4761-ab58-275871dd604a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:53.364838 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-2d484905-3b14-4761-ab58-275871dd604a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] HTTP exception thrown: Instance 5962be6e-d556-49ee-bc2f-8132b8a1ffc5 could not be found. Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2d484905-3b14-4761-ab58-275871dd604a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Request method failure captured: Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5 HTTP/1.1 Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWJ4B-SpfAjbdhEHTdHs8DnJD97YGZXIjzg2HGhqdiUpFWLvvEbckCtVEolXJk9PYFX2aErGpHVbvV5NY7BpaProZgDtn9TlG9MWZfj3G0wk5nEKiXaZKxV1tt4R4M-Z0URm-jDwMRmjfNbjVu2oQvdEmOyeZEOXqGBomYV2rgO5WfU Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: f363c7937867459f989f28dfa05e2a43 Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-MultipleCreateTestJSON-1679190166 Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f363c7937867459f989f28dfa05e2a43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f363c7937867459f989f28dfa05e2a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f363c7937867459f989f28dfa05e2a43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f363c7937867459f989f28dfa05e2a43", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-MultipleCreateTestJSON-1679190166 Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: f363c7937867459f989f28dfa05e2a43 Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1679190166 Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-MultipleCreateTestJSON-1679190166-project Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: bf94f6e3b43144a28378f2e272e1250d Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-MultipleCreateTestJSON-1679190166-project Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance 5962be6e-d556-49ee-bc2f-8132b8a1ffc5 could not be found. Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '5962be6e-d556-49ee-bc2f-8132b8a1ffc5'} Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5962be6e-d556-49ee-bc2f-8132b8a1ffc5 could not be found. Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5962be6e-d556-49ee-bc2f-8132b8a1ffc5 could not be found. Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:01:53.370003 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:01:53.378919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:53.378919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:01:53.378919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:01:53.378919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:01:53.378919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:01:53.378919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5962be6e-d556-49ee-bc2f-8132b8a1ffc5 could not be found. Jul 12 12:01:53.378919 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:01:53.378919 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2d484905-3b14-4761-ab58-275871dd604a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Returning 404 to user: Instance 5962be6e-d556-49ee-bc2f-8132b8a1ffc5 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:01:53.378919 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2d484905-3b14-4761-ab58-275871dd604a tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5" status: 404 len: 111 microversion: 2.1 time: 0.078307 Jul 12 12:01:53.378919 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1254/2691] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:53 2022] GET /compute/v2.1/servers/5962be6e-d556-49ee-bc2f-8132b8a1ffc5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 12:01:53.382402 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cd2d2940-2605-44ae-a4e0-a1c8ae4ce6ab tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:53.383506 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cd2d2940-2605-44ae-a4e0-a1c8ae4ce6ab tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:53.410524 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cd2d2940-2605-44ae-a4e0-a1c8ae4ce6ab tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:53.414466 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cd2d2940-2605-44ae-a4e0-a1c8ae4ce6ab tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:53.416090 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cd2d2940-2605-44ae-a4e0-a1c8ae4ce6ab tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:53.420609 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cd2d2940-2605-44ae-a4e0-a1c8ae4ce6ab tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:53.590041 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-73573f12-7800-4ad4-8a17-1cac1a6b35f1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:53.600462 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-73573f12-7800-4ad4-8a17-1cac1a6b35f1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.842691 Jul 12 12:01:53.612813 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1438/2692] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:52 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:53.617964 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-21b8028f-0193-4198-afcb-81d5f38c2493 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:53.618594 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-21b8028f-0193-4198-afcb-81d5f38c2493 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] [instance: 05ecf5a1-c911-4b95-9e61-296a93042f4b] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:53.637236 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-21b8028f-0193-4198-afcb-81d5f38c2493 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:53.637424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-21b8028f-0193-4198-afcb-81d5f38c2493 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:53.638847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-21b8028f-0193-4198-afcb-81d5f38c2493 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:53.639847 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-21b8028f-0193-4198-afcb-81d5f38c2493 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:53.665519 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-21b8028f-0193-4198-afcb-81d5f38c2493 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] HTTP exception thrown: Instance 05ecf5a1-c911-4b95-9e61-296a93042f4b could not be found. Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-21b8028f-0193-4198-afcb-81d5f38c2493 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Request method failure captured: Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b HTTP/1.1 Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWJ4B-SpfAjbdhEHTdHs8DnJD97YGZXIjzg2HGhqdiUpFWLvvEbckCtVEolXJk9PYFX2aErGpHVbvV5NY7BpaProZgDtn9TlG9MWZfj3G0wk5nEKiXaZKxV1tt4R4M-Z0URm-jDwMRmjfNbjVu2oQvdEmOyeZEOXqGBomYV2rgO5WfU Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: f363c7937867459f989f28dfa05e2a43 Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-MultipleCreateTestJSON-1679190166 Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f363c7937867459f989f28dfa05e2a43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f363c7937867459f989f28dfa05e2a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f363c7937867459f989f28dfa05e2a43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f363c7937867459f989f28dfa05e2a43", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-MultipleCreateTestJSON-1679190166 Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: f363c7937867459f989f28dfa05e2a43 Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1679190166 Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-MultipleCreateTestJSON-1679190166-project Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: bf94f6e3b43144a28378f2e272e1250d Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-MultipleCreateTestJSON-1679190166-project Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 05ecf5a1-c911-4b95-9e61-296a93042f4b could not be found. Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '05ecf5a1-c911-4b95-9e61-296a93042f4b'} Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ecf5a1-c911-4b95-9e61-296a93042f4b could not be found. Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ecf5a1-c911-4b95-9e61-296a93042f4b could not be found. Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:01:53.667910 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:53.675595 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:01:53.675595 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:01:53.675595 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:01:53.675595 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:01:53.675595 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:01:53.675595 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ecf5a1-c911-4b95-9e61-296a93042f4b could not be found. Jul 12 12:01:53.675595 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:01:53.675595 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-21b8028f-0193-4198-afcb-81d5f38c2493 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] Returning 404 to user: Instance 05ecf5a1-c911-4b95-9e61-296a93042f4b could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:01:53.677172 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-21b8028f-0193-4198-afcb-81d5f38c2493 tempest-MultipleCreateTestJSON-1679190166 tempest-MultipleCreateTestJSON-1679190166-project] 10.222.0.50 "GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b" status: 404 len: 111 microversion: 2.1 time: 0.061717 Jul 12 12:01:53.682312 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1439/2693] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:53 2022] GET /compute/v2.1/servers/05ecf5a1-c911-4b95-9e61-296a93042f4b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 12:01:53.690992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8a3b4369-35e5-42b0-90cd-bac8aa6162da tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:53.695491 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8a3b4369-35e5-42b0-90cd-bac8aa6162da tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:53.712530 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a3b4369-35e5-42b0-90cd-bac8aa6162da tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:53.714825 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a3b4369-35e5-42b0-90cd-bac8aa6162da tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:53.717198 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a3b4369-35e5-42b0-90cd-bac8aa6162da tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:53.717815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a3b4369-35e5-42b0-90cd-bac8aa6162da tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:53.864708 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-cd2d2940-2605-44ae-a4e0-a1c8ae4ce6ab tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:53.875845 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cd2d2940-2605-44ae-a4e0-a1c8ae4ce6ab tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1323 microversion: 2.1 time: 0.498871 Jul 12 12:01:53.886246 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1255/2694] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:53 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1323 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:53.892124 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-49b70748-1cd8-433c-a2e5-d77a0f479fae req-c8085d2c-2ec9-484f-8f87-b2db4e3abc04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ecf5a1-c911-4b95-9e61-296a93042f4b", "name": "network-vif-deleted", "tag": "9646633f-3d63-4d10-aa22-81ed1fee065e"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:53.901318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-49b70748-1cd8-433c-a2e5-d77a0f479fae req-c8085d2c-2ec9-484f-8f87-b2db4e3abc04 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:53.901919 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-49b70748-1cd8-433c-a2e5-d77a0f479fae req-c8085d2c-2ec9-484f-8f87-b2db4e3abc04 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:53.928115 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-49b70748-1cd8-433c-a2e5-d77a0f479fae req-c8085d2c-2ec9-484f-8f87-b2db4e3abc04 service nova] Creating event network-vif-deleted:9646633f-3d63-4d10-aa22-81ed1fee065e for instance 05ecf5a1-c911-4b95-9e61-296a93042f4b on n-h2-849104-4 Jul 12 12:01:53.938628 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-49b70748-1cd8-433c-a2e5-d77a0f479fae req-c8085d2c-2ec9-484f-8f87-b2db4e3abc04 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049553 Jul 12 12:01:53.940327 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1256/2695] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:54.180445 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8a3b4369-35e5-42b0-90cd-bac8aa6162da tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:54.201854 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8a3b4369-35e5-42b0-90cd-bac8aa6162da tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:54.204724 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8a3b4369-35e5-42b0-90cd-bac8aa6162da tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:54.206227 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8a3b4369-35e5-42b0-90cd-bac8aa6162da tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1279 microversion: 2.25 time: 0.527467 Jul 12 12:01:54.208461 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1440/2696] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:53 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1279 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:54.315354 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bb265f80-d47b-4395-a5e3-6cd8a1080627 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:54.315891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bb265f80-d47b-4395-a5e3-6cd8a1080627 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:54.335215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bb265f80-d47b-4395-a5e3-6cd8a1080627 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:54.336287 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bb265f80-d47b-4395-a5e3-6cd8a1080627 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:54.336440 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bb265f80-d47b-4395-a5e3-6cd8a1080627 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:54.336886 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bb265f80-d47b-4395-a5e3-6cd8a1080627 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:54.467772 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a76c92ec-a2d7-4990-8bcb-e62fd9f53e01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:54.468511 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a76c92ec-a2d7-4990-8bcb-e62fd9f53e01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:54.475638 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a76c92ec-a2d7-4990-8bcb-e62fd9f53e01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:54.476140 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a76c92ec-a2d7-4990-8bcb-e62fd9f53e01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:54.477111 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a76c92ec-a2d7-4990-8bcb-e62fd9f53e01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:54.477734 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a76c92ec-a2d7-4990-8bcb-e62fd9f53e01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:54.507758 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a76c92ec-a2d7-4990-8bcb-e62fd9f53e01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:01:54.643231 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a76c92ec-a2d7-4990-8bcb-e62fd9f53e01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 204 len: 0 microversion: 2.42 time: 0.422109 Jul 12 12:01:54.648727 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1257/2697] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 12:01:54 2022] DELETE /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 12:01:54.658603 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c676937c-bf2a-4584-ab79-bf22736b75ee tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:54.659980 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c676937c-bf2a-4584-ab79-bf22736b75ee tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:54.671522 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c676937c-bf2a-4584-ab79-bf22736b75ee tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:54.672852 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c676937c-bf2a-4584-ab79-bf22736b75ee tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:54.673907 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c676937c-bf2a-4584-ab79-bf22736b75ee tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:54.674748 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c676937c-bf2a-4584-ab79-bf22736b75ee tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:54.895625 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bb265f80-d47b-4395-a5e3-6cd8a1080627 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:54.907541 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bb265f80-d47b-4395-a5e3-6cd8a1080627 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.596354 Jul 12 12:01:54.917176 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1441/2698] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:54 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:01:54.929306 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8c828ea4-26e9-4afc-8141-062b96ad144b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:54.930976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8c828ea4-26e9-4afc-8141-062b96ad144b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:54.943620 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c828ea4-26e9-4afc-8141-062b96ad144b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:54.944912 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c828ea4-26e9-4afc-8141-062b96ad144b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:54.946899 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c828ea4-26e9-4afc-8141-062b96ad144b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:54.948228 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8c828ea4-26e9-4afc-8141-062b96ad144b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:55.112536 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=4 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:55.231630 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=12 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:55.280908 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c676937c-bf2a-4584-ab79-bf22736b75ee tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:55.358745 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c676937c-bf2a-4584-ab79-bf22736b75ee tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.706145 Jul 12 12:01:55.360288 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1258/2699] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:54 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:55.374413 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-194600a9-b783-4a56-a984-fdee2b36dbff tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:55.375626 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-194600a9-b783-4a56-a984-fdee2b36dbff tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:55.386026 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-194600a9-b783-4a56-a984-fdee2b36dbff tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:55.386913 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-194600a9-b783-4a56-a984-fdee2b36dbff tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:55.390301 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-194600a9-b783-4a56-a984-fdee2b36dbff tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:55.391112 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-194600a9-b783-4a56-a984-fdee2b36dbff tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:55.476150 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8c828ea4-26e9-4afc-8141-062b96ad144b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:55.491656 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8c828ea4-26e9-4afc-8141-062b96ad144b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:55.513589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8c828ea4-26e9-4afc-8141-062b96ad144b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:55.524940 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8c828ea4-26e9-4afc-8141-062b96ad144b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 2961 microversion: 2.42 time: 0.604944 Jul 12 12:01:55.525992 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1442/2700] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:54 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 2961 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:55.537649 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-624e0def-b8b6-434f-8d5b-078dab9ecdbf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:55.542584 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-624e0def-b8b6-434f-8d5b-078dab9ecdbf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:55.572812 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-624e0def-b8b6-434f-8d5b-078dab9ecdbf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:55.573846 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-624e0def-b8b6-434f-8d5b-078dab9ecdbf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:55.576274 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-624e0def-b8b6-434f-8d5b-078dab9ecdbf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:55.577364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-624e0def-b8b6-434f-8d5b-078dab9ecdbf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:55.910140 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:56.004466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-624e0def-b8b6-434f-8d5b-078dab9ecdbf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:56.027368 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-624e0def-b8b6-434f-8d5b-078dab9ecdbf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:56.029178 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-624e0def-b8b6-434f-8d5b-078dab9ecdbf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:56.031360 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-624e0def-b8b6-434f-8d5b-078dab9ecdbf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1279 microversion: 2.25 time: 0.503557 Jul 12 12:01:56.035204 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1443/2701] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:55 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1279 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:56.050242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-0147ee7c-c6ea-426f-b30c-2aac76a9d4dd req-7432d935-a5be-4e45-a696-ed7d87d93558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deab1788-4378-44fc-8c70-3f3e04bf5e35", "tag": "70ebfb7f-2f94-4495-80d6-8b78bfd503e1"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:56.078608 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-0147ee7c-c6ea-426f-b30c-2aac76a9d4dd req-7432d935-a5be-4e45-a696-ed7d87d93558 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:56.079058 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-0147ee7c-c6ea-426f-b30c-2aac76a9d4dd req-7432d935-a5be-4e45-a696-ed7d87d93558 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:56.117471 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-0147ee7c-c6ea-426f-b30c-2aac76a9d4dd req-7432d935-a5be-4e45-a696-ed7d87d93558 service nova] Creating event network-changed:70ebfb7f-2f94-4495-80d6-8b78bfd503e1 for instance deab1788-4378-44fc-8c70-3f3e04bf5e35 on n-h1-849104-4 Jul 12 12:01:56.143035 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-0147ee7c-c6ea-426f-b30c-2aac76a9d4dd req-7432d935-a5be-4e45-a696-ed7d87d93558 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105733 Jul 12 12:01:56.144672 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1444/2702] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:56.154366 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a43d7832-37b7-4125-a1ea-0f6ea69aadee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:56.156069 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a43d7832-37b7-4125-a1ea-0f6ea69aadee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:56.178710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a43d7832-37b7-4125-a1ea-0f6ea69aadee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:56.182878 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a43d7832-37b7-4125-a1ea-0f6ea69aadee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:56.185367 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a43d7832-37b7-4125-a1ea-0f6ea69aadee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:56.186412 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a43d7832-37b7-4125-a1ea-0f6ea69aadee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:56.471285 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-194600a9-b783-4a56-a984-fdee2b36dbff tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:56.509932 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-194600a9-b783-4a56-a984-fdee2b36dbff tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1323 microversion: 2.1 time: 1.148187 Jul 12 12:01:56.514041 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1259/2703] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:55 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1323 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:56.524415 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=4 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:56.525453 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a68b7951-7bb5-41b2-948f-edcb0eea99eb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:56.526094 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a68b7951-7bb5-41b2-948f-edcb0eea99eb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:56.538318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a68b7951-7bb5-41b2-948f-edcb0eea99eb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:56.539727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a68b7951-7bb5-41b2-948f-edcb0eea99eb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:56.541223 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a68b7951-7bb5-41b2-948f-edcb0eea99eb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:56.542415 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a68b7951-7bb5-41b2-948f-edcb0eea99eb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:56.767869 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a43d7832-37b7-4125-a1ea-0f6ea69aadee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:56.778018 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a43d7832-37b7-4125-a1ea-0f6ea69aadee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.630874 Jul 12 12:01:56.779690 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1445/2704] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:56 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:56.789773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dcc33ede-dad3-43a3-a90b-794f3b6c6ed5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:56.790904 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dcc33ede-dad3-43a3-a90b-794f3b6c6ed5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:56.816466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcc33ede-dad3-43a3-a90b-794f3b6c6ed5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:56.817369 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcc33ede-dad3-43a3-a90b-794f3b6c6ed5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:56.818548 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcc33ede-dad3-43a3-a90b-794f3b6c6ed5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:56.819259 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcc33ede-dad3-43a3-a90b-794f3b6c6ed5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:57.105663 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a68b7951-7bb5-41b2-948f-edcb0eea99eb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:57.114789 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a68b7951-7bb5-41b2-948f-edcb0eea99eb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.599173 Jul 12 12:01:57.115377 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1260/2705] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:56 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:57.121254 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4ca263f0-b710-4a4b-9eed-80aa93f23a7a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:57.122199 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4ca263f0-b710-4a4b-9eed-80aa93f23a7a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:57.137974 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4ca263f0-b710-4a4b-9eed-80aa93f23a7a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:57.138767 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4ca263f0-b710-4a4b-9eed-80aa93f23a7a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:57.141050 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4ca263f0-b710-4a4b-9eed-80aa93f23a7a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:57.141830 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4ca263f0-b710-4a4b-9eed-80aa93f23a7a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:57.283586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dcc33ede-dad3-43a3-a90b-794f3b6c6ed5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:57.300893 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dcc33ede-dad3-43a3-a90b-794f3b6c6ed5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:57.305268 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dcc33ede-dad3-43a3-a90b-794f3b6c6ed5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:57.306985 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dcc33ede-dad3-43a3-a90b-794f3b6c6ed5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 2961 microversion: 2.42 time: 0.525667 Jul 12 12:01:57.321695 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1446/2706] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:56 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 2961 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:57.343088 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4ca263f0-b710-4a4b-9eed-80aa93f23a7a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:57.357221 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4ca263f0-b710-4a4b-9eed-80aa93f23a7a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:57.360484 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4ca263f0-b710-4a4b-9eed-80aa93f23a7a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:57.362008 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4ca263f0-b710-4a4b-9eed-80aa93f23a7a tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1279 microversion: 2.25 time: 0.244633 Jul 12 12:01:57.362991 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1261/2707] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:57 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1279 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:57.530091 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7268bb7e-28bd-4d27-854e-368c6f74447b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:57.530851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7268bb7e-28bd-4d27-854e-368c6f74447b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:57.537859 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7268bb7e-28bd-4d27-854e-368c6f74447b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:57.538627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7268bb7e-28bd-4d27-854e-368c6f74447b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:57.539429 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7268bb7e-28bd-4d27-854e-368c6f74447b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:57.539881 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7268bb7e-28bd-4d27-854e-368c6f74447b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:57.573963 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:57.776827 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f050615d-c8d4-4659-a096-74e2afdca7eb tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a96b5106-34ea-4c90-a5ce-7047e898a6b2"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:57.779358 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f050615d-c8d4-4659-a096-74e2afdca7eb tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:57.791617 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f050615d-c8d4-4659-a096-74e2afdca7eb tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:57.792387 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f050615d-c8d4-4659-a096-74e2afdca7eb tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:57.794455 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f050615d-c8d4-4659-a096-74e2afdca7eb tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:57.795081 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f050615d-c8d4-4659-a096-74e2afdca7eb tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:57.821109 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:01:58.340879 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f050615d-c8d4-4659-a096-74e2afdca7eb tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "POST /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.570713 Jul 12 12:01:58.343403 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1262/2708] 10.222.0.50 () {60 vars in 1322 bytes} [Tue Jul 12 12:01:57 2022] POST /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998/os-volume_attachments => generated 194 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:58.356525 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0391b5fd-1625-4039-8d49-99e6f9e75e58 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:58.358972 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0391b5fd-1625-4039-8d49-99e6f9e75e58 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:58.369777 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0391b5fd-1625-4039-8d49-99e6f9e75e58 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:58.370926 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0391b5fd-1625-4039-8d49-99e6f9e75e58 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:58.372378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0391b5fd-1625-4039-8d49-99e6f9e75e58 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:58.373418 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0391b5fd-1625-4039-8d49-99e6f9e75e58 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:58.507398 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7268bb7e-28bd-4d27-854e-368c6f74447b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:58.521676 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7268bb7e-28bd-4d27-854e-368c6f74447b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1323 microversion: 2.1 time: 0.997020 Jul 12 12:01:58.540481 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1447/2709] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:57 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1323 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:58.550171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c8929cdd-c4ff-4915-b472-c818d260e417 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:58.551286 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c8929cdd-c4ff-4915-b472-c818d260e417 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:58.567931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c8929cdd-c4ff-4915-b472-c818d260e417 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:58.569202 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c8929cdd-c4ff-4915-b472-c818d260e417 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:58.576863 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c8929cdd-c4ff-4915-b472-c818d260e417 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:58.578201 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c8929cdd-c4ff-4915-b472-c818d260e417 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:58.635929 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0391b5fd-1625-4039-8d49-99e6f9e75e58 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:58.648512 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0391b5fd-1625-4039-8d49-99e6f9e75e58 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.302292 Jul 12 12:01:58.649799 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1263/2710] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:58 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:58.656741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-572bf19f-ffff-48f6-a6fb-d60d38c9b8c9 req-a5497409-4d5b-4f97-9e90-308e51b4ffca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eefd015-61dc-4aea-8dc9-4faabaf9a869", "tag": "bfc5370e-ce21-4218-be02-49f52a93b0ba"}, {"name": "network-changed", "server_uuid": "21a370a2-ee60-46d7-8b18-3f5bf976e8bc", "tag": "e0ad7f75-136c-4075-bed4-139c20d686f7"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:01:58.670542 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-572bf19f-ffff-48f6-a6fb-d60d38c9b8c9 req-a5497409-4d5b-4f97-9e90-308e51b4ffca service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:58.671133 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-572bf19f-ffff-48f6-a6fb-d60d38c9b8c9 req-a5497409-4d5b-4f97-9e90-308e51b4ffca service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:58.688398 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-572bf19f-ffff-48f6-a6fb-d60d38c9b8c9 req-a5497409-4d5b-4f97-9e90-308e51b4ffca service nova] Creating event network-changed:bfc5370e-ce21-4218-be02-49f52a93b0ba for instance 0eefd015-61dc-4aea-8dc9-4faabaf9a869 on n-h1-849104-4 Jul 12 12:01:58.689231 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-572bf19f-ffff-48f6-a6fb-d60d38c9b8c9 req-a5497409-4d5b-4f97-9e90-308e51b4ffca service nova] Creating event network-changed:e0ad7f75-136c-4075-bed4-139c20d686f7 for instance 21a370a2-ee60-46d7-8b18-3f5bf976e8bc on n-h2-849104-4 Jul 12 12:01:58.699182 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-572bf19f-ffff-48f6-a6fb-d60d38c9b8c9 req-a5497409-4d5b-4f97-9e90-308e51b4ffca service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048088 Jul 12 12:01:58.700423 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1264/2711] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:01:58.706685 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-115e6ef4-215b-45c0-9f1e-69e069405e25 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:58.707388 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-115e6ef4-215b-45c0-9f1e-69e069405e25 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:58.714851 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-115e6ef4-215b-45c0-9f1e-69e069405e25 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:58.715948 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-115e6ef4-215b-45c0-9f1e-69e069405e25 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:58.716891 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-115e6ef4-215b-45c0-9f1e-69e069405e25 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:58.717390 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-115e6ef4-215b-45c0-9f1e-69e069405e25 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:58.970156 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c8929cdd-c4ff-4915-b472-c818d260e417 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:58.978795 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c8929cdd-c4ff-4915-b472-c818d260e417 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.436930 Jul 12 12:01:58.990757 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1448/2712] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:58 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:01:58.997142 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-83f8f197-7416-4544-adb0-f9f145ba275f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:58.998871 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-83f8f197-7416-4544-adb0-f9f145ba275f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:59.006792 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83f8f197-7416-4544-adb0-f9f145ba275f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:59.007739 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83f8f197-7416-4544-adb0-f9f145ba275f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:59.008911 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83f8f197-7416-4544-adb0-f9f145ba275f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:59.009582 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-83f8f197-7416-4544-adb0-f9f145ba275f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:59.063848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-115e6ef4-215b-45c0-9f1e-69e069405e25 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:59.086818 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-115e6ef4-215b-45c0-9f1e-69e069405e25 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:59.091930 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-115e6ef4-215b-45c0-9f1e-69e069405e25 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:59.094784 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-115e6ef4-215b-45c0-9f1e-69e069405e25 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 2961 microversion: 2.42 time: 0.392849 Jul 12 12:01:59.096484 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1265/2713] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:58 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 2961 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:59.528311 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-83f8f197-7416-4544-adb0-f9f145ba275f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:59.541954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ee9915c8-b8f1-4239-be60-a06d3b75fed6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:59.542618 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ee9915c8-b8f1-4239-be60-a06d3b75fed6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:59.554776 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-83f8f197-7416-4544-adb0-f9f145ba275f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:59.555611 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee9915c8-b8f1-4239-be60-a06d3b75fed6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:59.555823 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee9915c8-b8f1-4239-be60-a06d3b75fed6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:59.558854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee9915c8-b8f1-4239-be60-a06d3b75fed6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:59.559344 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee9915c8-b8f1-4239-be60-a06d3b75fed6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:59.564824 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-83f8f197-7416-4544-adb0-f9f145ba275f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:01:59.572804 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-83f8f197-7416-4544-adb0-f9f145ba275f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1279 microversion: 2.25 time: 0.580249 Jul 12 12:01:59.588973 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1449/2714] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:01:58 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1279 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:01:59.669800 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f85c538d-7e9f-4068-b1eb-e9c0de01351a tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:01:59.671252 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f85c538d-7e9f-4068-b1eb-e9c0de01351a tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:01:59.694949 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f85c538d-7e9f-4068-b1eb-e9c0de01351a tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:59.695904 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f85c538d-7e9f-4068-b1eb-e9c0de01351a tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:01:59.697163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f85c538d-7e9f-4068-b1eb-e9c0de01351a tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:01:59.701224 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f85c538d-7e9f-4068-b1eb-e9c0de01351a tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:00.199286 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ee9915c8-b8f1-4239-be60-a06d3b75fed6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:00.217185 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ee9915c8-b8f1-4239-be60-a06d3b75fed6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1323 microversion: 2.1 time: 0.679564 Jul 12 12:02:00.227467 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1266/2715] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:59 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1323 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:00.231275 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a75d4437-306c-482e-aef3-4d8fb6256ef7 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:00.232487 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a75d4437-306c-482e-aef3-4d8fb6256ef7 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:00.243438 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a75d4437-306c-482e-aef3-4d8fb6256ef7 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:00.243903 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a75d4437-306c-482e-aef3-4d8fb6256ef7 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:00.244775 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a75d4437-306c-482e-aef3-4d8fb6256ef7 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:00.245219 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a75d4437-306c-482e-aef3-4d8fb6256ef7 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:00.339531 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f85c538d-7e9f-4068-b1eb-e9c0de01351a tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:00.350912 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f85c538d-7e9f-4068-b1eb-e9c0de01351a tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.687664 Jul 12 12:02:00.351577 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1450/2716] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:01:59 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:00.357241 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9bc18843-8566-4163-bc69-9e2c9e4e05d2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:00.369016 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9bc18843-8566-4163-bc69-9e2c9e4e05d2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:00.376433 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9bc18843-8566-4163-bc69-9e2c9e4e05d2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:00.376927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9bc18843-8566-4163-bc69-9e2c9e4e05d2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:00.377923 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9bc18843-8566-4163-bc69-9e2c9e4e05d2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:00.378372 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9bc18843-8566-4163-bc69-9e2c9e4e05d2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:00.880011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9bc18843-8566-4163-bc69-9e2c9e4e05d2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:00.898414 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9bc18843-8566-4163-bc69-9e2c9e4e05d2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:00.900870 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9bc18843-8566-4163-bc69-9e2c9e4e05d2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:00.903085 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9bc18843-8566-4163-bc69-9e2c9e4e05d2 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 2961 microversion: 2.42 time: 0.549990 Jul 12 12:02:00.905327 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1451/2717] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:00 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 2961 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:00.912662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e70f5a21-ee20-4925-b98d-45efaaf8955f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:00.917507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a75d4437-306c-482e-aef3-4d8fb6256ef7 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:00.933354 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e70f5a21-ee20-4925-b98d-45efaaf8955f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:00.948783 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a75d4437-306c-482e-aef3-4d8fb6256ef7 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.729697 Jul 12 12:02:00.949432 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1267/2718] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:00 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:00.952243 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e70f5a21-ee20-4925-b98d-45efaaf8955f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:00.953012 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e70f5a21-ee20-4925-b98d-45efaaf8955f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:00.954421 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e70f5a21-ee20-4925-b98d-45efaaf8955f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:00.955181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e70f5a21-ee20-4925-b98d-45efaaf8955f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:01.236005 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1ae18678-ad8d-419b-aff4-0dd87d7573df tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:01.236658 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1ae18678-ad8d-419b-aff4-0dd87d7573df tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:01.258213 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1ae18678-ad8d-419b-aff4-0dd87d7573df tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:01.261071 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1ae18678-ad8d-419b-aff4-0dd87d7573df tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:01.262154 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1ae18678-ad8d-419b-aff4-0dd87d7573df tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:01.263965 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1ae18678-ad8d-419b-aff4-0dd87d7573df tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:01.291323 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e70f5a21-ee20-4925-b98d-45efaaf8955f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:01.319708 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e70f5a21-ee20-4925-b98d-45efaaf8955f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:01.329239 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e70f5a21-ee20-4925-b98d-45efaaf8955f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:01.330751 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e70f5a21-ee20-4925-b98d-45efaaf8955f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1279 microversion: 2.25 time: 0.423565 Jul 12 12:02:01.331591 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1452/2719] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:00 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1279 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:01.342388 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-02567072-6151-44a8-b6c7-8f589a6573da req-a57ebc22-44fb-4aff-ba16-66a180cb0a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6834c01a-284c-47fc-8939-403833f0ebd8", "name": "network-vif-plugged", "status": "completed", "tag": "5ac103df-1ff9-40af-8256-5349b52e1acc"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:01.362794 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-02567072-6151-44a8-b6c7-8f589a6573da req-a57ebc22-44fb-4aff-ba16-66a180cb0a92 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:01.363254 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-02567072-6151-44a8-b6c7-8f589a6573da req-a57ebc22-44fb-4aff-ba16-66a180cb0a92 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:01.392556 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-02567072-6151-44a8-b6c7-8f589a6573da req-a57ebc22-44fb-4aff-ba16-66a180cb0a92 service nova] Creating event network-vif-plugged:5ac103df-1ff9-40af-8256-5349b52e1acc for instance 6834c01a-284c-47fc-8939-403833f0ebd8 on n-h1-849104-4 Jul 12 12:02:01.401435 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-02567072-6151-44a8-b6c7-8f589a6573da req-a57ebc22-44fb-4aff-ba16-66a180cb0a92 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067830 Jul 12 12:02:01.402350 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1453/2720] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:01.421923 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a761bccd-7dc6-40e1-b247-6a8d10eb1485 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:01.422656 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a761bccd-7dc6-40e1-b247-6a8d10eb1485 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:01.443293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a761bccd-7dc6-40e1-b247-6a8d10eb1485 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:01.445958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a761bccd-7dc6-40e1-b247-6a8d10eb1485 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:01.448514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a761bccd-7dc6-40e1-b247-6a8d10eb1485 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:01.449050 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a761bccd-7dc6-40e1-b247-6a8d10eb1485 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:01.890803 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a761bccd-7dc6-40e1-b247-6a8d10eb1485 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:01.902288 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a761bccd-7dc6-40e1-b247-6a8d10eb1485 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.498386 Jul 12 12:02:01.903468 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1454/2721] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:01 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:01.927628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b365488f-56d9-476c-87d1-ff50f95ea0a3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:01.928510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b365488f-56d9-476c-87d1-ff50f95ea0a3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:01.941464 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b365488f-56d9-476c-87d1-ff50f95ea0a3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:01.947333 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b365488f-56d9-476c-87d1-ff50f95ea0a3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:01.948609 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b365488f-56d9-476c-87d1-ff50f95ea0a3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:01.950521 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b365488f-56d9-476c-87d1-ff50f95ea0a3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:02.136831 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1ae18678-ad8d-419b-aff4-0dd87d7573df tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:02.148894 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1ae18678-ad8d-419b-aff4-0dd87d7573df tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1323 microversion: 2.1 time: 0.915345 Jul 12 12:02:02.149653 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1268/2722] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:01 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1323 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:02.159593 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e98a665e-37ec-4cac-9000-1ce55b5c0655 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:02.164899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e98a665e-37ec-4cac-9000-1ce55b5c0655 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:02.183505 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e98a665e-37ec-4cac-9000-1ce55b5c0655 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:02.185043 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e98a665e-37ec-4cac-9000-1ce55b5c0655 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:02.186166 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e98a665e-37ec-4cac-9000-1ce55b5c0655 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:02.187655 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e98a665e-37ec-4cac-9000-1ce55b5c0655 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:02.522056 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b365488f-56d9-476c-87d1-ff50f95ea0a3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:02.539348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b365488f-56d9-476c-87d1-ff50f95ea0a3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:02.541626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b365488f-56d9-476c-87d1-ff50f95ea0a3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:02.543271 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b365488f-56d9-476c-87d1-ff50f95ea0a3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 2961 microversion: 2.42 time: 0.620311 Jul 12 12:02:02.544400 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1455/2723] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:01 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 2961 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:02.552362 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8a58e673-a40b-4bd5-87cb-45fea9d6438e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:02.554778 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-8a58e673-a40b-4bd5-87cb-45fea9d6438e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:02.564566 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a58e673-a40b-4bd5-87cb-45fea9d6438e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:02.565494 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a58e673-a40b-4bd5-87cb-45fea9d6438e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:02.566492 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a58e673-a40b-4bd5-87cb-45fea9d6438e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:02.567415 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-8a58e673-a40b-4bd5-87cb-45fea9d6438e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:02.626035 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e98a665e-37ec-4cac-9000-1ce55b5c0655 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:02.635742 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e98a665e-37ec-4cac-9000-1ce55b5c0655 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.484164 Jul 12 12:02:02.637593 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1269/2724] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:02 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:02.924230 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-69f22eda-e65b-4c18-869a-0465b8b65805 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:02.925271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-69f22eda-e65b-4c18-869a-0465b8b65805 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:02.949246 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-69f22eda-e65b-4c18-869a-0465b8b65805 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:02.952143 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-69f22eda-e65b-4c18-869a-0465b8b65805 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:02.956744 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-69f22eda-e65b-4c18-869a-0465b8b65805 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:02.958322 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-69f22eda-e65b-4c18-869a-0465b8b65805 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:03.171942 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8a58e673-a40b-4bd5-87cb-45fea9d6438e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:03.187895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8a58e673-a40b-4bd5-87cb-45fea9d6438e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:03.189466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-8a58e673-a40b-4bd5-87cb-45fea9d6438e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:03.190820 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8a58e673-a40b-4bd5-87cb-45fea9d6438e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1279 microversion: 2.25 time: 0.643622 Jul 12 12:02:03.193305 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1456/2725] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:02 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1279 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:03.202094 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f36e094f-0389-4305-978b-a2a48bd6a082 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:03.203120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f36e094f-0389-4305-978b-a2a48bd6a082 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:03.218535 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f36e094f-0389-4305-978b-a2a48bd6a082 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:03.219309 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f36e094f-0389-4305-978b-a2a48bd6a082 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:03.220385 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f36e094f-0389-4305-978b-a2a48bd6a082 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:03.228241 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f36e094f-0389-4305-978b-a2a48bd6a082 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:03.602517 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f36e094f-0389-4305-978b-a2a48bd6a082 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:03.617741 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f36e094f-0389-4305-978b-a2a48bd6a082 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1323 microversion: 2.1 time: 0.422560 Jul 12 12:02:03.619369 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1457/2726] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:03 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1323 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:03.626436 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-cc50a2ee-5d49-43f4-849d-3fc7c37a2d18 req-47e41bf4-51e4-4975-a330-0e9865bb4d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-unplugged", "status": "completed", "tag": "89649079-3e25-40bb-b461-65345a57ea7f"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:03.650420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-cc50a2ee-5d49-43f4-849d-3fc7c37a2d18 req-47e41bf4-51e4-4975-a330-0e9865bb4d1b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:03.650873 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-cc50a2ee-5d49-43f4-849d-3fc7c37a2d18 req-47e41bf4-51e4-4975-a330-0e9865bb4d1b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:03.651726 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-69f22eda-e65b-4c18-869a-0465b8b65805 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:03.665925 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-69f22eda-e65b-4c18-869a-0465b8b65805 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.748968 Jul 12 12:02:03.670862 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1270/2727] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:02 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:03.681913 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e02aad7f-00ae-49db-9614-4eca97f578d8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:03.682706 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-cc50a2ee-5d49-43f4-849d-3fc7c37a2d18 req-47e41bf4-51e4-4975-a330-0e9865bb4d1b service nova] Creating event network-vif-unplugged:89649079-3e25-40bb-b461-65345a57ea7f for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 12:02:03.684481 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e02aad7f-00ae-49db-9614-4eca97f578d8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:03.690086 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-cc50a2ee-5d49-43f4-849d-3fc7c37a2d18 req-47e41bf4-51e4-4975-a330-0e9865bb4d1b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069432 Jul 12 12:02:03.690745 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1458/2728] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:03.701141 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6765e1be-a849-4c4e-98bd-006b02b3b816 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:03.701859 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6765e1be-a849-4c4e-98bd-006b02b3b816 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:03.704605 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e02aad7f-00ae-49db-9614-4eca97f578d8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:03.708601 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e02aad7f-00ae-49db-9614-4eca97f578d8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:03.709726 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e02aad7f-00ae-49db-9614-4eca97f578d8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:03.710380 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e02aad7f-00ae-49db-9614-4eca97f578d8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:03.722483 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6765e1be-a849-4c4e-98bd-006b02b3b816 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:03.722483 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6765e1be-a849-4c4e-98bd-006b02b3b816 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:03.722483 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6765e1be-a849-4c4e-98bd-006b02b3b816 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:03.722830 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6765e1be-a849-4c4e-98bd-006b02b3b816 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:04.043411 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6765e1be-a849-4c4e-98bd-006b02b3b816 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:04.057498 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6765e1be-a849-4c4e-98bd-006b02b3b816 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.361511 Jul 12 12:02:04.058088 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1459/2729] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:03 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:04.112484 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e02aad7f-00ae-49db-9614-4eca97f578d8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:04.146216 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e02aad7f-00ae-49db-9614-4eca97f578d8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:04.147775 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e02aad7f-00ae-49db-9614-4eca97f578d8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:04.149380 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e02aad7f-00ae-49db-9614-4eca97f578d8 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 2940 microversion: 2.42 time: 0.477184 Jul 12 12:02:04.149967 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1271/2730] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:03 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 2940 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:04.212906 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b31c7c40-73c6-44d6-ad0c-9dc9e5c1293e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:04.215977 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b31c7c40-73c6-44d6-ad0c-9dc9e5c1293e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:04.226350 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b31c7c40-73c6-44d6-ad0c-9dc9e5c1293e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:04.227209 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b31c7c40-73c6-44d6-ad0c-9dc9e5c1293e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:04.228851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b31c7c40-73c6-44d6-ad0c-9dc9e5c1293e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:04.229555 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b31c7c40-73c6-44d6-ad0c-9dc9e5c1293e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:04.636428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a5b4f2af-3a8f-45e8-b671-91e7d93b387d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:04.637018 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a5b4f2af-3a8f-45e8-b671-91e7d93b387d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:04.657921 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5b4f2af-3a8f-45e8-b671-91e7d93b387d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:04.665287 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5b4f2af-3a8f-45e8-b671-91e7d93b387d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:04.667411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5b4f2af-3a8f-45e8-b671-91e7d93b387d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:04.671411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5b4f2af-3a8f-45e8-b671-91e7d93b387d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:04.829533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b31c7c40-73c6-44d6-ad0c-9dc9e5c1293e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:04.839380 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b31c7c40-73c6-44d6-ad0c-9dc9e5c1293e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:04.847095 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b31c7c40-73c6-44d6-ad0c-9dc9e5c1293e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:04.848698 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b31c7c40-73c6-44d6-ad0c-9dc9e5c1293e tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1475 microversion: 2.25 time: 0.641755 Jul 12 12:02:04.862697 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1460/2731] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:04 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1475 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:04.862697 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4dfd81dc-ac12-4b65-b94a-fe3683b31738 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:04.874120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4dfd81dc-ac12-4b65-b94a-fe3683b31738 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:04.895081 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4dfd81dc-ac12-4b65-b94a-fe3683b31738 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:04.895765 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4dfd81dc-ac12-4b65-b94a-fe3683b31738 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:04.904443 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4dfd81dc-ac12-4b65-b94a-fe3683b31738 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:04.905038 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4dfd81dc-ac12-4b65-b94a-fe3683b31738 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:05.002856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a5b4f2af-3a8f-45e8-b671-91e7d93b387d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:05.021378 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a5b4f2af-3a8f-45e8-b671-91e7d93b387d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1323 microversion: 2.1 time: 0.387020 Jul 12 12:02:05.024444 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1272/2732] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:04 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1323 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:05.158868 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4dfd81dc-ac12-4b65-b94a-fe3683b31738 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:05.190176 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4dfd81dc-ac12-4b65-b94a-fe3683b31738 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.337810 Jul 12 12:02:05.191451 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1461/2733] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:04 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:05.196993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1253f301-25d2-4256-9f83-872d519c0ad2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:05.197941 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1253f301-25d2-4256-9f83-872d519c0ad2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:05.204880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1253f301-25d2-4256-9f83-872d519c0ad2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:05.205751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1253f301-25d2-4256-9f83-872d519c0ad2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:05.206808 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1253f301-25d2-4256-9f83-872d519c0ad2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:05.207468 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1253f301-25d2-4256-9f83-872d519c0ad2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:05.392073 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1253f301-25d2-4256-9f83-872d519c0ad2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:05.405163 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1253f301-25d2-4256-9f83-872d519c0ad2 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.212154 Jul 12 12:02:05.406521 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1462/2734] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:05 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:05.411777 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-66f2bc54-9ad5-4df6-8b47-288459f3a73c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:05.412648 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-66f2bc54-9ad5-4df6-8b47-288459f3a73c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:05.420911 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-66f2bc54-9ad5-4df6-8b47-288459f3a73c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:05.421745 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-66f2bc54-9ad5-4df6-8b47-288459f3a73c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:05.422704 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-66f2bc54-9ad5-4df6-8b47-288459f3a73c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:05.423301 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-66f2bc54-9ad5-4df6-8b47-288459f3a73c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:05.493813 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8269964e-4a5d-48f6-9730-4bd7be288d8f tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:05.494702 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8269964e-4a5d-48f6-9730-4bd7be288d8f tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:05.505544 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8269964e-4a5d-48f6-9730-4bd7be288d8f tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:05.506009 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8269964e-4a5d-48f6-9730-4bd7be288d8f tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:05.506795 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8269964e-4a5d-48f6-9730-4bd7be288d8f tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:05.507235 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8269964e-4a5d-48f6-9730-4bd7be288d8f tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:05.677643 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-66f2bc54-9ad5-4df6-8b47-288459f3a73c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:05.698766 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-66f2bc54-9ad5-4df6-8b47-288459f3a73c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:05.701679 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-66f2bc54-9ad5-4df6-8b47-288459f3a73c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:05.709317 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-66f2bc54-9ad5-4df6-8b47-288459f3a73c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 2919 microversion: 2.42 time: 0.301275 Jul 12 12:02:05.711954 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1463/2735] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:05 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 2919 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:05.739947 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-c7ad1f1a-e544-4001-83fe-888b4082587d req-6aacb5c0-f480-46aa-9f13-be4453814f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-unplugged", "status": "completed", "tag": "05e9b75d-65e4-454a-9576-1b50e1900608"}, {"server_uuid": "deab1788-4378-44fc-8c70-3f3e04bf5e35", "name": "network-vif-plugged", "status": "completed", "tag": "70ebfb7f-2f94-4495-80d6-8b78bfd503e1"}, {"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-unplugged", "status": "completed", "tag": "e5630fc7-2a37-4d64-8b42-4467055177db"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:05.766587 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-c7ad1f1a-e544-4001-83fe-888b4082587d req-6aacb5c0-f480-46aa-9f13-be4453814f43 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:05.766931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-c7ad1f1a-e544-4001-83fe-888b4082587d req-6aacb5c0-f480-46aa-9f13-be4453814f43 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:05.794409 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-c7ad1f1a-e544-4001-83fe-888b4082587d req-6aacb5c0-f480-46aa-9f13-be4453814f43 service nova] Creating event network-vif-unplugged:05e9b75d-65e4-454a-9576-1b50e1900608 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 12:02:05.798136 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-c7ad1f1a-e544-4001-83fe-888b4082587d req-6aacb5c0-f480-46aa-9f13-be4453814f43 service nova] Creating event network-vif-plugged:70ebfb7f-2f94-4495-80d6-8b78bfd503e1 for instance deab1788-4378-44fc-8c70-3f3e04bf5e35 on n-h1-849104-4 Jul 12 12:02:05.798743 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-c7ad1f1a-e544-4001-83fe-888b4082587d req-6aacb5c0-f480-46aa-9f13-be4453814f43 service nova] Creating event network-vif-unplugged:e5630fc7-2a37-4d64-8b42-4467055177db for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 12:02:05.823950 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-c7ad1f1a-e544-4001-83fe-888b4082587d req-6aacb5c0-f480-46aa-9f13-be4453814f43 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.091433 Jul 12 12:02:05.829221 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1464/2736] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:05.846162 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-8269964e-4a5d-48f6-9730-4bd7be288d8f tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'services' on Instance uuid 6834c01a-284c-47fc-8939-403833f0ebd8 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:02:05.878324 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8269964e-4a5d-48f6-9730-4bd7be288d8f tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1966 microversion: 2.25 time: 0.852053 Jul 12 12:02:05.879658 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1273/2737] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:05 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1966 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:05.901324 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-96ca70b2-4d1d-471b-888d-5fd5ec466732 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:05.901324 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-96ca70b2-4d1d-471b-888d-5fd5ec466732 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:05.910346 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-96ca70b2-4d1d-471b-888d-5fd5ec466732 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:05.910996 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-96ca70b2-4d1d-471b-888d-5fd5ec466732 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:05.912018 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-96ca70b2-4d1d-471b-888d-5fd5ec466732 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:05.912806 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-96ca70b2-4d1d-471b-888d-5fd5ec466732 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:06.042538 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7fc988f6-6898-47cc-b88e-a5edbf6f74b8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:06.044514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7fc988f6-6898-47cc-b88e-a5edbf6f74b8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:06.054337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7fc988f6-6898-47cc-b88e-a5edbf6f74b8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:06.057020 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7fc988f6-6898-47cc-b88e-a5edbf6f74b8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:06.058843 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7fc988f6-6898-47cc-b88e-a5edbf6f74b8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:06.064285 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7fc988f6-6898-47cc-b88e-a5edbf6f74b8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:06.208938 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-96ca70b2-4d1d-471b-888d-5fd5ec466732 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'services' on Instance uuid 6834c01a-284c-47fc-8939-403833f0ebd8 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:02:06.213653 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:06.236495 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-96ca70b2-4d1d-471b-888d-5fd5ec466732 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1966 microversion: 2.25 time: 0.343172 Jul 12 12:02:06.239776 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1465/2738] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:05 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1966 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:06.437502 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7fc988f6-6898-47cc-b88e-a5edbf6f74b8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:06.447242 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7fc988f6-6898-47cc-b88e-a5edbf6f74b8 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1323 microversion: 2.1 time: 0.408840 Jul 12 12:02:06.458666 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1274/2739] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:06 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1323 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:02:06.463874 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f1dd2cba-5b97-4783-a10a-e5bba4f50104 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:06.464708 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f1dd2cba-5b97-4783-a10a-e5bba4f50104 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:06.473017 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f1dd2cba-5b97-4783-a10a-e5bba4f50104 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:06.473746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f1dd2cba-5b97-4783-a10a-e5bba4f50104 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:06.474684 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f1dd2cba-5b97-4783-a10a-e5bba4f50104 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:06.475273 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f1dd2cba-5b97-4783-a10a-e5bba4f50104 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:06.561536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1520074561", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": "none"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:06.668786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:02:06.669231 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:02:06.669737 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:02:06.670160 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:02:06.670760 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:02:06.703477 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:06.703477 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:06.703477 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:06.703477 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:06.741850 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Getting quotas for project 499ed556665744c1bbeff02b60965343. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:02:06.752335 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Getting quotas for user e9eb93594c074611b82b9723c964cbe7 and project 499ed556665744c1bbeff02b60965343. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:02:06.771540 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 12:02:06.773962 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:02:06.829626 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0a76a44e-2f4b-47b6-a650-6a2f51607d48 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.587785 Jul 12 12:02:06.830900 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1466/2740] 10.222.0.50 () {62 vars in 1187 bytes} [Tue Jul 12 12:02:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 12:02:06.832572 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f1dd2cba-5b97-4783-a10a-e5bba4f50104 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:06.840948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d12ba933-6b67-480d-8900-3d5ca03695ef tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:06.842984 n-d-849104-4 devstack@n-api.service[125984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 12:02:06.842984 n-d-849104-4 devstack@n-api.service[125984]: warnings.warn(msg) Jul 12 12:02:06.844871 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d12ba933-6b67-480d-8900-3d5ca03695ef tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:06.845993 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f1dd2cba-5b97-4783-a10a-e5bba4f50104 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1514 microversion: 2.1 time: 0.382167 Jul 12 12:02:06.846791 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d12ba933-6b67-480d-8900-3d5ca03695ef tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:06.847545 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1275/2741] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:06 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1514 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:06.848237 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d12ba933-6b67-480d-8900-3d5ca03695ef tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:06.848687 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d12ba933-6b67-480d-8900-3d5ca03695ef tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:06.863293 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0cd9aead-0b0f-4e36-bf45-20abe67f824e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:06.864448 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0cd9aead-0b0f-4e36-bf45-20abe67f824e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:06.881954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0cd9aead-0b0f-4e36-bf45-20abe67f824e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:06.882168 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d12ba933-6b67-480d-8900-3d5ca03695ef tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.050033 Jul 12 12:02:06.888704 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1467/2742] 10.222.0.50 () {60 vars in 1216 bytes} [Tue Jul 12 12:02:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 12:02:06.889484 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-74fef735-6b1d-4b80-92e9-b01fe0daee27 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:06.890468 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0cd9aead-0b0f-4e36-bf45-20abe67f824e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:06.890799 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-74fef735-6b1d-4b80-92e9-b01fe0daee27 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:06.891817 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0cd9aead-0b0f-4e36-bf45-20abe67f824e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:06.892491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0cd9aead-0b0f-4e36-bf45-20abe67f824e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:06.898213 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74fef735-6b1d-4b80-92e9-b01fe0daee27 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:06.898412 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74fef735-6b1d-4b80-92e9-b01fe0daee27 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:06.899348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74fef735-6b1d-4b80-92e9-b01fe0daee27 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:06.900158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-74fef735-6b1d-4b80-92e9-b01fe0daee27 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:07.131813 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0cd9aead-0b0f-4e36-bf45-20abe67f824e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:07.140447 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0cd9aead-0b0f-4e36-bf45-20abe67f824e tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.290637 Jul 12 12:02:07.153411 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1276/2743] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:06 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:07.176420 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2283d29d-edb8-4d61-80d4-8ca8b909ed57 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:07.177654 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2283d29d-edb8-4d61-80d4-8ca8b909ed57 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:07.194271 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-74fef735-6b1d-4b80-92e9-b01fe0daee27 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:07.196976 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:07.208244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-74fef735-6b1d-4b80-92e9-b01fe0daee27 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:07.210390 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-74fef735-6b1d-4b80-92e9-b01fe0daee27 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:07.212876 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-74fef735-6b1d-4b80-92e9-b01fe0daee27 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 2872 microversion: 2.42 time: 0.328143 Jul 12 12:02:07.213784 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1468/2744] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:06 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 2872 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:07.219926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b06a9892-c9c2-4ce6-9bce-fd7f17eb4899 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849104-4", "block_migration": "auto"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:07.221130 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b06a9892-c9c2-4ce6-9bce-fd7f17eb4899 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:07.235450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b06a9892-c9c2-4ce6-9bce-fd7f17eb4899 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:07.238038 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b06a9892-c9c2-4ce6-9bce-fd7f17eb4899 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:07.251117 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2283d29d-edb8-4d61-80d4-8ca8b909ed57 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:07.255515 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b06a9892-c9c2-4ce6-9bce-fd7f17eb4899 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:07.256246 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b06a9892-c9c2-4ce6-9bce-fd7f17eb4899 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:07.264339 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2283d29d-edb8-4d61-80d4-8ca8b909ed57 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:07.266636 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2283d29d-edb8-4d61-80d4-8ca8b909ed57 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:07.281121 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2283d29d-edb8-4d61-80d4-8ca8b909ed57 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1278 microversion: 2.57 time: 0.117033 Jul 12 12:02:07.282142 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1277/2745] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:07 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1278 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:07.293929 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-8b0ffcf4-b40f-4fe2-a509-7db245b8785e req-515fe613-8ed4-4798-b8a5-b2fe4cfc8f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-deleted", "tag": "f4cee665-cebb-4239-899b-d9d2a125a5c3"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:07.303866 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-b06a9892-c9c2-4ce6-9bce-fd7f17eb4899 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'flavor' on Instance uuid 6834c01a-284c-47fc-8939-403833f0ebd8 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:02:07.319064 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-8b0ffcf4-b40f-4fe2-a509-7db245b8785e req-515fe613-8ed4-4798-b8a5-b2fe4cfc8f56 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:07.320719 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-8b0ffcf4-b40f-4fe2-a509-7db245b8785e req-515fe613-8ed4-4798-b8a5-b2fe4cfc8f56 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:07.337709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b06a9892-c9c2-4ce6-9bce-fd7f17eb4899 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Going to try to live migrate instance to n-h2-849104-4 {{(pid=125984) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 12 12:02:07.354229 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-8b0ffcf4-b40f-4fe2-a509-7db245b8785e req-515fe613-8ed4-4798-b8a5-b2fe4cfc8f56 service nova] Creating event network-vif-deleted:f4cee665-cebb-4239-899b-d9d2a125a5c3 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 12:02:07.374405 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-8b0ffcf4-b40f-4fe2-a509-7db245b8785e req-515fe613-8ed4-4798-b8a5-b2fe4cfc8f56 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090655 Jul 12 12:02:07.375386 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1278/2746] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:07.472326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d4c72b09-ba1d-4059-9a1b-b62088860b32 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:07.473736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d4c72b09-ba1d-4059-9a1b-b62088860b32 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:07.495132 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d4c72b09-ba1d-4059-9a1b-b62088860b32 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:07.495415 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d4c72b09-ba1d-4059-9a1b-b62088860b32 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:07.496788 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d4c72b09-ba1d-4059-9a1b-b62088860b32 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:07.497492 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d4c72b09-ba1d-4059-9a1b-b62088860b32 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:07.731642 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d4c72b09-ba1d-4059-9a1b-b62088860b32 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:07.743086 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:07.749206 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d4c72b09-ba1d-4059-9a1b-b62088860b32 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1323 microversion: 2.1 time: 0.286119 Jul 12 12:02:07.749833 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1279/2747] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:07 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1323 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:07.851173 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-c295b7b1-82ac-4564-8c0a-c881b56ee3ba req-e2ae0644-2f5a-4f5d-baa6-5977cedebf4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-unplugged", "status": "completed", "tag": "c0a4bf74-eaa2-46bb-97d3-902c76d0da52"}, {"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-unplugged", "status": "completed", "tag": "f4cee665-cebb-4239-899b-d9d2a125a5c3"}, {"server_uuid": "21a370a2-ee60-46d7-8b18-3f5bf976e8bc", "name": "network-vif-plugged", "status": "completed", "tag": "e0ad7f75-136c-4075-bed4-139c20d686f7"}, {"server_uuid": "0eefd015-61dc-4aea-8dc9-4faabaf9a869", "name": "network-vif-plugged", "status": "completed", "tag": "bfc5370e-ce21-4218-be02-49f52a93b0ba"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:07.863270 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-c295b7b1-82ac-4564-8c0a-c881b56ee3ba req-e2ae0644-2f5a-4f5d-baa6-5977cedebf4a service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:07.863714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-c295b7b1-82ac-4564-8c0a-c881b56ee3ba req-e2ae0644-2f5a-4f5d-baa6-5977cedebf4a service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:07.880602 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-c295b7b1-82ac-4564-8c0a-c881b56ee3ba req-e2ae0644-2f5a-4f5d-baa6-5977cedebf4a service nova] Creating event network-vif-unplugged:c0a4bf74-eaa2-46bb-97d3-902c76d0da52 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 12:02:07.881112 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-c295b7b1-82ac-4564-8c0a-c881b56ee3ba req-e2ae0644-2f5a-4f5d-baa6-5977cedebf4a service nova] Creating event network-vif-unplugged:f4cee665-cebb-4239-899b-d9d2a125a5c3 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 12:02:07.881609 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-c295b7b1-82ac-4564-8c0a-c881b56ee3ba req-e2ae0644-2f5a-4f5d-baa6-5977cedebf4a service nova] Creating event network-vif-plugged:e0ad7f75-136c-4075-bed4-139c20d686f7 for instance 21a370a2-ee60-46d7-8b18-3f5bf976e8bc on n-h2-849104-4 Jul 12 12:02:07.882102 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-c295b7b1-82ac-4564-8c0a-c881b56ee3ba req-e2ae0644-2f5a-4f5d-baa6-5977cedebf4a service nova] Creating event network-vif-plugged:bfc5370e-ce21-4218-be02-49f52a93b0ba for instance 0eefd015-61dc-4aea-8dc9-4faabaf9a869 on n-h1-849104-4 Jul 12 12:02:07.892855 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-c295b7b1-82ac-4564-8c0a-c881b56ee3ba req-e2ae0644-2f5a-4f5d-baa6-5977cedebf4a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.046176 Jul 12 12:02:07.893582 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1280/2748] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:02:07.899061 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4fa4e677-d658-40bf-b049-fceabcadf50b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:07.899775 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4fa4e677-d658-40bf-b049-fceabcadf50b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:07.908477 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4fa4e677-d658-40bf-b049-fceabcadf50b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:07.908906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4fa4e677-d658-40bf-b049-fceabcadf50b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:07.914491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4fa4e677-d658-40bf-b049-fceabcadf50b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:07.915000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4fa4e677-d658-40bf-b049-fceabcadf50b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:08.345245 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4fa4e677-d658-40bf-b049-fceabcadf50b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:08.361153 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4fa4e677-d658-40bf-b049-fceabcadf50b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1520 microversion: 2.1 time: 0.466254 Jul 12 12:02:08.361756 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1281/2749] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:07 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1520 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:08.366465 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-370a909e-5b60-4d74-965d-1245a1458921 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:08.367077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-370a909e-5b60-4d74-965d-1245a1458921 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:08.388723 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-370a909e-5b60-4d74-965d-1245a1458921 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:08.389711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-370a909e-5b60-4d74-965d-1245a1458921 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:08.391198 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-370a909e-5b60-4d74-965d-1245a1458921 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:08.392213 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-370a909e-5b60-4d74-965d-1245a1458921 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:08.902537 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-370a909e-5b60-4d74-965d-1245a1458921 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:08.916772 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-370a909e-5b60-4d74-965d-1245a1458921 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.553524 Jul 12 12:02:08.918279 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1282/2750] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:08 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:08.938303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d6b138b3-6f5d-4c8e-9176-1e6698a64627 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:08.939474 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d6b138b3-6f5d-4c8e-9176-1e6698a64627 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:08.951564 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d6b138b3-6f5d-4c8e-9176-1e6698a64627 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:08.952412 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d6b138b3-6f5d-4c8e-9176-1e6698a64627 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:08.953874 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d6b138b3-6f5d-4c8e-9176-1e6698a64627 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:08.954683 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d6b138b3-6f5d-4c8e-9176-1e6698a64627 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:09.399598 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d6b138b3-6f5d-4c8e-9176-1e6698a64627 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:09.409813 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d6b138b3-6f5d-4c8e-9176-1e6698a64627 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:09.411790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d6b138b3-6f5d-4c8e-9176-1e6698a64627 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:09.413072 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d6b138b3-6f5d-4c8e-9176-1e6698a64627 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 2758 microversion: 2.42 time: 0.493605 Jul 12 12:02:09.426308 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1283/2751] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:08 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 2758 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:09.427098 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f6657597-be69-4c33-8896-e95c038a3489 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:09.427954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f6657597-be69-4c33-8896-e95c038a3489 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:09.435486 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f6657597-be69-4c33-8896-e95c038a3489 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:09.436108 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f6657597-be69-4c33-8896-e95c038a3489 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:09.437308 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f6657597-be69-4c33-8896-e95c038a3489 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:09.438262 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f6657597-be69-4c33-8896-e95c038a3489 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:09.535942 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f6657597-be69-4c33-8896-e95c038a3489 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:09.545837 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f6657597-be69-4c33-8896-e95c038a3489 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:09.547576 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f6657597-be69-4c33-8896-e95c038a3489 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:09.548745 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f6657597-be69-4c33-8896-e95c038a3489 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1348 microversion: 2.57 time: 0.126409 Jul 12 12:02:09.549311 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1284/2752] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:09 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1348 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:09.553764 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2a5ed08a-bf07-4122-a49e-d4830f420650 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:09.554356 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2a5ed08a-bf07-4122-a49e-d4830f420650 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:09.565181 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2a5ed08a-bf07-4122-a49e-d4830f420650 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:09.565638 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2a5ed08a-bf07-4122-a49e-d4830f420650 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:09.566425 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2a5ed08a-bf07-4122-a49e-d4830f420650 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:09.566875 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2a5ed08a-bf07-4122-a49e-d4830f420650 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:09.685955 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b06a9892-c9c2-4ce6-9bce-fd7f17eb4899 tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8/action" status: 202 len: 0 microversion: 2.25 time: 2.470545 Jul 12 12:02:09.686783 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1469/2753] 10.222.0.50 () {62 vars in 1318 bytes} [Tue Jul 12 12:02:07 2022] POST /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8/action => generated 0 bytes in 2472 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:02:09.703700 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d53b2d33-c3dc-4b99-baf8-aec2c22ad448 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:09.704381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d53b2d33-c3dc-4b99-baf8-aec2c22ad448 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:09.747227 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d53b2d33-c3dc-4b99-baf8-aec2c22ad448 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:09.747933 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d53b2d33-c3dc-4b99-baf8-aec2c22ad448 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:09.749339 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d53b2d33-c3dc-4b99-baf8-aec2c22ad448 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:09.749798 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d53b2d33-c3dc-4b99-baf8-aec2c22ad448 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:09.913154 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2a5ed08a-bf07-4122-a49e-d4830f420650 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:09.947075 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2a5ed08a-bf07-4122-a49e-d4830f420650 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1323 microversion: 2.1 time: 0.396532 Jul 12 12:02:09.947595 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1285/2754] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:09 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1323 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:09.962343 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-79a73784-e3d5-460f-962e-95ad1d23297c req-df458275-0250-4fed-b16e-db23b0e423b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-deleted", "tag": "c0a4bf74-eaa2-46bb-97d3-902c76d0da52"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:09.972509 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-79a73784-e3d5-460f-962e-95ad1d23297c req-df458275-0250-4fed-b16e-db23b0e423b0 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:09.972965 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-79a73784-e3d5-460f-962e-95ad1d23297c req-df458275-0250-4fed-b16e-db23b0e423b0 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:09.991839 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-79a73784-e3d5-460f-962e-95ad1d23297c req-df458275-0250-4fed-b16e-db23b0e423b0 service nova] Creating event network-vif-deleted:c0a4bf74-eaa2-46bb-97d3-902c76d0da52 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 12:02:09.999342 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-79a73784-e3d5-460f-962e-95ad1d23297c req-df458275-0250-4fed-b16e-db23b0e423b0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039596 Jul 12 12:02:09.999987 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1286/2755] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:10.012398 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-59301161-55ef-46ab-b264-29c6ddf3ec44 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:10.013206 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-59301161-55ef-46ab-b264-29c6ddf3ec44 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:10.025309 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-59301161-55ef-46ab-b264-29c6ddf3ec44 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:10.026221 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-59301161-55ef-46ab-b264-29c6ddf3ec44 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:10.027657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-59301161-55ef-46ab-b264-29c6ddf3ec44 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:10.028455 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-59301161-55ef-46ab-b264-29c6ddf3ec44 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:10.075884 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d53b2d33-c3dc-4b99-baf8-aec2c22ad448 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:10.098036 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d53b2d33-c3dc-4b99-baf8-aec2c22ad448 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1520 microversion: 2.1 time: 0.397905 Jul 12 12:02:10.099402 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1470/2756] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:09 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1520 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:10.108434 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-90397a29-9686-479c-881d-9cc07e3725b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:10.109500 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-90397a29-9686-479c-881d-9cc07e3725b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:10.118135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90397a29-9686-479c-881d-9cc07e3725b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:10.118637 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90397a29-9686-479c-881d-9cc07e3725b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:10.119586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90397a29-9686-479c-881d-9cc07e3725b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:10.120077 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-90397a29-9686-479c-881d-9cc07e3725b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:10.317138 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-90397a29-9686-479c-881d-9cc07e3725b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:10.325385 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-90397a29-9686-479c-881d-9cc07e3725b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.223802 Jul 12 12:02:10.326046 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1471/2757] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:10 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:10.336321 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-59301161-55ef-46ab-b264-29c6ddf3ec44 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:10.344527 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-59301161-55ef-46ab-b264-29c6ddf3ec44 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:10.346174 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-59301161-55ef-46ab-b264-29c6ddf3ec44 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:10.347350 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-59301161-55ef-46ab-b264-29c6ddf3ec44 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.346012 Jul 12 12:02:10.347977 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1287/2758] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:10 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:10.438826 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a1a8f934-9dd2-48d6-b33e-a553d0489be3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:10.439618 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a1a8f934-9dd2-48d6-b33e-a553d0489be3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:10.449858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a1a8f934-9dd2-48d6-b33e-a553d0489be3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:10.450512 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a1a8f934-9dd2-48d6-b33e-a553d0489be3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:10.452363 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a1a8f934-9dd2-48d6-b33e-a553d0489be3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:10.453002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a1a8f934-9dd2-48d6-b33e-a553d0489be3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:10.569903 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-446a8883-b47a-42a1-8058-5b09d0220c4d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:10.570912 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-446a8883-b47a-42a1-8058-5b09d0220c4d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:10.581269 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-446a8883-b47a-42a1-8058-5b09d0220c4d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:10.582190 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-446a8883-b47a-42a1-8058-5b09d0220c4d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:10.583504 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-446a8883-b47a-42a1-8058-5b09d0220c4d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:10.584240 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-446a8883-b47a-42a1-8058-5b09d0220c4d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:10.659266 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a1a8f934-9dd2-48d6-b33e-a553d0489be3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:10.670394 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a1a8f934-9dd2-48d6-b33e-a553d0489be3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:10.672271 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a1a8f934-9dd2-48d6-b33e-a553d0489be3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:10.673625 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a1a8f934-9dd2-48d6-b33e-a553d0489be3 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 2597 microversion: 2.42 time: 0.241135 Jul 12 12:02:10.674349 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1472/2759] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:10 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 2597 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:10.702999 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-446a8883-b47a-42a1-8058-5b09d0220c4d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:10.711378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-446a8883-b47a-42a1-8058-5b09d0220c4d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:10.713462 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-446a8883-b47a-42a1-8058-5b09d0220c4d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:10.714912 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-446a8883-b47a-42a1-8058-5b09d0220c4d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1336 microversion: 2.57 time: 0.149664 Jul 12 12:02:10.720110 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1288/2760] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:10 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1336 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:10.870321 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-b05acb7f-c890-4b36-8f7f-ce54a35fbdeb req-f751bca3-7e85-4f23-81ae-16ee819892c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd4cf5e-cd93-4202-815d-87eb5305f5ee", "name": "network-vif-plugged", "status": "completed", "tag": "59c136a8-69e4-4426-bca5-83e039980105"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:10.875379 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:10.883592 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b05acb7f-c890-4b36-8f7f-ce54a35fbdeb req-f751bca3-7e85-4f23-81ae-16ee819892c6 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:10.884331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b05acb7f-c890-4b36-8f7f-ce54a35fbdeb req-f751bca3-7e85-4f23-81ae-16ee819892c6 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:10.899449 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-b05acb7f-c890-4b36-8f7f-ce54a35fbdeb req-f751bca3-7e85-4f23-81ae-16ee819892c6 service nova] Creating event network-vif-plugged:59c136a8-69e4-4426-bca5-83e039980105 for instance 5cd4cf5e-cd93-4202-815d-87eb5305f5ee on n-h2-849104-4 Jul 12 12:02:10.908244 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-b05acb7f-c890-4b36-8f7f-ce54a35fbdeb req-f751bca3-7e85-4f23-81ae-16ee819892c6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041104 Jul 12 12:02:10.909280 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1473/2761] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:10.965446 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-61085fd5-9d9f-46fa-8966-c0b0c9c13305 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:10.966524 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-61085fd5-9d9f-46fa-8966-c0b0c9c13305 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:10.974783 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-61085fd5-9d9f-46fa-8966-c0b0c9c13305 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:10.975319 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-61085fd5-9d9f-46fa-8966-c0b0c9c13305 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:10.976183 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-61085fd5-9d9f-46fa-8966-c0b0c9c13305 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:10.976626 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-61085fd5-9d9f-46fa-8966-c0b0c9c13305 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:11.122041 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1c5ab73e-a255-4c70-be66-0917b7b739d6 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:11.124200 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1c5ab73e-a255-4c70-be66-0917b7b739d6 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:11.134862 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c5ab73e-a255-4c70-be66-0917b7b739d6 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:11.135547 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c5ab73e-a255-4c70-be66-0917b7b739d6 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:11.136598 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c5ab73e-a255-4c70-be66-0917b7b739d6 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:11.137088 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1c5ab73e-a255-4c70-be66-0917b7b739d6 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:11.195301 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-61085fd5-9d9f-46fa-8966-c0b0c9c13305 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:11.204398 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-61085fd5-9d9f-46fa-8966-c0b0c9c13305 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1515 microversion: 2.1 time: 0.243794 Jul 12 12:02:11.205310 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1289/2762] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:10 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:11.226208 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1bac72f2-20c5-466d-ae7b-5f8d8b4f28fb tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:11.227689 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1bac72f2-20c5-466d-ae7b-5f8d8b4f28fb tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 21a370a2-ee60-46d7-8b18-3f5bf976e8bc] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:11.236626 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1bac72f2-20c5-466d-ae7b-5f8d8b4f28fb tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:11.237337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1bac72f2-20c5-466d-ae7b-5f8d8b4f28fb tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:11.238522 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1bac72f2-20c5-466d-ae7b-5f8d8b4f28fb tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:11.239107 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1bac72f2-20c5-466d-ae7b-5f8d8b4f28fb tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:11.331913 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1c5ab73e-a255-4c70-be66-0917b7b739d6 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:11.345868 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1c5ab73e-a255-4c70-be66-0917b7b739d6 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1520 microversion: 2.1 time: 0.230325 Jul 12 12:02:11.347745 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1474/2763] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:11 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:11.357915 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-632f0045-7957-40c7-8802-8b0e32de377d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:11.359939 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-632f0045-7957-40c7-8802-8b0e32de377d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:11.375310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-632f0045-7957-40c7-8802-8b0e32de377d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:11.375769 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-632f0045-7957-40c7-8802-8b0e32de377d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:11.376827 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-632f0045-7957-40c7-8802-8b0e32de377d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:11.377428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-632f0045-7957-40c7-8802-8b0e32de377d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:11.414774 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1bac72f2-20c5-466d-ae7b-5f8d8b4f28fb tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:11.427529 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1bac72f2-20c5-466d-ae7b-5f8d8b4f28fb tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/21a370a2-ee60-46d7-8b18-3f5bf976e8bc" status: 200 len: 1515 microversion: 2.1 time: 0.208867 Jul 12 12:02:11.428726 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1290/2764] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:11 2022] GET /compute/v2.1/servers/21a370a2-ee60-46d7-8b18-3f5bf976e8bc => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:11.439257 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8ae9818a-5bac-4b4f-9ed6-d3601ad5975c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:11.440604 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8ae9818a-5bac-4b4f-9ed6-d3601ad5975c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:11.448283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ae9818a-5bac-4b4f-9ed6-d3601ad5975c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:11.448741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ae9818a-5bac-4b4f-9ed6-d3601ad5975c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:11.449656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ae9818a-5bac-4b4f-9ed6-d3601ad5975c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:11.450195 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8ae9818a-5bac-4b4f-9ed6-d3601ad5975c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:11.547629 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-632f0045-7957-40c7-8802-8b0e32de377d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:11.558545 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-632f0045-7957-40c7-8802-8b0e32de377d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.207626 Jul 12 12:02:11.560208 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1475/2765] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:11 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:11.576895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0ca909b1-d87c-4807-8786-1d4c46c06600 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:11.577967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0ca909b1-d87c-4807-8786-1d4c46c06600 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: deab1788-4378-44fc-8c70-3f3e04bf5e35] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:11.586377 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ca909b1-d87c-4807-8786-1d4c46c06600 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:11.587590 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ca909b1-d87c-4807-8786-1d4c46c06600 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:11.589250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ca909b1-d87c-4807-8786-1d4c46c06600 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:11.590066 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0ca909b1-d87c-4807-8786-1d4c46c06600 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:11.806336 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8ae9818a-5bac-4b4f-9ed6-d3601ad5975c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:11.815738 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8ae9818a-5bac-4b4f-9ed6-d3601ad5975c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:11.817699 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8ae9818a-5bac-4b4f-9ed6-d3601ad5975c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:11.819889 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8ae9818a-5bac-4b4f-9ed6-d3601ad5975c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.388497 Jul 12 12:02:11.821117 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1291/2766] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:11 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:11.826278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-37b4b3b3-83fb-4952-8272-4b843691a009 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:11.827788 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-37b4b3b3-83fb-4952-8272-4b843691a009 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:11.836196 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37b4b3b3-83fb-4952-8272-4b843691a009 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:11.837225 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37b4b3b3-83fb-4952-8272-4b843691a009 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:11.838287 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37b4b3b3-83fb-4952-8272-4b843691a009 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:11.838852 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37b4b3b3-83fb-4952-8272-4b843691a009 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:11.858399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0ca909b1-d87c-4807-8786-1d4c46c06600 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:11.869260 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0ca909b1-d87c-4807-8786-1d4c46c06600 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35" status: 200 len: 1515 microversion: 2.1 time: 0.307645 Jul 12 12:02:11.870623 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1476/2767] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:11 2022] GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35 => generated 1515 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:11.877380 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5fdd877f-f616-4fa4-ae92-0a28ae1050b2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:11.877995 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5fdd877f-f616-4fa4-ae92-0a28ae1050b2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:11.885263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5fdd877f-f616-4fa4-ae92-0a28ae1050b2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:11.885714 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5fdd877f-f616-4fa4-ae92-0a28ae1050b2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:11.886530 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5fdd877f-f616-4fa4-ae92-0a28ae1050b2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:11.887010 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5fdd877f-f616-4fa4-ae92-0a28ae1050b2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:12.081425 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5fdd877f-f616-4fa4-ae92-0a28ae1050b2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:12.106349 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5fdd877f-f616-4fa4-ae92-0a28ae1050b2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:12.117287 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5fdd877f-f616-4fa4-ae92-0a28ae1050b2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:12.119899 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5fdd877f-f616-4fa4-ae92-0a28ae1050b2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1336 microversion: 2.57 time: 0.246602 Jul 12 12:02:12.128591 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1477/2768] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:11 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1336 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:12.141960 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-92a6c73b-e026-439d-b635-cfe69c00fb0c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:12.142285 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-92a6c73b-e026-439d-b635-cfe69c00fb0c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: deab1788-4378-44fc-8c70-3f3e04bf5e35] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:12.149600 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-92a6c73b-e026-439d-b635-cfe69c00fb0c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:12.150054 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-92a6c73b-e026-439d-b635-cfe69c00fb0c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:12.150846 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-92a6c73b-e026-439d-b635-cfe69c00fb0c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:12.151279 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-92a6c73b-e026-439d-b635-cfe69c00fb0c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:12.186055 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-92a6c73b-e026-439d-b635-cfe69c00fb0c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: deab1788-4378-44fc-8c70-3f3e04bf5e35] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:02:12.251076 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-37b4b3b3-83fb-4952-8272-4b843691a009 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:12.263323 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-37b4b3b3-83fb-4952-8272-4b843691a009 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:12.265518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-37b4b3b3-83fb-4952-8272-4b843691a009 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:12.267628 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-37b4b3b3-83fb-4952-8272-4b843691a009 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 2550 microversion: 2.42 time: 0.445052 Jul 12 12:02:12.268573 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1292/2769] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:11 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 2550 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:12.294457 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-c32246ab-13ca-4335-b808-25b704715844 req-2e72d20d-35cb-4905-8fe6-2a07e6fd9f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-deleted", "tag": "05e9b75d-65e4-454a-9576-1b50e1900608"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:12.305139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-c32246ab-13ca-4335-b808-25b704715844 req-2e72d20d-35cb-4905-8fe6-2a07e6fd9f3e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:12.305947 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-c32246ab-13ca-4335-b808-25b704715844 req-2e72d20d-35cb-4905-8fe6-2a07e6fd9f3e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:12.326484 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-92a6c73b-e026-439d-b635-cfe69c00fb0c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "DELETE /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35" status: 204 len: 0 microversion: 2.1 time: 0.195347 Jul 12 12:02:12.328595 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-c32246ab-13ca-4335-b808-25b704715844 req-2e72d20d-35cb-4905-8fe6-2a07e6fd9f3e service nova] Creating event network-vif-deleted:05e9b75d-65e4-454a-9576-1b50e1900608 for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 12:02:12.333763 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1478/2770] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:02:12 2022] DELETE /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:02:12.339335 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-c32246ab-13ca-4335-b808-25b704715844 req-2e72d20d-35cb-4905-8fe6-2a07e6fd9f3e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055527 Jul 12 12:02:12.341099 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1293/2771] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:12.351846 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-85d301ef-04c5-4610-9196-8a3214c82654 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:12.351846 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-85d301ef-04c5-4610-9196-8a3214c82654 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: deab1788-4378-44fc-8c70-3f3e04bf5e35] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:12.365598 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-894d7ccc-fc96-43ae-b66d-1b3c0f50f8b4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:12.366349 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-894d7ccc-fc96-43ae-b66d-1b3c0f50f8b4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:12.376525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-85d301ef-04c5-4610-9196-8a3214c82654 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:12.377094 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-85d301ef-04c5-4610-9196-8a3214c82654 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:12.377744 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-894d7ccc-fc96-43ae-b66d-1b3c0f50f8b4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:12.378199 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-894d7ccc-fc96-43ae-b66d-1b3c0f50f8b4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:12.378510 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-85d301ef-04c5-4610-9196-8a3214c82654 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:12.379509 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-85d301ef-04c5-4610-9196-8a3214c82654 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:12.386304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-894d7ccc-fc96-43ae-b66d-1b3c0f50f8b4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:12.387027 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-894d7ccc-fc96-43ae-b66d-1b3c0f50f8b4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:12.645375 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-85d301ef-04c5-4610-9196-8a3214c82654 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:12.656829 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-85d301ef-04c5-4610-9196-8a3214c82654 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35" status: 200 len: 1521 microversion: 2.1 time: 0.321098 Jul 12 12:02:12.657416 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1479/2772] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:12 2022] GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:12.662342 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3b94809f-fd0d-45a3-bc90-de266ce8e48f tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:12.662955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3b94809f-fd0d-45a3-bc90-de266ce8e48f tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:12.669616 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3b94809f-fd0d-45a3-bc90-de266ce8e48f tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:12.670078 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3b94809f-fd0d-45a3-bc90-de266ce8e48f tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:12.670865 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3b94809f-fd0d-45a3-bc90-de266ce8e48f tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:12.671471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3b94809f-fd0d-45a3-bc90-de266ce8e48f tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:12.738524 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-894d7ccc-fc96-43ae-b66d-1b3c0f50f8b4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:12.751287 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-894d7ccc-fc96-43ae-b66d-1b3c0f50f8b4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1520 microversion: 2.1 time: 0.390444 Jul 12 12:02:12.753328 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1294/2773] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:12 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:02:12.844233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ca56fee3-e121-4d6c-919c-259384bd988b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:12.844752 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ca56fee3-e121-4d6c-919c-259384bd988b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:12.851441 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca56fee3-e121-4d6c-919c-259384bd988b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:12.851892 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca56fee3-e121-4d6c-919c-259384bd988b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:12.852860 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca56fee3-e121-4d6c-919c-259384bd988b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:12.853298 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ca56fee3-e121-4d6c-919c-259384bd988b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:12.858319 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3b94809f-fd0d-45a3-bc90-de266ce8e48f tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:12.863630 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:12.870113 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3b94809f-fd0d-45a3-bc90-de266ce8e48f tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.211447 Jul 12 12:02:12.870973 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1480/2774] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:12 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:13.010650 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ca56fee3-e121-4d6c-919c-259384bd988b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:13.019320 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ca56fee3-e121-4d6c-919c-259384bd988b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:13.020867 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ca56fee3-e121-4d6c-919c-259384bd988b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:13.022030 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ca56fee3-e121-4d6c-919c-259384bd988b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.183019 Jul 12 12:02:13.022597 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1295/2775] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:12 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:13.150942 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b55b6f7e-4efa-4aef-82d6-5350cf098b7a tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:13.151558 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b55b6f7e-4efa-4aef-82d6-5350cf098b7a tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:13.161240 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b55b6f7e-4efa-4aef-82d6-5350cf098b7a tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:13.161814 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b55b6f7e-4efa-4aef-82d6-5350cf098b7a tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:13.162700 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b55b6f7e-4efa-4aef-82d6-5350cf098b7a tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:13.163241 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b55b6f7e-4efa-4aef-82d6-5350cf098b7a tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:13.283348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b55b6f7e-4efa-4aef-82d6-5350cf098b7a tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:13.293768 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-695d4928-1d17-4bdc-9ffe-28b50303ceb7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:13.294431 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-695d4928-1d17-4bdc-9ffe-28b50303ceb7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:13.302035 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-695d4928-1d17-4bdc-9ffe-28b50303ceb7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:13.302987 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-695d4928-1d17-4bdc-9ffe-28b50303ceb7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:13.304236 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-695d4928-1d17-4bdc-9ffe-28b50303ceb7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:13.304856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-695d4928-1d17-4bdc-9ffe-28b50303ceb7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:13.315835 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b55b6f7e-4efa-4aef-82d6-5350cf098b7a tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:13.318540 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b55b6f7e-4efa-4aef-82d6-5350cf098b7a tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:13.320954 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b55b6f7e-4efa-4aef-82d6-5350cf098b7a tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1336 microversion: 2.57 time: 0.173290 Jul 12 12:02:13.322435 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1481/2776] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:13 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1336 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:13.573695 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-695d4928-1d17-4bdc-9ffe-28b50303ceb7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:13.587320 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-695d4928-1d17-4bdc-9ffe-28b50303ceb7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:13.590048 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-695d4928-1d17-4bdc-9ffe-28b50303ceb7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:13.591824 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-695d4928-1d17-4bdc-9ffe-28b50303ceb7 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 2212 microversion: 2.42 time: 0.306786 Jul 12 12:02:13.592671 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1296/2777] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:13 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 2212 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:13.681411 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-11027095-e1a0-41e7-8b28-10077fb9c491 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:13.682154 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-11027095-e1a0-41e7-8b28-10077fb9c491 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: deab1788-4378-44fc-8c70-3f3e04bf5e35] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:13.696843 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-11027095-e1a0-41e7-8b28-10077fb9c491 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:13.697734 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-11027095-e1a0-41e7-8b28-10077fb9c491 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:13.698969 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-11027095-e1a0-41e7-8b28-10077fb9c491 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:13.699801 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-11027095-e1a0-41e7-8b28-10077fb9c491 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:13.772777 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4bdbb454-2d05-4b99-8dc1-22fab4229748 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:13.774467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4bdbb454-2d05-4b99-8dc1-22fab4229748 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:13.787262 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4bdbb454-2d05-4b99-8dc1-22fab4229748 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:13.787757 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4bdbb454-2d05-4b99-8dc1-22fab4229748 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:13.789068 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4bdbb454-2d05-4b99-8dc1-22fab4229748 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:13.789635 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4bdbb454-2d05-4b99-8dc1-22fab4229748 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:13.978476 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-11027095-e1a0-41e7-8b28-10077fb9c491 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:13.986930 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-11027095-e1a0-41e7-8b28-10077fb9c491 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35" status: 200 len: 1521 microversion: 2.1 time: 0.310789 Jul 12 12:02:13.987517 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1482/2778] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:13 2022] GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:02:13.992163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c888ac98-d7e7-47c2-8100-9b75cebc10bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:13.992780 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c888ac98-d7e7-47c2-8100-9b75cebc10bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:14.004944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c888ac98-d7e7-47c2-8100-9b75cebc10bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:14.004944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c888ac98-d7e7-47c2-8100-9b75cebc10bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:14.004944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c888ac98-d7e7-47c2-8100-9b75cebc10bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:14.004944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c888ac98-d7e7-47c2-8100-9b75cebc10bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:14.150482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4bdbb454-2d05-4b99-8dc1-22fab4229748 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:14.171460 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4bdbb454-2d05-4b99-8dc1-22fab4229748 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1520 microversion: 2.1 time: 0.403588 Jul 12 12:02:14.172854 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1297/2779] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:13 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1520 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:14.202458 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ee6c8f04-dccd-46ca-b1ba-43e83baa3058 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:14.203705 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ee6c8f04-dccd-46ca-b1ba-43e83baa3058 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:14.217640 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee6c8f04-dccd-46ca-b1ba-43e83baa3058 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:14.218357 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee6c8f04-dccd-46ca-b1ba-43e83baa3058 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:14.219691 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee6c8f04-dccd-46ca-b1ba-43e83baa3058 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:14.220336 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee6c8f04-dccd-46ca-b1ba-43e83baa3058 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:14.255741 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:14.258408 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c888ac98-d7e7-47c2-8100-9b75cebc10bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:14.288689 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c888ac98-d7e7-47c2-8100-9b75cebc10bd tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.297224 Jul 12 12:02:14.306101 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1483/2780] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:13 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:14.366464 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cd1ca215-8240-4a6a-9500-1e2aeb74e455 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:14.366947 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cd1ca215-8240-4a6a-9500-1e2aeb74e455 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:14.376419 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd1ca215-8240-4a6a-9500-1e2aeb74e455 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:14.377199 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd1ca215-8240-4a6a-9500-1e2aeb74e455 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:14.378062 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd1ca215-8240-4a6a-9500-1e2aeb74e455 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:14.378702 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd1ca215-8240-4a6a-9500-1e2aeb74e455 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:14.489172 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cd1ca215-8240-4a6a-9500-1e2aeb74e455 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:14.500424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cd1ca215-8240-4a6a-9500-1e2aeb74e455 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:14.501989 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cd1ca215-8240-4a6a-9500-1e2aeb74e455 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:14.503375 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cd1ca215-8240-4a6a-9500-1e2aeb74e455 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1357 microversion: 2.57 time: 0.155102 Jul 12 12:02:14.504010 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1484/2781] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:14 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:14.508782 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-a72435be-b3fc-4765-990a-7d00e0628978 req-e4fd022d-2bf0-4763-a712-fd79cab555e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-deleted", "tag": "e5630fc7-2a37-4d64-8b42-4467055177db"}, {"server_uuid": "bf15ce48-6829-4bdf-9b73-570b093f9725", "name": "network-vif-deleted", "tag": "89649079-3e25-40bb-b461-65345a57ea7f"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:14.519938 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-a72435be-b3fc-4765-990a-7d00e0628978 req-e4fd022d-2bf0-4763-a712-fd79cab555e7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:14.520450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-a72435be-b3fc-4765-990a-7d00e0628978 req-e4fd022d-2bf0-4763-a712-fd79cab555e7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:14.554090 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-a72435be-b3fc-4765-990a-7d00e0628978 req-e4fd022d-2bf0-4763-a712-fd79cab555e7 service nova] Creating event network-vif-deleted:e5630fc7-2a37-4d64-8b42-4467055177db for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 12:02:14.554784 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-a72435be-b3fc-4765-990a-7d00e0628978 req-e4fd022d-2bf0-4763-a712-fd79cab555e7 service nova] Creating event network-vif-deleted:89649079-3e25-40bb-b461-65345a57ea7f for instance bf15ce48-6829-4bdf-9b73-570b093f9725 on n-h2-849104-4 Jul 12 12:02:14.562225 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-a72435be-b3fc-4765-990a-7d00e0628978 req-e4fd022d-2bf0-4763-a712-fd79cab555e7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056765 Jul 12 12:02:14.563526 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1485/2782] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:14.569291 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e"}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:14.571419 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:14.579348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:14.579733 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:14.580701 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:14.581160 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:14.625324 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ee6c8f04-dccd-46ca-b1ba-43e83baa3058 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:14.657958 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ee6c8f04-dccd-46ca-b1ba-43e83baa3058 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:14.662363 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ee6c8f04-dccd-46ca-b1ba-43e83baa3058 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:14.665916 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ee6c8f04-dccd-46ca-b1ba-43e83baa3058 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.490462 Jul 12 12:02:14.667547 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1298/2783] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:14 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:14.676423 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4842f06b-f65f-4399-b753-31b47b4c3b69 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:14.677521 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4842f06b-f65f-4399-b753-31b47b4c3b69 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:14.691585 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4842f06b-f65f-4399-b753-31b47b4c3b69 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:14.692647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4842f06b-f65f-4399-b753-31b47b4c3b69 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:14.694467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4842f06b-f65f-4399-b753-31b47b4c3b69 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:14.696283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4842f06b-f65f-4399-b753-31b47b4c3b69 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:14.727398 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:02:14.728607 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:02:14.731162 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:02:14.732344 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:02:14.733398 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:02:14.820771 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4842f06b-f65f-4399-b753-31b47b4c3b69 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:14.836229 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4842f06b-f65f-4399-b753-31b47b4c3b69 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:14.838001 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4842f06b-f65f-4399-b753-31b47b4c3b69 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:14.839456 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4842f06b-f65f-4399-b753-31b47b4c3b69 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.169997 Jul 12 12:02:14.840770 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1299/2784] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:14 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:14.918092 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:14.950547 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:14.951426 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:14.953530 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:14.954446 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:15.009340 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-92a396fa-9b1b-4e66-8c9d-71b17da30b44 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:15.013863 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-92a396fa-9b1b-4e66-8c9d-71b17da30b44 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: deab1788-4378-44fc-8c70-3f3e04bf5e35] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:15.017529 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e6b8e6dd-801c-47d3-a7b9-29ba6a09d89b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "POST /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25/action" status: 202 len: 1138 microversion: 2.57 time: 0.452708 Jul 12 12:02:15.028176 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1486/2785] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Jul 12 12:02:14 2022] POST /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25/action => generated 1138 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 12 12:02:15.049918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9f82ce6b-b4cc-4d01-8c8b-6ae808ac7922 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:15.058165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9f82ce6b-b4cc-4d01-8c8b-6ae808ac7922 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:15.062626 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-92a396fa-9b1b-4e66-8c9d-71b17da30b44 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:15.063181 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-92a396fa-9b1b-4e66-8c9d-71b17da30b44 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:15.072072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-92a396fa-9b1b-4e66-8c9d-71b17da30b44 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:15.072631 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-92a396fa-9b1b-4e66-8c9d-71b17da30b44 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:15.094609 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9f82ce6b-b4cc-4d01-8c8b-6ae808ac7922 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:15.102538 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9f82ce6b-b4cc-4d01-8c8b-6ae808ac7922 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:15.107608 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9f82ce6b-b4cc-4d01-8c8b-6ae808ac7922 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:15.112267 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9f82ce6b-b4cc-4d01-8c8b-6ae808ac7922 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:15.190637 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-92a396fa-9b1b-4e66-8c9d-71b17da30b44 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:15.191100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-92a396fa-9b1b-4e66-8c9d-71b17da30b44 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:15.192900 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-92a396fa-9b1b-4e66-8c9d-71b17da30b44 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lazy-loading 'fault' on Instance uuid deab1788-4378-44fc-8c70-3f3e04bf5e35 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:02:15.271394 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-92a396fa-9b1b-4e66-8c9d-71b17da30b44 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:15.282602 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-92a396fa-9b1b-4e66-8c9d-71b17da30b44 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35" status: 200 len: 1313 microversion: 2.1 time: 0.280798 Jul 12 12:02:15.283197 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1300/2786] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:14 2022] GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:15.288581 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c4b9787d-c0f4-4c0c-99db-dccd86edae6b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:15.289421 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c4b9787d-c0f4-4c0c-99db-dccd86edae6b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:15.297891 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c4b9787d-c0f4-4c0c-99db-dccd86edae6b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:15.298579 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c4b9787d-c0f4-4c0c-99db-dccd86edae6b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:15.299562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c4b9787d-c0f4-4c0c-99db-dccd86edae6b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:15.300005 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c4b9787d-c0f4-4c0c-99db-dccd86edae6b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:15.382913 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9f82ce6b-b4cc-4d01-8c8b-6ae808ac7922 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:15.412106 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9f82ce6b-b4cc-4d01-8c8b-6ae808ac7922 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:15.416700 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9f82ce6b-b4cc-4d01-8c8b-6ae808ac7922 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:15.419479 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9f82ce6b-b4cc-4d01-8c8b-6ae808ac7922 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.378325 Jul 12 12:02:15.433886 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1487/2787] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:15 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:15.449403 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b5517e67-9384-4dbb-afb9-ade08021cc39 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:15.450127 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b5517e67-9384-4dbb-afb9-ade08021cc39 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:15.488727 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b5517e67-9384-4dbb-afb9-ade08021cc39 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:15.489197 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b5517e67-9384-4dbb-afb9-ade08021cc39 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:15.490434 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b5517e67-9384-4dbb-afb9-ade08021cc39 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:15.501755 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b5517e67-9384-4dbb-afb9-ade08021cc39 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:15.607677 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c4b9787d-c0f4-4c0c-99db-dccd86edae6b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:15.637779 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c4b9787d-c0f4-4c0c-99db-dccd86edae6b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1520 microversion: 2.1 time: 0.353267 Jul 12 12:02:15.647759 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1301/2788] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:15 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:15.690890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ae852489-e499-44c9-aa08-5a153d231aa6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:15.691779 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ae852489-e499-44c9-aa08-5a153d231aa6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:15.711837 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae852489-e499-44c9-aa08-5a153d231aa6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:15.712357 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae852489-e499-44c9-aa08-5a153d231aa6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:15.713166 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae852489-e499-44c9-aa08-5a153d231aa6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:15.713627 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae852489-e499-44c9-aa08-5a153d231aa6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:15.806573 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b5517e67-9384-4dbb-afb9-ade08021cc39 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:15.825266 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b5517e67-9384-4dbb-afb9-ade08021cc39 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.386921 Jul 12 12:02:15.831237 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1488/2789] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:15 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:15.878997 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5216595a-b5d2-42d7-9a3d-2231efe18969 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:15.879812 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5216595a-b5d2-42d7-9a3d-2231efe18969 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:15.887589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5216595a-b5d2-42d7-9a3d-2231efe18969 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:15.888074 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5216595a-b5d2-42d7-9a3d-2231efe18969 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:15.889067 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5216595a-b5d2-42d7-9a3d-2231efe18969 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:15.889637 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5216595a-b5d2-42d7-9a3d-2231efe18969 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:15.959123 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ae852489-e499-44c9-aa08-5a153d231aa6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:15.960621 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5216595a-b5d2-42d7-9a3d-2231efe18969 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:15.968938 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ae852489-e499-44c9-aa08-5a153d231aa6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:15.970719 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ae852489-e499-44c9-aa08-5a153d231aa6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:15.971940 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5216595a-b5d2-42d7-9a3d-2231efe18969 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:15.972092 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ae852489-e499-44c9-aa08-5a153d231aa6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.288857 Jul 12 12:02:15.973101 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1302/2790] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:15 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:15.973575 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5216595a-b5d2-42d7-9a3d-2231efe18969 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:15.974768 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5216595a-b5d2-42d7-9a3d-2231efe18969 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.104661 Jul 12 12:02:15.975458 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1489/2791] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:15 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:16.303651 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3a0e7f29-575c-48ee-8fae-cee3dada69e4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:16.304874 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3a0e7f29-575c-48ee-8fae-cee3dada69e4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: deab1788-4378-44fc-8c70-3f3e04bf5e35] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:16.314514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a0e7f29-575c-48ee-8fae-cee3dada69e4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:16.314975 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a0e7f29-575c-48ee-8fae-cee3dada69e4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:16.315920 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a0e7f29-575c-48ee-8fae-cee3dada69e4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:16.316416 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a0e7f29-575c-48ee-8fae-cee3dada69e4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:16.353739 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a0e7f29-575c-48ee-8fae-cee3dada69e4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:16.354259 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a0e7f29-575c-48ee-8fae-cee3dada69e4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:16.354724 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-3a0e7f29-575c-48ee-8fae-cee3dada69e4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lazy-loading 'fault' on Instance uuid deab1788-4378-44fc-8c70-3f3e04bf5e35 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:02:16.403708 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3a0e7f29-575c-48ee-8fae-cee3dada69e4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:16.412656 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3a0e7f29-575c-48ee-8fae-cee3dada69e4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35" status: 200 len: 1313 microversion: 2.1 time: 0.114624 Jul 12 12:02:16.413474 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1303/2792] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:16 2022] GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35 => generated 1313 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:16.443562 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-61f3441c-af7c-4cce-a02a-9ab082cd3cef tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:16.444487 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-61f3441c-af7c-4cce-a02a-9ab082cd3cef tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:16.452331 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61f3441c-af7c-4cce-a02a-9ab082cd3cef tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:16.452824 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61f3441c-af7c-4cce-a02a-9ab082cd3cef tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:16.453936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61f3441c-af7c-4cce-a02a-9ab082cd3cef tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:16.454404 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61f3441c-af7c-4cce-a02a-9ab082cd3cef tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:16.542600 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-61f3441c-af7c-4cce-a02a-9ab082cd3cef tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:16.553573 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-61f3441c-af7c-4cce-a02a-9ab082cd3cef tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:16.555832 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-61f3441c-af7c-4cce-a02a-9ab082cd3cef tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:16.557245 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-61f3441c-af7c-4cce-a02a-9ab082cd3cef tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.119164 Jul 12 12:02:16.557818 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1490/2793] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:16 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:16.596712 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-d3f69cac-b9b6-46e5-adea-0ebaa140be26 req-af7fb436-767e-4e00-b27a-43ec619e80a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deab1788-4378-44fc-8c70-3f3e04bf5e35", "name": "network-vif-deleted", "tag": "70ebfb7f-2f94-4495-80d6-8b78bfd503e1"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:16.605881 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-d3f69cac-b9b6-46e5-adea-0ebaa140be26 req-af7fb436-767e-4e00-b27a-43ec619e80a8 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:16.606319 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-d3f69cac-b9b6-46e5-adea-0ebaa140be26 req-af7fb436-767e-4e00-b27a-43ec619e80a8 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:16.626372 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-d3f69cac-b9b6-46e5-adea-0ebaa140be26 req-af7fb436-767e-4e00-b27a-43ec619e80a8 service nova] Creating event network-vif-deleted:70ebfb7f-2f94-4495-80d6-8b78bfd503e1 for instance deab1788-4378-44fc-8c70-3f3e04bf5e35 on n-h1-849104-4 Jul 12 12:02:16.632757 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-d3f69cac-b9b6-46e5-adea-0ebaa140be26 req-af7fb436-767e-4e00-b27a-43ec619e80a8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039902 Jul 12 12:02:16.633960 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1304/2794] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:16.658411 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-644d293d-8058-4f1e-8065-9a30836c6f00 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:16.659261 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-644d293d-8058-4f1e-8065-9a30836c6f00 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:16.670399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-644d293d-8058-4f1e-8065-9a30836c6f00 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:16.670856 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-644d293d-8058-4f1e-8065-9a30836c6f00 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:16.671713 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-644d293d-8058-4f1e-8065-9a30836c6f00 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:16.672364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-644d293d-8058-4f1e-8065-9a30836c6f00 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:16.763232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:16.851673 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e0b03d81-761e-4bc3-af84-0fb27ab489b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:16.855318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e0b03d81-761e-4bc3-af84-0fb27ab489b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:16.858241 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-644d293d-8058-4f1e-8065-9a30836c6f00 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:16.861435 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=4 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:16.872452 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0b03d81-761e-4bc3-af84-0fb27ab489b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:16.873839 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0b03d81-761e-4bc3-af84-0fb27ab489b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:16.875660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0b03d81-761e-4bc3-af84-0fb27ab489b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:16.876381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0b03d81-761e-4bc3-af84-0fb27ab489b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:16.884598 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-644d293d-8058-4f1e-8065-9a30836c6f00 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1505 microversion: 2.1 time: 0.230332 Jul 12 12:02:16.887746 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1491/2795] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:16 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:16.909754 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-55cf6a7d-4835-4a38-852f-5265a8fdc776 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:16.910694 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-55cf6a7d-4835-4a38-852f-5265a8fdc776 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:16.918709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-55cf6a7d-4835-4a38-852f-5265a8fdc776 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:16.920265 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-55cf6a7d-4835-4a38-852f-5265a8fdc776 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:16.921226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-55cf6a7d-4835-4a38-852f-5265a8fdc776 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:16.922032 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-55cf6a7d-4835-4a38-852f-5265a8fdc776 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.088576 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-55cf6a7d-4835-4a38-852f-5265a8fdc776 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.098824 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-55cf6a7d-4835-4a38-852f-5265a8fdc776 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 200 len: 1505 microversion: 2.1 time: 0.193438 Jul 12 12:02:17.108253 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1492/2796] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:16 2022] GET /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:17.116635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7d2be031-6e63-4671-a12e-a33940e6f2bf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:17.117930 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7d2be031-6e63-4671-a12e-a33940e6f2bf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:17.129528 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d2be031-6e63-4671-a12e-a33940e6f2bf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.130451 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d2be031-6e63-4671-a12e-a33940e6f2bf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.131996 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d2be031-6e63-4671-a12e-a33940e6f2bf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.132900 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d2be031-6e63-4671-a12e-a33940e6f2bf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.255624 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:17.312625 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7d2be031-6e63-4671-a12e-a33940e6f2bf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.321482 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7d2be031-6e63-4671-a12e-a33940e6f2bf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.323229 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-7d2be031-6e63-4671-a12e-a33940e6f2bf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.325188 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7d2be031-6e63-4671-a12e-a33940e6f2bf tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.222607 Jul 12 12:02:17.336063 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1493/2797] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:17 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:17.336063 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-37b4b412-837c-48a0-a2a4-c9dc0e2ee232 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:17.336063 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-37b4b412-837c-48a0-a2a4-c9dc0e2ee232 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:17.342946 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-37b4b412-837c-48a0-a2a4-c9dc0e2ee232 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.343735 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-37b4b412-837c-48a0-a2a4-c9dc0e2ee232 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.344897 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-37b4b412-837c-48a0-a2a4-c9dc0e2ee232 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.345583 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-37b4b412-837c-48a0-a2a4-c9dc0e2ee232 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.420630 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-37b4b412-837c-48a0-a2a4-c9dc0e2ee232 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.435096 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-37b4b412-837c-48a0-a2a4-c9dc0e2ee232 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.437181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-37b4b412-837c-48a0-a2a4-c9dc0e2ee232 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.438758 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-37b4b412-837c-48a0-a2a4-c9dc0e2ee232 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.111861 Jul 12 12:02:17.450909 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1494/2798] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:17 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:17.450909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d14af5c8-1eb9-4a49-8d2f-a3cb7c0c5338 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:17.450909 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d14af5c8-1eb9-4a49-8d2f-a3cb7c0c5338 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:17.452051 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e0b03d81-761e-4bc3-af84-0fb27ab489b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.455838 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d14af5c8-1eb9-4a49-8d2f-a3cb7c0c5338 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.456365 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e0b03d81-761e-4bc3-af84-0fb27ab489b8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.612780 Jul 12 12:02:17.456626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d14af5c8-1eb9-4a49-8d2f-a3cb7c0c5338 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.457538 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d14af5c8-1eb9-4a49-8d2f-a3cb7c0c5338 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.458085 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d14af5c8-1eb9-4a49-8d2f-a3cb7c0c5338 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.465811 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1305/2799] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:16 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:17.471393 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2f8bf5b2-8c6a-47db-ad7b-6bfb0ad057af tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:17.472130 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2f8bf5b2-8c6a-47db-ad7b-6bfb0ad057af tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: deab1788-4378-44fc-8c70-3f3e04bf5e35] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:17.479084 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2f8bf5b2-8c6a-47db-ad7b-6bfb0ad057af tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.479609 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2f8bf5b2-8c6a-47db-ad7b-6bfb0ad057af tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.480726 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2f8bf5b2-8c6a-47db-ad7b-6bfb0ad057af tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.481202 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2f8bf5b2-8c6a-47db-ad7b-6bfb0ad057af tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.492764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d14af5c8-1eb9-4a49-8d2f-a3cb7c0c5338 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 5cd4cf5e-cd93-4202-815d-87eb5305f5ee] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:02:17.497431 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-2f8bf5b2-8c6a-47db-ad7b-6bfb0ad057af tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] HTTP exception thrown: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2f8bf5b2-8c6a-47db-ad7b-6bfb0ad057af tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Request method failure captured: Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35 HTTP/1.1 Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWKmL0PKu8GjRTBtrrj_XvDRihVt_MuektaWxa6CfzloD9ekS9qZdVQ4oe9i4P4S-sJiMxLYuTn6LFZ9bHkolEieelEaxnmdYmd57GIt7in5-bZLcX7SM1m9CXjODzzHpltCdNceTRsFxCjXDr7THU09TjKzxvaDSSpcvI59WyyJ66A Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f630a8015def485db0ac46681a162960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f630a8015def485db0ac46681a162960", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: f0c8a66c40024ed4b583cf187350a9e0 Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'deab1788-4378-44fc-8c70-3f3e04bf5e35'} Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:17.499430 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.505126 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:17.505126 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:17.505126 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:17.505126 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:02:17.505126 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:02:17.505126 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:17.505126 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.505126 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2f8bf5b2-8c6a-47db-ad7b-6bfb0ad057af tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Returning 404 to user: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:02:17.505126 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2f8bf5b2-8c6a-47db-ad7b-6bfb0ad057af tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35" status: 404 len: 111 microversion: 2.1 time: 0.033810 Jul 12 12:02:17.505899 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1306/2800] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:17 2022] GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 12:02:17.510743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-cc28c35a-e65b-4d62-aa9d-1caca3dbe14d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:17.515114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-cc28c35a-e65b-4d62-aa9d-1caca3dbe14d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.516134 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-cc28c35a-e65b-4d62-aa9d-1caca3dbe14d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'f630a8015def485db0ac46681a162960'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:02:17.519891 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:17.522391 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cc28c35a-e65b-4d62-aa9d-1caca3dbe14d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.522906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cc28c35a-e65b-4d62-aa9d-1caca3dbe14d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.523706 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cc28c35a-e65b-4d62-aa9d-1caca3dbe14d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.524169 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-cc28c35a-e65b-4d62-aa9d-1caca3dbe14d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.609519 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d14af5c8-1eb9-4a49-8d2f-a3cb7c0c5338 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee" status: 204 len: 0 microversion: 2.1 time: 0.166520 Jul 12 12:02:17.614988 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1495/2801] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:02:17 2022] DELETE /compute/v2.1/servers/5cd4cf5e-cd93-4202-815d-87eb5305f5ee => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:02:17.631647 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-cc28c35a-e65b-4d62-aa9d-1caca3dbe14d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.120247 Jul 12 12:02:17.631858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5eb74877-bf32-4d72-ba2e-5bdaea622fbc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:17.631858 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5eb74877-bf32-4d72-ba2e-5bdaea622fbc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:17.633933 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1307/2802] 10.222.0.50 () {58 vars in 1229 bytes} [Tue Jul 12 12:02:17 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 12:02:17.638709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5eb74877-bf32-4d72-ba2e-5bdaea622fbc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.639342 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5eb74877-bf32-4d72-ba2e-5bdaea622fbc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.640284 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5eb74877-bf32-4d72-ba2e-5bdaea622fbc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.640570 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1b732f5a-67ad-449c-bd90-aa560b30f345 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:17.641073 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5eb74877-bf32-4d72-ba2e-5bdaea622fbc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1b732f5a-67ad-449c-bd90-aa560b30f345 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Request method failure captured: Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWKmL0PKu8GjRTBtrrj_XvDRihVt_MuektaWxa6CfzloD9ekS9qZdVQ4oe9i4P4S-sJiMxLYuTn6LFZ9bHkolEieelEaxnmdYmd57GIt7in5-bZLcX7SM1m9CXjODzzHpltCdNceTRsFxCjXDr7THU09TjKzxvaDSSpcvI59WyyJ66A Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f630a8015def485db0ac46681a162960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f630a8015def485db0ac46681a162960", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: f0c8a66c40024ed4b583cf187350a9e0 Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: action_args: {} Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise error Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 12 12:02:17.643396 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1b732f5a-67ad-449c-bd90-aa560b30f345 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1b732f5a-67ad-449c-bd90-aa560b30f345 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.010078 Jul 12 12:02:17.650637 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1308/2803] 10.222.0.50 () {58 vars in 1181 bytes} [Tue Jul 12 12:02:17 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 12:02:17.657565 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b59c5880-afab-4f28-a193-5a9ab5713d66 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:17.661732 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b59c5880-afab-4f28-a193-5a9ab5713d66 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.662514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b59c5880-afab-4f28-a193-5a9ab5713d66 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Searching by: {'deleted': False, 'project_id': 'f630a8015def485db0ac46681a162960'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:02:17.670397 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b59c5880-afab-4f28-a193-5a9ab5713d66 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.671000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b59c5880-afab-4f28-a193-5a9ab5713d66 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.671962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b59c5880-afab-4f28-a193-5a9ab5713d66 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.672598 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b59c5880-afab-4f28-a193-5a9ab5713d66 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.703512 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.multi_cell_list [None req-b59c5880-afab-4f28-a193-5a9ab5713d66 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:02:17.742490 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b59c5880-afab-4f28-a193-5a9ab5713d66 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.089589 Jul 12 12:02:17.743284 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1309/2804] 10.222.0.50 () {58 vars in 1124 bytes} [Tue Jul 12 12:02:17 2022] GET /compute/v2.1/servers => generated 683 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:17.752653 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5eb74877-bf32-4d72-ba2e-5bdaea622fbc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.755329 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8028779f-c67c-4361-862c-795bfd93982f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:17.759222 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8028779f-c67c-4361-862c-795bfd93982f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.759883 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.compute.servers [None req-8028779f-c67c-4361-862c-795bfd93982f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Removing options 'limit' from query {{(pid=125983) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 12 12:02:17.761180 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8028779f-c67c-4361-862c-795bfd93982f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Searching by: {'deleted': False, 'project_id': 'f630a8015def485db0ac46681a162960'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:02:17.767394 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5eb74877-bf32-4d72-ba2e-5bdaea622fbc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.768555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8028779f-c67c-4361-862c-795bfd93982f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.769713 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8028779f-c67c-4361-862c-795bfd93982f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.770830 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8028779f-c67c-4361-862c-795bfd93982f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.771320 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8028779f-c67c-4361-862c-795bfd93982f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.772165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5eb74877-bf32-4d72-ba2e-5bdaea622fbc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.773934 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5eb74877-bf32-4d72-ba2e-5bdaea622fbc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.161035 Jul 12 12:02:17.775283 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1496/2805] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:17 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:17.797711 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-360428670", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "f4ac0726-e839-448f-a6d9-960e0dc48281"}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:17.813562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.multi_cell_list [None req-8028779f-c67c-4361-862c-795bfd93982f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=125983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:02:17.858268 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8028779f-c67c-4361-862c-795bfd93982f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.105973 Jul 12 12:02:17.859684 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1310/2806] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Jul 12 12:02:17 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:02:17.870397 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8c3d4e9d-bc2e-4647-a9f6-1b38616c41e6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:17.872120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] validate_networks() for [('f4ac0726-e839-448f-a6d9-960e0dc48281', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8c3d4e9d-bc2e-4647-a9f6-1b38616c41e6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Request method failure captured: Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWKmL0PKu8GjRTBtrrj_XvDRihVt_MuektaWxa6CfzloD9ekS9qZdVQ4oe9i4P4S-sJiMxLYuTn6LFZ9bHkolEieelEaxnmdYmd57GIt7in5-bZLcX7SM1m9CXjODzzHpltCdNceTRsFxCjXDr7THU09TjKzxvaDSSpcvI59WyyJ66A Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f630a8015def485db0ac46681a162960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f630a8015def485db0ac46681a162960", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: f0c8a66c40024ed4b583cf187350a9e0 Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: action_args: {} Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise error Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi '-1' Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 12 12:02:17.873862 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8c3d4e9d-bc2e-4647-a9f6-1b38616c41e6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8c3d4e9d-bc2e-4647-a9f6-1b38616c41e6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.008808 Jul 12 12:02:17.883475 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1311/2807] 10.222.0.50 () {58 vars in 1141 bytes} [Tue Jul 12 12:02:17 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 12:02:17.893837 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5b6c2605-4240-4867-a2b8-1085c947122b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5b6c2605-4240-4867-a2b8-1085c947122b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Request method failure captured: Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWKmL0PKu8GjRTBtrrj_XvDRihVt_MuektaWxa6CfzloD9ekS9qZdVQ4oe9i4P4S-sJiMxLYuTn6LFZ9bHkolEieelEaxnmdYmd57GIt7in5-bZLcX7SM1m9CXjODzzHpltCdNceTRsFxCjXDr7THU09TjKzxvaDSSpcvI59WyyJ66A Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f630a8015def485db0ac46681a162960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f630a8015def485db0ac46681a162960", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: f0c8a66c40024ed4b583cf187350a9e0 Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: action_args: {} Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise error Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi 'testing' Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 12 12:02:17.898761 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5b6c2605-4240-4867-a2b8-1085c947122b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:02:17.905498 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5b6c2605-4240-4867-a2b8-1085c947122b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.016879 Jul 12 12:02:17.910237 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1312/2808] 10.222.0.50 () {58 vars in 1151 bytes} [Tue Jul 12 12:02:17 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 12:02:17.919932 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c9adfc37-3d0e-4c13-8f2b-95f8f60045c4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:17.924117 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c9adfc37-3d0e-4c13-8f2b-95f8f60045c4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.925003 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c9adfc37-3d0e-4c13-8f2b-95f8f60045c4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'f630a8015def485db0ac46681a162960'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:02:17.932515 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.compute.servers [None req-c9adfc37-3d0e-4c13-8f2b-95f8f60045c4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Flavor 'non_existing_flavor' could not be found {{(pid=125983) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 12 12:02:17.934306 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c9adfc37-3d0e-4c13-8f2b-95f8f60045c4 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.018272 Jul 12 12:02:17.935374 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1313/2809] 10.222.0.50 () {58 vars in 1177 bytes} [Tue Jul 12 12:02:17 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 12:02:17.947561 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-18f90052-793d-4bdf-ba99-1ae06519be3d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:17.951572 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-18f90052-793d-4bdf-ba99-1ae06519be3d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:17.952269 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-18f90052-793d-4bdf-ba99-1ae06519be3d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'f630a8015def485db0ac46681a162960'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:02:17.958351 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-18f90052-793d-4bdf-ba99-1ae06519be3d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.958797 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-18f90052-793d-4bdf-ba99-1ae06519be3d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:17.959594 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-18f90052-793d-4bdf-ba99-1ae06519be3d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:17.960047 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-18f90052-793d-4bdf-ba99-1ae06519be3d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:18.397216 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:02:18.398280 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:02:18.400292 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:02:18.400731 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:02:18.401328 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:02:18.415449 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:18.416256 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:18.417388 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:18.418589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:18.427300 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-18f90052-793d-4bdf-ba99-1ae06519be3d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.483084 Jul 12 12:02:18.428264 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1314/2810] 10.222.0.50 () {58 vars in 1173 bytes} [Tue Jul 12 12:02:17 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 12:02:18.439243 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e604c0de-63d4-460f-9435-5400eb99e4f2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:18.440383 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e604c0de-63d4-460f-9435-5400eb99e4f2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:18.445775 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Getting quotas for project b4d3ca9b6340438c998a53df6dd73496. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:02:18.450329 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e604c0de-63d4-460f-9435-5400eb99e4f2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:18.453562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e604c0de-63d4-460f-9435-5400eb99e4f2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:18.453562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e604c0de-63d4-460f-9435-5400eb99e4f2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:18.454100 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Getting quotas for user 7302f396799e41a28b8dec72fb3fc6db and project b4d3ca9b6340438c998a53df6dd73496. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:02:18.454798 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e604c0de-63d4-460f-9435-5400eb99e4f2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:18.476049 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 12:02:18.481673 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:02:18.553813 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3c424ce4-4fac-4d43-8278-70b618b3c40b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760489 Jul 12 12:02:18.555357 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1497/2811] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 12:02:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 12:02:18.565692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-dcfff5e3-76bf-4579-a175-c38dae7bb5e1 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:18.573055 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-dcfff5e3-76bf-4579-a175-c38dae7bb5e1 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:18.574969 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-dcfff5e3-76bf-4579-a175-c38dae7bb5e1 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'f630a8015def485db0ac46681a162960'} {{(pid=125984) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:02:18.585983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcfff5e3-76bf-4579-a175-c38dae7bb5e1 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:18.586780 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcfff5e3-76bf-4579-a175-c38dae7bb5e1 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:18.588303 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcfff5e3-76bf-4579-a175-c38dae7bb5e1 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:18.589194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-dcfff5e3-76bf-4579-a175-c38dae7bb5e1 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:18.681458 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e604c0de-63d4-460f-9435-5400eb99e4f2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:18.694974 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e604c0de-63d4-460f-9435-5400eb99e4f2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:18.697272 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e604c0de-63d4-460f-9435-5400eb99e4f2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:18.704054 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e604c0de-63d4-460f-9435-5400eb99e4f2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.274482 Jul 12 12:02:18.718833 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1315/2812] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:18 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:18.727354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-55c63b5b-c5ad-4918-8240-ae34bad12328 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:18.729051 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-55c63b5b-c5ad-4918-8240-ae34bad12328 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:18.737610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55c63b5b-c5ad-4918-8240-ae34bad12328 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:18.738074 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55c63b5b-c5ad-4918-8240-ae34bad12328 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:18.739043 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55c63b5b-c5ad-4918-8240-ae34bad12328 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:18.739542 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-55c63b5b-c5ad-4918-8240-ae34bad12328 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:18.767495 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-dcfff5e3-76bf-4579-a175-c38dae7bb5e1 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.209982 Jul 12 12:02:18.769111 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1498/2813] 10.222.0.50 () {58 vars in 1183 bytes} [Tue Jul 12 12:02:18 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 12:02:18.783704 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9c4b0034-cfc9-41d5-a1c7-7116ea56e5e6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:18.786005 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9c4b0034-cfc9-41d5-a1c7-7116ea56e5e6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:18.798896 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c4b0034-cfc9-41d5-a1c7-7116ea56e5e6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:18.799692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c4b0034-cfc9-41d5-a1c7-7116ea56e5e6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:18.801158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c4b0034-cfc9-41d5-a1c7-7116ea56e5e6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:18.802002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9c4b0034-cfc9-41d5-a1c7-7116ea56e5e6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:18.832934 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-55c63b5b-c5ad-4918-8240-ae34bad12328 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:18.843316 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-55c63b5b-c5ad-4918-8240-ae34bad12328 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:18.845736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-55c63b5b-c5ad-4918-8240-ae34bad12328 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:18.847160 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-55c63b5b-c5ad-4918-8240-ae34bad12328 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.126956 Jul 12 12:02:18.848664 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1316/2814] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:18 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:18.853775 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-faa0afee-920a-4f88-abb7-6cdf81ff3c97 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:18.854532 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-faa0afee-920a-4f88-abb7-6cdf81ff3c97 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:18.970830 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-faa0afee-920a-4f88-abb7-6cdf81ff3c97 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:18.984158 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-faa0afee-920a-4f88-abb7-6cdf81ff3c97 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1217 microversion: 2.1 time: 0.133985 Jul 12 12:02:18.985225 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1317/2815] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:18 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:19.018419 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f72acdf2-4e25-488c-bf11-cd24f863788b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:19.028553 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f72acdf2-4e25-488c-bf11-cd24f863788b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:19.031008 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f72acdf2-4e25-488c-bf11-cd24f863788b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Searching by: {'deleted': False, 'project_id': 'f630a8015def485db0ac46681a162960'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:02:19.044178 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f72acdf2-4e25-488c-bf11-cd24f863788b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.044970 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f72acdf2-4e25-488c-bf11-cd24f863788b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.046410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f72acdf2-4e25-488c-bf11-cd24f863788b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.047161 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f72acdf2-4e25-488c-bf11-cd24f863788b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.048126 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9c4b0034-cfc9-41d5-a1c7-7116ea56e5e6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:19.057681 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9c4b0034-cfc9-41d5-a1c7-7116ea56e5e6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1486 microversion: 2.1 time: 0.286822 Jul 12 12:02:19.072207 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1499/2816] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:18 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1486 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:19.078551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-39465a92-ef05-4de4-8d68-4349036d488d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:19.079400 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-39465a92-ef05-4de4-8d68-4349036d488d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:19.087165 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39465a92-ef05-4de4-8d68-4349036d488d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.087951 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39465a92-ef05-4de4-8d68-4349036d488d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.089029 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39465a92-ef05-4de4-8d68-4349036d488d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.089712 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-39465a92-ef05-4de4-8d68-4349036d488d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.101778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.multi_cell_list [None req-f72acdf2-4e25-488c-bf11-cd24f863788b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:02:19.186441 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f72acdf2-4e25-488c-bf11-cd24f863788b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:19.194600 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f72acdf2-4e25-488c-bf11-cd24f863788b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.195046 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f72acdf2-4e25-488c-bf11-cd24f863788b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.202791 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-39465a92-ef05-4de4-8d68-4349036d488d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:19.220468 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-39465a92-ef05-4de4-8d68-4349036d488d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:19.222159 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-39465a92-ef05-4de4-8d68-4349036d488d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:19.223804 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-39465a92-ef05-4de4-8d68-4349036d488d tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.150080 Jul 12 12:02:19.228489 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1500/2817] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:19 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:19.235983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bd9fe671-fecc-4b3a-9d74-c14d78e08dcb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:19.236668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bd9fe671-fecc-4b3a-9d74-c14d78e08dcb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:19.244105 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bd9fe671-fecc-4b3a-9d74-c14d78e08dcb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.244659 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bd9fe671-fecc-4b3a-9d74-c14d78e08dcb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.245627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bd9fe671-fecc-4b3a-9d74-c14d78e08dcb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.246733 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bd9fe671-fecc-4b3a-9d74-c14d78e08dcb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.384535 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bd9fe671-fecc-4b3a-9d74-c14d78e08dcb tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "POST /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77/action" status: 202 len: 0 microversion: 2.1 time: 0.153401 Jul 12 12:02:19.391868 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1501/2818] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 12:02:19 2022] POST /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 12:02:19.401971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ac220e32-c834-466b-bdbf-aae276f5f2a8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:19.403112 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ac220e32-c834-466b-bdbf-aae276f5f2a8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:19.413740 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f72acdf2-4e25-488c-bf11-cd24f863788b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.426571 Jul 12 12:02:19.420785 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1318/2819] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Jul 12 12:02:18 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:19.422473 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac220e32-c834-466b-bdbf-aae276f5f2a8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.423292 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac220e32-c834-466b-bdbf-aae276f5f2a8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.424708 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac220e32-c834-466b-bdbf-aae276f5f2a8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.425514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ac220e32-c834-466b-bdbf-aae276f5f2a8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.450617 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0e7e022f-8f00-49e2-9b9d-3c996691c96c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:19.456812 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0e7e022f-8f00-49e2-9b9d-3c996691c96c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:19.458586 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0e7e022f-8f00-49e2-9b9d-3c996691c96c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.014104 Jul 12 12:02:19.459579 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1319/2820] 10.222.0.50 () {58 vars in 1177 bytes} [Tue Jul 12 12:02:19 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 12:02:19.476925 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6b986836-863c-4a2e-93c8-b024d051ab1c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:19.487077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6b986836-863c-4a2e-93c8-b024d051ab1c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:19.488524 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6b986836-863c-4a2e-93c8-b024d051ab1c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Searching by: {'deleted': False, 'project_id': 'f630a8015def485db0ac46681a162960'} {{(pid=125983) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 12:02:19.500367 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6b986836-863c-4a2e-93c8-b024d051ab1c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.501336 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6b986836-863c-4a2e-93c8-b024d051ab1c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.504746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6b986836-863c-4a2e-93c8-b024d051ab1c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.507284 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6b986836-863c-4a2e-93c8-b024d051ab1c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.557407 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.multi_cell_list [None req-6b986836-863c-4a2e-93c8-b024d051ab1c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 12:02:19.629774 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6b986836-863c-4a2e-93c8-b024d051ab1c tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.159445 Jul 12 12:02:19.637907 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1320/2821] 10.222.0.50 () {58 vars in 1124 bytes} [Tue Jul 12 12:02:19 2022] GET /compute/v2.1/servers => generated 683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:02:19.643303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ddb0ccc5-d8a7-4aa9-bdf6-0239f66bdadf tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:19.644103 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ddb0ccc5-d8a7-4aa9-bdf6-0239f66bdadf tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: deab1788-4378-44fc-8c70-3f3e04bf5e35] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:19.653204 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ddb0ccc5-d8a7-4aa9-bdf6-0239f66bdadf tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.654017 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ddb0ccc5-d8a7-4aa9-bdf6-0239f66bdadf tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.655002 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ddb0ccc5-d8a7-4aa9-bdf6-0239f66bdadf tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.655602 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ddb0ccc5-d8a7-4aa9-bdf6-0239f66bdadf tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.686642 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-ddb0ccc5-d8a7-4aa9-bdf6-0239f66bdadf tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] HTTP exception thrown: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ddb0ccc5-d8a7-4aa9-bdf6-0239f66bdadf tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Request method failure captured: Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35 HTTP/1.1 Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWKmL0PKu8GjRTBtrrj_XvDRihVt_MuektaWxa6CfzloD9ekS9qZdVQ4oe9i4P4S-sJiMxLYuTn6LFZ9bHkolEieelEaxnmdYmd57GIt7in5-bZLcX7SM1m9CXjODzzHpltCdNceTRsFxCjXDr7THU09TjKzxvaDSSpcvI59WyyJ66A Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f630a8015def485db0ac46681a162960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f630a8015def485db0ac46681a162960", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: f0c8a66c40024ed4b583cf187350a9e0 Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'deab1788-4378-44fc-8c70-3f3e04bf5e35'} Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:02:19.688785 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:02:19.692520 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:19.692520 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:19.692520 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:19.692520 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:19.692520 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:19.692520 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:19.692520 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:19.692520 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:02:19.692520 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:02:19.692520 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:19.692520 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:19.692520 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ddb0ccc5-d8a7-4aa9-bdf6-0239f66bdadf tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Returning 404 to user: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:02:19.692520 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ddb0ccc5-d8a7-4aa9-bdf6-0239f66bdadf tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "DELETE /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35" status: 404 len: 111 microversion: 2.1 time: 0.051188 Jul 12 12:02:19.692520 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1321/2822] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:02:19 2022] DELETE /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 12:02:19.703229 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-77625c10-8635-4e93-8251-397bdb7cff6f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:19.703732 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-77625c10-8635-4e93-8251-397bdb7cff6f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 21a370a2-ee60-46d7-8b18-3f5bf976e8bc] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:19.719867 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77625c10-8635-4e93-8251-397bdb7cff6f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.720399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77625c10-8635-4e93-8251-397bdb7cff6f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.721221 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77625c10-8635-4e93-8251-397bdb7cff6f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.721663 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-77625c10-8635-4e93-8251-397bdb7cff6f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.726111 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=100 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:19.773968 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-77625c10-8635-4e93-8251-397bdb7cff6f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 21a370a2-ee60-46d7-8b18-3f5bf976e8bc] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:02:19.866561 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ac220e32-c834-466b-bdbf-aae276f5f2a8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:19.877542 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ac220e32-c834-466b-bdbf-aae276f5f2a8 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1494 microversion: 2.1 time: 0.481141 Jul 12 12:02:19.878198 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1502/2823] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:19 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1494 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:19.890570 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fb0ec293-ab81-44e0-a5eb-79ca4be4a286 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:19.892806 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fb0ec293-ab81-44e0-a5eb-79ca4be4a286 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:19.904748 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb0ec293-ab81-44e0-a5eb-79ca4be4a286 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.905714 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb0ec293-ab81-44e0-a5eb-79ca4be4a286 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.906944 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb0ec293-ab81-44e0-a5eb-79ca4be4a286 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.908174 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fb0ec293-ab81-44e0-a5eb-79ca4be4a286 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.939284 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-77625c10-8635-4e93-8251-397bdb7cff6f tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "DELETE /compute/v2.1/servers/21a370a2-ee60-46d7-8b18-3f5bf976e8bc" status: 204 len: 0 microversion: 2.1 time: 0.239710 Jul 12 12:02:19.944318 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1322/2824] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:02:19 2022] DELETE /compute/v2.1/servers/21a370a2-ee60-46d7-8b18-3f5bf976e8bc => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:02:19.954630 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-188fbf57-f115-41d7-a789-a21ab64fae01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:19.955349 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-188fbf57-f115-41d7-a789-a21ab64fae01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:19.972378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-188fbf57-f115-41d7-a789-a21ab64fae01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.973038 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-188fbf57-f115-41d7-a789-a21ab64fae01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:19.973636 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-188fbf57-f115-41d7-a789-a21ab64fae01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:19.974085 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-188fbf57-f115-41d7-a789-a21ab64fae01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:20.108812 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-188fbf57-f115-41d7-a789-a21ab64fae01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:20.125260 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-188fbf57-f115-41d7-a789-a21ab64fae01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:20.127370 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-188fbf57-f115-41d7-a789-a21ab64fae01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:20.129597 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-188fbf57-f115-41d7-a789-a21ab64fae01 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.183974 Jul 12 12:02:20.130363 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1323/2825] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:19 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:20.135107 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8c014d76-ab4b-4db2-848a-c5dee0554925 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:20.136193 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8c014d76-ab4b-4db2-848a-c5dee0554925 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:20.138944 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:20.149490 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c014d76-ab4b-4db2-848a-c5dee0554925 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:20.149945 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c014d76-ab4b-4db2-848a-c5dee0554925 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:20.150879 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c014d76-ab4b-4db2-848a-c5dee0554925 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:20.151482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8c014d76-ab4b-4db2-848a-c5dee0554925 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:20.223368 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8c014d76-ab4b-4db2-848a-c5dee0554925 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:02:20.253831 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fb0ec293-ab81-44e0-a5eb-79ca4be4a286 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:20.283240 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fb0ec293-ab81-44e0-a5eb-79ca4be4a286 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:20.285284 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fb0ec293-ab81-44e0-a5eb-79ca4be4a286 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:20.288049 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fb0ec293-ab81-44e0-a5eb-79ca4be4a286 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.407695 Jul 12 12:02:20.288275 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1503/2826] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:19 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:20.298976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-79551c9c-4ae3-41dd-9f59-2b9477f8f05d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:20.309968 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-79551c9c-4ae3-41dd-9f59-2b9477f8f05d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:20.322163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-79551c9c-4ae3-41dd-9f59-2b9477f8f05d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:20.322897 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-79551c9c-4ae3-41dd-9f59-2b9477f8f05d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:20.324582 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-79551c9c-4ae3-41dd-9f59-2b9477f8f05d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:20.325357 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-79551c9c-4ae3-41dd-9f59-2b9477f8f05d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:20.419980 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8c014d76-ab4b-4db2-848a-c5dee0554925 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 204 len: 0 microversion: 2.1 time: 0.287649 Jul 12 12:02:20.422051 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1324/2827] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:02:20 2022] DELETE /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:02:20.433009 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-eb2e87a4-3e36-494d-b826-d1c68d844a7c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:20.434229 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-eb2e87a4-3e36-494d-b826-d1c68d844a7c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:20.443038 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb2e87a4-3e36-494d-b826-d1c68d844a7c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:20.443761 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb2e87a4-3e36-494d-b826-d1c68d844a7c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:20.444848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb2e87a4-3e36-494d-b826-d1c68d844a7c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:20.445506 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eb2e87a4-3e36-494d-b826-d1c68d844a7c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:20.530141 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eb2e87a4-3e36-494d-b826-d1c68d844a7c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:20.548780 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-79551c9c-4ae3-41dd-9f59-2b9477f8f05d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:20.551392 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eb2e87a4-3e36-494d-b826-d1c68d844a7c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:20.555956 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eb2e87a4-3e36-494d-b826-d1c68d844a7c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:20.558705 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-eb2e87a4-3e36-494d-b826-d1c68d844a7c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.134179 Jul 12 12:02:20.560499 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1325/2828] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:20 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:20.570943 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-89d69e9e-954e-43c8-a4d6-e8b872fa9b18 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:20.573091 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-89d69e9e-954e-43c8-a4d6-e8b872fa9b18 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: deab1788-4378-44fc-8c70-3f3e04bf5e35] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:20.576106 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-79551c9c-4ae3-41dd-9f59-2b9477f8f05d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1277 microversion: 2.1 time: 0.286106 Jul 12 12:02:20.577043 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1504/2829] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:20 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1277 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:20.597430 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89d69e9e-954e-43c8-a4d6-e8b872fa9b18 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:20.598034 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89d69e9e-954e-43c8-a4d6-e8b872fa9b18 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:20.601739 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89d69e9e-954e-43c8-a4d6-e8b872fa9b18 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:20.602762 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-89d69e9e-954e-43c8-a4d6-e8b872fa9b18 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:20.618709 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-ed658f60-bada-4456-8bea-041a121a7a59 req-4b28f1b7-4b29-413a-9384-840b8e255a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd4cf5e-cd93-4202-815d-87eb5305f5ee", "name": "network-vif-deleted", "tag": "59c136a8-69e4-4426-bca5-83e039980105"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:20.630191 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-ed658f60-bada-4456-8bea-041a121a7a59 req-4b28f1b7-4b29-413a-9384-840b8e255a17 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:20.630919 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-ed658f60-bada-4456-8bea-041a121a7a59 req-4b28f1b7-4b29-413a-9384-840b8e255a17 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:20.633030 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-89d69e9e-954e-43c8-a4d6-e8b872fa9b18 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] HTTP exception thrown: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-89d69e9e-954e-43c8-a4d6-e8b872fa9b18 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Request method failure captured: Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35 HTTP/1.1 Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWKmL0PKu8GjRTBtrrj_XvDRihVt_MuektaWxa6CfzloD9ekS9qZdVQ4oe9i4P4S-sJiMxLYuTn6LFZ9bHkolEieelEaxnmdYmd57GIt7in5-bZLcX7SM1m9CXjODzzHpltCdNceTRsFxCjXDr7THU09TjKzxvaDSSpcvI59WyyJ66A Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f630a8015def485db0ac46681a162960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f630a8015def485db0ac46681a162960", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: f0c8a66c40024ed4b583cf187350a9e0 Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'deab1788-4378-44fc-8c70-3f3e04bf5e35'} Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:20.636374 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:20.645267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:20.645267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:20.645267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:20.645267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:02:20.645267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:02:20.645267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. Jul 12 12:02:20.645267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:20.645267 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-89d69e9e-954e-43c8-a4d6-e8b872fa9b18 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Returning 404 to user: Instance deab1788-4378-44fc-8c70-3f3e04bf5e35 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:02:20.645267 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-89d69e9e-954e-43c8-a4d6-e8b872fa9b18 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35" status: 404 len: 111 microversion: 2.1 time: 0.079850 Jul 12 12:02:20.645267 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1326/2830] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:20 2022] GET /compute/v2.1/servers/deab1788-4378-44fc-8c70-3f3e04bf5e35 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 12:02:20.654683 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-ed658f60-bada-4456-8bea-041a121a7a59 req-4b28f1b7-4b29-413a-9384-840b8e255a17 service nova] Creating event network-vif-deleted:59c136a8-69e4-4426-bca5-83e039980105 for instance 5cd4cf5e-cd93-4202-815d-87eb5305f5ee on n-h2-849104-4 Jul 12 12:02:20.657000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-80f78535-24ca-4ff7-94b7-3a6fcc790dfc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:20.658085 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-80f78535-24ca-4ff7-94b7-3a6fcc790dfc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 21a370a2-ee60-46d7-8b18-3f5bf976e8bc] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:20.661597 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-ed658f60-bada-4456-8bea-041a121a7a59 req-4b28f1b7-4b29-413a-9384-840b8e255a17 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046302 Jul 12 12:02:20.663834 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1505/2831] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:02:20.667539 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80f78535-24ca-4ff7-94b7-3a6fcc790dfc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:20.668342 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80f78535-24ca-4ff7-94b7-3a6fcc790dfc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:20.669497 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80f78535-24ca-4ff7-94b7-3a6fcc790dfc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:20.669942 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80f78535-24ca-4ff7-94b7-3a6fcc790dfc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:20.831005 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-80f78535-24ca-4ff7-94b7-3a6fcc790dfc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:20.839590 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-80f78535-24ca-4ff7-94b7-3a6fcc790dfc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/21a370a2-ee60-46d7-8b18-3f5bf976e8bc" status: 200 len: 1521 microversion: 2.1 time: 0.189314 Jul 12 12:02:20.840299 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1327/2832] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:20 2022] GET /compute/v2.1/servers/21a370a2-ee60-46d7-8b18-3f5bf976e8bc => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:20.895527 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-238ff70d-d436-47f6-9523-5d25967ffd7d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:20.896369 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-238ff70d-d436-47f6-9523-5d25967ffd7d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:20.903525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-238ff70d-d436-47f6-9523-5d25967ffd7d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:20.904141 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-238ff70d-d436-47f6-9523-5d25967ffd7d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:20.904993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-238ff70d-d436-47f6-9523-5d25967ffd7d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:20.905513 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-238ff70d-d436-47f6-9523-5d25967ffd7d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:21.039067 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-aa2664fd-ad76-420d-aa2c-9d4190b3f687 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:21.040113 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-aa2664fd-ad76-420d-aa2c-9d4190b3f687 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:21.047872 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aa2664fd-ad76-420d-aa2c-9d4190b3f687 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:21.048360 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aa2664fd-ad76-420d-aa2c-9d4190b3f687 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:21.049153 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aa2664fd-ad76-420d-aa2c-9d4190b3f687 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:21.049592 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aa2664fd-ad76-420d-aa2c-9d4190b3f687 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:21.081863 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-aa2664fd-ad76-420d-aa2c-9d4190b3f687 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046690 Jul 12 12:02:21.082643 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1328/2833] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 12:02:21 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:02:21.094402 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bb75557a-18b2-42fa-b109-f6e5dffd99b8 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:21.094970 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-bb75557a-18b2-42fa-b109-f6e5dffd99b8 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:21.101401 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb75557a-18b2-42fa-b109-f6e5dffd99b8 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:21.101858 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb75557a-18b2-42fa-b109-f6e5dffd99b8 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:21.102646 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb75557a-18b2-42fa-b109-f6e5dffd99b8 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:21.103091 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb75557a-18b2-42fa-b109-f6e5dffd99b8 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:21.111653 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-238ff70d-d436-47f6-9523-5d25967ffd7d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:21.121527 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-238ff70d-d436-47f6-9523-5d25967ffd7d tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1494 microversion: 2.1 time: 0.230235 Jul 12 12:02:21.123086 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1506/2834] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:20 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1494 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:21.153902 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e1f1959b-c125-4c20-82a8-145d28af5161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:21.154852 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e1f1959b-c125-4c20-82a8-145d28af5161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:21.165882 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e1f1959b-c125-4c20-82a8-145d28af5161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:21.172218 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e1f1959b-c125-4c20-82a8-145d28af5161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:21.172218 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e1f1959b-c125-4c20-82a8-145d28af5161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:21.172218 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e1f1959b-c125-4c20-82a8-145d28af5161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:21.232342 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-bb75557a-18b2-42fa-b109-f6e5dffd99b8 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lazy-loading 'services' on Instance uuid cea153f9-9c62-4a41-a8be-4bdf4c5d3998 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:02:21.267542 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e1f1959b-c125-4c20-82a8-145d28af5161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:21.280199 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e1f1959b-c125-4c20-82a8-145d28af5161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:21.281945 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e1f1959b-c125-4c20-82a8-145d28af5161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:21.283272 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e1f1959b-c125-4c20-82a8-145d28af5161 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.136059 Jul 12 12:02:21.284236 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1507/2835] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:21 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:21.308204 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-42eed06a-759c-460c-b1df-aa6fe6eaeef5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:21.308958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-42eed06a-759c-460c-b1df-aa6fe6eaeef5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:21.311065 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:21.323622 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-42eed06a-759c-460c-b1df-aa6fe6eaeef5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:21.324670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-42eed06a-759c-460c-b1df-aa6fe6eaeef5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:21.325471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-42eed06a-759c-460c-b1df-aa6fe6eaeef5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:21.325921 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-42eed06a-759c-460c-b1df-aa6fe6eaeef5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:21.342257 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bb75557a-18b2-42fa-b109-f6e5dffd99b8 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998/os-volume_attachments/a96b5106-34ea-4c90-a5ce-7047e898a6b2" status: 202 len: 0 microversion: 2.1 time: 0.253502 Jul 12 12:02:21.343240 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1329/2836] 10.222.0.50 () {58 vars in 1415 bytes} [Tue Jul 12 12:02:21 2022] DELETE /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998/os-volume_attachments/a96b5106-34ea-4c90-a5ce-7047e898a6b2 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 12:02:21.504921 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-42eed06a-759c-460c-b1df-aa6fe6eaeef5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:21.514657 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-42eed06a-759c-460c-b1df-aa6fe6eaeef5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:21.516196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-42eed06a-759c-460c-b1df-aa6fe6eaeef5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:21.517425 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-42eed06a-759c-460c-b1df-aa6fe6eaeef5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.214187 Jul 12 12:02:21.518110 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1508/2837] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:21 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:21.583093 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-21426cb7-620e-4a7d-aacf-18b1cf61df6b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:21.584605 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-21426cb7-620e-4a7d-aacf-18b1cf61df6b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:21.596470 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-21426cb7-620e-4a7d-aacf-18b1cf61df6b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:21.597237 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-21426cb7-620e-4a7d-aacf-18b1cf61df6b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:21.598073 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-21426cb7-620e-4a7d-aacf-18b1cf61df6b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:21.598530 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-21426cb7-620e-4a7d-aacf-18b1cf61df6b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:21.607416 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e35f4790-ed4b-468a-a9ef-b109619b48bb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:21.608669 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e35f4790-ed4b-468a-a9ef-b109619b48bb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:21.634242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e35f4790-ed4b-468a-a9ef-b109619b48bb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:21.635007 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e35f4790-ed4b-468a-a9ef-b109619b48bb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:21.636381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e35f4790-ed4b-468a-a9ef-b109619b48bb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:21.644654 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e35f4790-ed4b-468a-a9ef-b109619b48bb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:21.717541 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-21426cb7-620e-4a7d-aacf-18b1cf61df6b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:21.728461 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-21426cb7-620e-4a7d-aacf-18b1cf61df6b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:21.731451 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-21426cb7-620e-4a7d-aacf-18b1cf61df6b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:21.732913 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-21426cb7-620e-4a7d-aacf-18b1cf61df6b tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.157991 Jul 12 12:02:21.734139 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1330/2838] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:21 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:21.796887 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e35f4790-ed4b-468a-a9ef-b109619b48bb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:21.813403 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e35f4790-ed4b-468a-a9ef-b109619b48bb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1277 microversion: 2.1 time: 0.215580 Jul 12 12:02:21.815161 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1509/2839] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:21 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:21.862102 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1f0e385e-e08f-4023-9b56-43e41052d8bc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:21.863574 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1f0e385e-e08f-4023-9b56-43e41052d8bc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 21a370a2-ee60-46d7-8b18-3f5bf976e8bc] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:21.871725 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f0e385e-e08f-4023-9b56-43e41052d8bc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:21.872149 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f0e385e-e08f-4023-9b56-43e41052d8bc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:21.874163 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f0e385e-e08f-4023-9b56-43e41052d8bc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:21.874633 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f0e385e-e08f-4023-9b56-43e41052d8bc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:22.032810 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1f0e385e-e08f-4023-9b56-43e41052d8bc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:22.041416 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1f0e385e-e08f-4023-9b56-43e41052d8bc tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/21a370a2-ee60-46d7-8b18-3f5bf976e8bc" status: 200 len: 1521 microversion: 2.1 time: 0.184659 Jul 12 12:02:22.042920 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1331/2840] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:21 2022] GET /compute/v2.1/servers/21a370a2-ee60-46d7-8b18-3f5bf976e8bc => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:22.143067 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d8ef7c55-ebd3-46fb-b3c0-bdc249655924 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:22.143846 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d8ef7c55-ebd3-46fb-b3c0-bdc249655924 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:22.151960 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d8ef7c55-ebd3-46fb-b3c0-bdc249655924 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:22.153485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d8ef7c55-ebd3-46fb-b3c0-bdc249655924 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:22.154870 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d8ef7c55-ebd3-46fb-b3c0-bdc249655924 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:22.155657 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d8ef7c55-ebd3-46fb-b3c0-bdc249655924 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:22.303835 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b536bfc1-a101-4b90-90d5-3e3ba3befa73 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:22.304348 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b536bfc1-a101-4b90-90d5-3e3ba3befa73 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:22.313494 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b536bfc1-a101-4b90-90d5-3e3ba3befa73 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:22.313948 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b536bfc1-a101-4b90-90d5-3e3ba3befa73 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:22.314887 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b536bfc1-a101-4b90-90d5-3e3ba3befa73 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:22.315331 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b536bfc1-a101-4b90-90d5-3e3ba3befa73 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:22.466784 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b536bfc1-a101-4b90-90d5-3e3ba3befa73 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:22.472937 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d8ef7c55-ebd3-46fb-b3c0-bdc249655924 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:22.482241 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b536bfc1-a101-4b90-90d5-3e3ba3befa73 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:22.485798 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b536bfc1-a101-4b90-90d5-3e3ba3befa73 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:22.489014 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b536bfc1-a101-4b90-90d5-3e3ba3befa73 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.189869 Jul 12 12:02:22.489348 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d8ef7c55-ebd3-46fb-b3c0-bdc249655924 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1494 microversion: 2.1 time: 0.352339 Jul 12 12:02:22.489597 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1332/2841] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:22 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:22.493020 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1510/2842] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:22 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1494 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:22.536381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-860498a6-ca77-46a9-8775-0494d754f472 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:22.537010 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-860498a6-ca77-46a9-8775-0494d754f472 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:22.543719 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-860498a6-ca77-46a9-8775-0494d754f472 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:22.544211 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-860498a6-ca77-46a9-8775-0494d754f472 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:22.545008 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-860498a6-ca77-46a9-8775-0494d754f472 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:22.545456 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-860498a6-ca77-46a9-8775-0494d754f472 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:22.737834 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-860498a6-ca77-46a9-8775-0494d754f472 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:22.753481 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0f8fc8d4-86df-4cda-a7cd-b83150609df1 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:22.754182 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0f8fc8d4-86df-4cda-a7cd-b83150609df1 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:22.755403 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-860498a6-ca77-46a9-8775-0494d754f472 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:22.757441 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-860498a6-ca77-46a9-8775-0494d754f472 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:22.761029 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-860498a6-ca77-46a9-8775-0494d754f472 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.228365 Jul 12 12:02:22.774501 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1333/2843] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:22 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:22.776946 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f8fc8d4-86df-4cda-a7cd-b83150609df1 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:22.778047 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f8fc8d4-86df-4cda-a7cd-b83150609df1 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:22.779194 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f8fc8d4-86df-4cda-a7cd-b83150609df1 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:22.780300 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0f8fc8d4-86df-4cda-a7cd-b83150609df1 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:22.833711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-879bf24a-ded8-43a4-b779-84dcaf59bab3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:22.834777 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-879bf24a-ded8-43a4-b779-84dcaf59bab3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:22.850375 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-879bf24a-ded8-43a4-b779-84dcaf59bab3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:22.851643 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-879bf24a-ded8-43a4-b779-84dcaf59bab3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:22.853024 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-879bf24a-ded8-43a4-b779-84dcaf59bab3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:22.853732 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-879bf24a-ded8-43a4-b779-84dcaf59bab3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:22.879104 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0f8fc8d4-86df-4cda-a7cd-b83150609df1 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:22.897353 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0f8fc8d4-86df-4cda-a7cd-b83150609df1 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:22.898661 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0f8fc8d4-86df-4cda-a7cd-b83150609df1 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:22.899893 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0f8fc8d4-86df-4cda-a7cd-b83150609df1 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.151800 Jul 12 12:02:22.904373 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1511/2844] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:22 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:23.000894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-f002b1f2-b714-4f1f-92a2-a955c821d616 req-ab84d0d1-9951-4fd1-b1f8-ef3d87719a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a370a2-ee60-46d7-8b18-3f5bf976e8bc", "name": "network-vif-deleted", "tag": "e0ad7f75-136c-4075-bed4-139c20d686f7"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:23.047189 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-f002b1f2-b714-4f1f-92a2-a955c821d616 req-ab84d0d1-9951-4fd1-b1f8-ef3d87719a7b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:23.049108 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-f002b1f2-b714-4f1f-92a2-a955c821d616 req-ab84d0d1-9951-4fd1-b1f8-ef3d87719a7b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:23.058754 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:23.071356 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-f002b1f2-b714-4f1f-92a2-a955c821d616 req-ab84d0d1-9951-4fd1-b1f8-ef3d87719a7b service nova] Creating event network-vif-deleted:e0ad7f75-136c-4075-bed4-139c20d686f7 for instance 21a370a2-ee60-46d7-8b18-3f5bf976e8bc on n-h2-849104-4 Jul 12 12:02:23.082019 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-f002b1f2-b714-4f1f-92a2-a955c821d616 req-ab84d0d1-9951-4fd1-b1f8-ef3d87719a7b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084441 Jul 12 12:02:23.082019 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1512/2845] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:02:23.088819 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-559e25b5-768e-44a8-9ae2-5e7006055931 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:23.090833 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-559e25b5-768e-44a8-9ae2-5e7006055931 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 21a370a2-ee60-46d7-8b18-3f5bf976e8bc] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:23.113608 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-559e25b5-768e-44a8-9ae2-5e7006055931 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:23.114067 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-559e25b5-768e-44a8-9ae2-5e7006055931 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:23.114860 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-559e25b5-768e-44a8-9ae2-5e7006055931 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:23.115303 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-559e25b5-768e-44a8-9ae2-5e7006055931 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:23.321204 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-559e25b5-768e-44a8-9ae2-5e7006055931 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:23.333142 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-879bf24a-ded8-43a4-b779-84dcaf59bab3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:23.337170 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-559e25b5-768e-44a8-9ae2-5e7006055931 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/21a370a2-ee60-46d7-8b18-3f5bf976e8bc" status: 200 len: 1308 microversion: 2.1 time: 0.253287 Jul 12 12:02:23.338467 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1513/2846] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:23 2022] GET /compute/v2.1/servers/21a370a2-ee60-46d7-8b18-3f5bf976e8bc => generated 1308 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:23.347310 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-879bf24a-ded8-43a4-b779-84dcaf59bab3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1317 microversion: 2.1 time: 0.517548 Jul 12 12:02:23.347906 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1334/2847] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:22 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:02:23.520823 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-48ef08d9-6f08-44bc-8fee-4615358ff409 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:23.522276 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-48ef08d9-6f08-44bc-8fee-4615358ff409 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:23.524214 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-36b41be6-b108-4a9e-b471-6a3e6aecedca tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:23.525008 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-36b41be6-b108-4a9e-b471-6a3e6aecedca tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:23.573952 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-36b41be6-b108-4a9e-b471-6a3e6aecedca tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:23.574890 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-36b41be6-b108-4a9e-b471-6a3e6aecedca tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:23.575999 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-48ef08d9-6f08-44bc-8fee-4615358ff409 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:23.577031 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-36b41be6-b108-4a9e-b471-6a3e6aecedca tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:23.577716 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-36b41be6-b108-4a9e-b471-6a3e6aecedca tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:23.580456 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-48ef08d9-6f08-44bc-8fee-4615358ff409 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:23.581664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-48ef08d9-6f08-44bc-8fee-4615358ff409 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:23.581827 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-48ef08d9-6f08-44bc-8fee-4615358ff409 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:23.646774 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:23.737572 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-36b41be6-b108-4a9e-b471-6a3e6aecedca tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:23.754606 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-36b41be6-b108-4a9e-b471-6a3e6aecedca tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:23.756281 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-36b41be6-b108-4a9e-b471-6a3e6aecedca tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:23.757574 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-36b41be6-b108-4a9e-b471-6a3e6aecedca tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.251420 Jul 12 12:02:23.763239 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1514/2848] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:23 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:23.781797 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f45938ca-1699-48c3-bc43-e1eedb20be52 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:23.782533 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f45938ca-1699-48c3-bc43-e1eedb20be52 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:23.801469 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45938ca-1699-48c3-bc43-e1eedb20be52 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:23.802049 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45938ca-1699-48c3-bc43-e1eedb20be52 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:23.802943 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45938ca-1699-48c3-bc43-e1eedb20be52 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:23.803499 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f45938ca-1699-48c3-bc43-e1eedb20be52 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:23.973060 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-48ef08d9-6f08-44bc-8fee-4615358ff409 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:23.996694 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-48ef08d9-6f08-44bc-8fee-4615358ff409 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1500 microversion: 2.1 time: 0.489272 Jul 12 12:02:23.998690 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1335/2849] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:23 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1500 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:24.004354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4207b3db-32e1-426b-89bb-738455207e36 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:24.005304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4207b3db-32e1-426b-89bb-738455207e36 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:24.028839 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4207b3db-32e1-426b-89bb-738455207e36 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.031361 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4207b3db-32e1-426b-89bb-738455207e36 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.032296 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4207b3db-32e1-426b-89bb-738455207e36 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.034658 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4207b3db-32e1-426b-89bb-738455207e36 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.159491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4207b3db-32e1-426b-89bb-738455207e36 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:24.168619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4207b3db-32e1-426b-89bb-738455207e36 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:24.170797 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4207b3db-32e1-426b-89bb-738455207e36 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:24.172307 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4207b3db-32e1-426b-89bb-738455207e36 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.172083 Jul 12 12:02:24.186207 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1336/2850] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:23 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:24.191513 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-42ca11df-5b67-4169-bc15-7a613888a24b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:24.192167 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-42ca11df-5b67-4169-bc15-7a613888a24b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:24.203615 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-42ca11df-5b67-4169-bc15-7a613888a24b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.204342 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-42ca11df-5b67-4169-bc15-7a613888a24b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.205990 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-42ca11df-5b67-4169-bc15-7a613888a24b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.206538 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-42ca11df-5b67-4169-bc15-7a613888a24b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.236520 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-42ca11df-5b67-4169-bc15-7a613888a24b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:02:24.325658 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-42ca11df-5b67-4169-bc15-7a613888a24b tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 204 len: 0 microversion: 2.1 time: 0.137926 Jul 12 12:02:24.326299 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1337/2851] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:02:24 2022] DELETE /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:02:24.335121 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-06747979-925c-466e-95fe-bd855a3b9af6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:24.335939 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-06747979-925c-466e-95fe-bd855a3b9af6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:24.343037 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-06747979-925c-466e-95fe-bd855a3b9af6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.343524 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-06747979-925c-466e-95fe-bd855a3b9af6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.344938 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-06747979-925c-466e-95fe-bd855a3b9af6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.345391 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-06747979-925c-466e-95fe-bd855a3b9af6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.355305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f45938ca-1699-48c3-bc43-e1eedb20be52 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:24.371534 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f45938ca-1699-48c3-bc43-e1eedb20be52 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:24.374010 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f45938ca-1699-48c3-bc43-e1eedb20be52 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:24.375386 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f45938ca-1699-48c3-bc43-e1eedb20be52 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.599002 Jul 12 12:02:24.376486 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1515/2852] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:23 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:24.381151 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cf8cfb35-5841-4a80-bebd-6120eb844b3b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:24.381946 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cf8cfb35-5841-4a80-bebd-6120eb844b3b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 21a370a2-ee60-46d7-8b18-3f5bf976e8bc] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:24.400812 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cf8cfb35-5841-4a80-bebd-6120eb844b3b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.403012 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cf8cfb35-5841-4a80-bebd-6120eb844b3b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.404129 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cf8cfb35-5841-4a80-bebd-6120eb844b3b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.406025 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cf8cfb35-5841-4a80-bebd-6120eb844b3b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.431634 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-cf8cfb35-5841-4a80-bebd-6120eb844b3b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] HTTP exception thrown: Instance 21a370a2-ee60-46d7-8b18-3f5bf976e8bc could not be found. Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cf8cfb35-5841-4a80-bebd-6120eb844b3b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Request method failure captured: Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/21a370a2-ee60-46d7-8b18-3f5bf976e8bc HTTP/1.1 Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWKmL0PKu8GjRTBtrrj_XvDRihVt_MuektaWxa6CfzloD9ekS9qZdVQ4oe9i4P4S-sJiMxLYuTn6LFZ9bHkolEieelEaxnmdYmd57GIt7in5-bZLcX7SM1m9CXjODzzHpltCdNceTRsFxCjXDr7THU09TjKzxvaDSSpcvI59WyyJ66A Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f630a8015def485db0ac46681a162960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f630a8015def485db0ac46681a162960", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: f0c8a66c40024ed4b583cf187350a9e0 Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 21a370a2-ee60-46d7-8b18-3f5bf976e8bc could not be found. Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '21a370a2-ee60-46d7-8b18-3f5bf976e8bc'} Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a370a2-ee60-46d7-8b18-3f5bf976e8bc could not be found. Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a370a2-ee60-46d7-8b18-3f5bf976e8bc could not be found. Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:24.440135 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:24.443924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:24.443924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:24.443924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:24.443924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:02:24.443924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:02:24.443924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a370a2-ee60-46d7-8b18-3f5bf976e8bc could not be found. Jul 12 12:02:24.443924 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:24.448786 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cf8cfb35-5841-4a80-bebd-6120eb844b3b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Returning 404 to user: Instance 21a370a2-ee60-46d7-8b18-3f5bf976e8bc could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:02:24.450425 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cf8cfb35-5841-4a80-bebd-6120eb844b3b tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/21a370a2-ee60-46d7-8b18-3f5bf976e8bc" status: 404 len: 111 microversion: 2.1 time: 0.072842 Jul 12 12:02:24.451517 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1516/2853] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:24 2022] GET /compute/v2.1/servers/21a370a2-ee60-46d7-8b18-3f5bf976e8bc => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 12:02:24.461780 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-fc4cfec3-fba4-4008-9129-67f175eaddcf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:24.465824 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-fc4cfec3-fba4-4008-9129-67f175eaddcf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:24.477651 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc4cfec3-fba4-4008-9129-67f175eaddcf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.478109 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc4cfec3-fba4-4008-9129-67f175eaddcf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.478904 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc4cfec3-fba4-4008-9129-67f175eaddcf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.479347 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-fc4cfec3-fba4-4008-9129-67f175eaddcf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.576159 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-06747979-925c-466e-95fe-bd855a3b9af6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:24.587552 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-06747979-925c-466e-95fe-bd855a3b9af6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.255594 Jul 12 12:02:24.587552 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1338/2854] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:24 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:02:24.601299 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c6d52e63-a79c-4004-915b-c480da2a989d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:24.601991 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c6d52e63-a79c-4004-915b-c480da2a989d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:24.609155 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c6d52e63-a79c-4004-915b-c480da2a989d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.609636 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c6d52e63-a79c-4004-915b-c480da2a989d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.610550 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c6d52e63-a79c-4004-915b-c480da2a989d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.611168 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c6d52e63-a79c-4004-915b-c480da2a989d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.650780 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c6d52e63-a79c-4004-915b-c480da2a989d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.651245 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c6d52e63-a79c-4004-915b-c480da2a989d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.651714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-c6d52e63-a79c-4004-915b-c480da2a989d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lazy-loading 'fault' on Instance uuid 0eefd015-61dc-4aea-8dc9-4faabaf9a869 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:02:24.717747 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c6d52e63-a79c-4004-915b-c480da2a989d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:24.727341 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c6d52e63-a79c-4004-915b-c480da2a989d tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1313 microversion: 2.1 time: 0.139134 Jul 12 12:02:24.735479 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1339/2855] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:24 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:24.785275 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b525f593-fc7d-4ad4-a85b-fbe279eb48f9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:24.787100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b525f593-fc7d-4ad4-a85b-fbe279eb48f9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:24.798024 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b525f593-fc7d-4ad4-a85b-fbe279eb48f9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.799619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b525f593-fc7d-4ad4-a85b-fbe279eb48f9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.801035 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b525f593-fc7d-4ad4-a85b-fbe279eb48f9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:24.802027 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b525f593-fc7d-4ad4-a85b-fbe279eb48f9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:24.892430 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-fc4cfec3-fba4-4008-9129-67f175eaddcf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:24.903954 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-fc4cfec3-fba4-4008-9129-67f175eaddcf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1317 microversion: 2.1 time: 0.451041 Jul 12 12:02:24.904587 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1517/2856] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:24 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:24.905723 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b525f593-fc7d-4ad4-a85b-fbe279eb48f9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:24.919996 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b525f593-fc7d-4ad4-a85b-fbe279eb48f9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:24.921822 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b525f593-fc7d-4ad4-a85b-fbe279eb48f9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:24.923270 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b525f593-fc7d-4ad4-a85b-fbe279eb48f9 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.144404 Jul 12 12:02:24.924467 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1340/2857] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:24 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:25.154210 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-654bdcae-9e5f-4798-be5b-ca0fc04374bf req-2dc30ef2-236b-442c-8ff3-1cfcd796f5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eefd015-61dc-4aea-8dc9-4faabaf9a869", "name": "network-vif-deleted", "tag": "bfc5370e-ce21-4218-be02-49f52a93b0ba"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:25.169107 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-654bdcae-9e5f-4798-be5b-ca0fc04374bf req-2dc30ef2-236b-442c-8ff3-1cfcd796f5c8 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.169837 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-654bdcae-9e5f-4798-be5b-ca0fc04374bf req-2dc30ef2-236b-442c-8ff3-1cfcd796f5c8 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:25.196662 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-26029e2b-1929-4270-8334-10fbc1a774f2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:25.197689 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-26029e2b-1929-4270-8334-10fbc1a774f2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:25.200569 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-654bdcae-9e5f-4798-be5b-ca0fc04374bf req-2dc30ef2-236b-442c-8ff3-1cfcd796f5c8 service nova] Creating event network-vif-deleted:bfc5370e-ce21-4218-be02-49f52a93b0ba for instance 0eefd015-61dc-4aea-8dc9-4faabaf9a869 on n-h1-849104-4 Jul 12 12:02:25.209465 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26029e2b-1929-4270-8334-10fbc1a774f2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.211304 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26029e2b-1929-4270-8334-10fbc1a774f2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:25.215962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26029e2b-1929-4270-8334-10fbc1a774f2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.215962 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26029e2b-1929-4270-8334-10fbc1a774f2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:25.217780 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-654bdcae-9e5f-4798-be5b-ca0fc04374bf req-2dc30ef2-236b-442c-8ff3-1cfcd796f5c8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070935 Jul 12 12:02:25.222369 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1518/2858] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:02:25.278114 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-6f7850ee-b969-48b4-aa8c-6565a3fab725 req-eba6b020-669e-44d0-98ab-69f6522079d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c11deeb-3a1a-477f-ab1c-cd66a5fef930", "tag": "4f655b24-a3d1-4d12-bfc2-6fee676ef485"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:25.295376 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-6f7850ee-b969-48b4-aa8c-6565a3fab725 req-eba6b020-669e-44d0-98ab-69f6522079d3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.295906 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-6f7850ee-b969-48b4-aa8c-6565a3fab725 req-eba6b020-669e-44d0-98ab-69f6522079d3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:25.298895 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-26029e2b-1929-4270-8334-10fbc1a774f2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:25.309851 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-26029e2b-1929-4270-8334-10fbc1a774f2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:25.311516 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-26029e2b-1929-4270-8334-10fbc1a774f2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:25.317133 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-26029e2b-1929-4270-8334-10fbc1a774f2 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.127313 Jul 12 12:02:25.318233 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1341/2859] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:25 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:25.319660 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-6f7850ee-b969-48b4-aa8c-6565a3fab725 req-eba6b020-669e-44d0-98ab-69f6522079d3 service nova] Creating event network-changed:4f655b24-a3d1-4d12-bfc2-6fee676ef485 for instance 7c11deeb-3a1a-477f-ab1c-cd66a5fef930 on n-h2-849104-4 Jul 12 12:02:25.334277 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-6f7850ee-b969-48b4-aa8c-6565a3fab725 req-eba6b020-669e-44d0-98ab-69f6522079d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060399 Jul 12 12:02:25.335115 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1519/2860] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:25.395968 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d8b6a405-3c17-4074-b5af-d1b851053af2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:25.401351 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d8b6a405-3c17-4074-b5af-d1b851053af2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:25.414714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d8b6a405-3c17-4074-b5af-d1b851053af2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.415184 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d8b6a405-3c17-4074-b5af-d1b851053af2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:25.418650 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d8b6a405-3c17-4074-b5af-d1b851053af2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.419113 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d8b6a405-3c17-4074-b5af-d1b851053af2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:25.607348 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cc0a68cc-a75e-43a4-92e3-a677901a97aa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:25.608263 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cc0a68cc-a75e-43a4-92e3-a677901a97aa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:25.617784 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cc0a68cc-a75e-43a4-92e3-a677901a97aa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.618479 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cc0a68cc-a75e-43a4-92e3-a677901a97aa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:25.619447 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cc0a68cc-a75e-43a4-92e3-a677901a97aa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.620334 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cc0a68cc-a75e-43a4-92e3-a677901a97aa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:25.694322 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d8b6a405-3c17-4074-b5af-d1b851053af2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:25.705039 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d8b6a405-3c17-4074-b5af-d1b851053af2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:25.709963 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d8b6a405-3c17-4074-b5af-d1b851053af2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:25.712825 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d8b6a405-3c17-4074-b5af-d1b851053af2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.321355 Jul 12 12:02:25.724958 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1342/2861] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:25 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:25.758084 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7162d779-0e65-4a3f-82c5-189cb3867a0e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:25.758634 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7162d779-0e65-4a3f-82c5-189cb3867a0e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:25.768341 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7162d779-0e65-4a3f-82c5-189cb3867a0e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.768809 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7162d779-0e65-4a3f-82c5-189cb3867a0e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:25.769603 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7162d779-0e65-4a3f-82c5-189cb3867a0e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.770053 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7162d779-0e65-4a3f-82c5-189cb3867a0e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:25.828813 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7162d779-0e65-4a3f-82c5-189cb3867a0e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.829277 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7162d779-0e65-4a3f-82c5-189cb3867a0e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:25.829922 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-7162d779-0e65-4a3f-82c5-189cb3867a0e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lazy-loading 'fault' on Instance uuid 0eefd015-61dc-4aea-8dc9-4faabaf9a869 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:02:25.884057 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7162d779-0e65-4a3f-82c5-189cb3867a0e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:25.892450 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7162d779-0e65-4a3f-82c5-189cb3867a0e tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1313 microversion: 2.1 time: 0.144661 Jul 12 12:02:25.893334 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1343/2862] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:25 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:02:25.903662 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cc0a68cc-a75e-43a4-92e3-a677901a97aa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:25.911659 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cc0a68cc-a75e-43a4-92e3-a677901a97aa tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.311214 Jul 12 12:02:25.912404 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1520/2863] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:25 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:02:25.929168 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-02aa2f1c-90f5-42a2-8cfd-904be64af68b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:25.929797 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-02aa2f1c-90f5-42a2-8cfd-904be64af68b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:25.947532 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02aa2f1c-90f5-42a2-8cfd-904be64af68b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.948147 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02aa2f1c-90f5-42a2-8cfd-904be64af68b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:25.948422 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-23c1dc60-b076-4f8c-9815-c919d9832d40 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:25.948779 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-23c1dc60-b076-4f8c-9815-c919d9832d40 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:25.948952 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02aa2f1c-90f5-42a2-8cfd-904be64af68b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.949458 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-02aa2f1c-90f5-42a2-8cfd-904be64af68b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:25.955722 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-23c1dc60-b076-4f8c-9815-c919d9832d40 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.956196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-23c1dc60-b076-4f8c-9815-c919d9832d40 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:25.956983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-23c1dc60-b076-4f8c-9815-c919d9832d40 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:25.957427 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-23c1dc60-b076-4f8c-9815-c919d9832d40 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:26.039527 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-23c1dc60-b076-4f8c-9815-c919d9832d40 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:26.054649 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-23c1dc60-b076-4f8c-9815-c919d9832d40 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:26.054649 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-23c1dc60-b076-4f8c-9815-c919d9832d40 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:26.055925 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-23c1dc60-b076-4f8c-9815-c919d9832d40 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.112064 Jul 12 12:02:26.067739 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1521/2864] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:25 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:26.145793 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-02aa2f1c-90f5-42a2-8cfd-904be64af68b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:26.154639 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-02aa2f1c-90f5-42a2-8cfd-904be64af68b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1317 microversion: 2.1 time: 0.229507 Jul 12 12:02:26.155219 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1344/2865] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:25 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:26.336239 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-48d64cd2-f035-4eaf-a04a-c8d399a31802 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:26.336864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-48d64cd2-f035-4eaf-a04a-c8d399a31802 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:26.344450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-48d64cd2-f035-4eaf-a04a-c8d399a31802 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:26.344904 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-48d64cd2-f035-4eaf-a04a-c8d399a31802 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:26.345691 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-48d64cd2-f035-4eaf-a04a-c8d399a31802 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:26.346127 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-48d64cd2-f035-4eaf-a04a-c8d399a31802 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:26.438964 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-48d64cd2-f035-4eaf-a04a-c8d399a31802 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:26.451129 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-48d64cd2-f035-4eaf-a04a-c8d399a31802 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:26.451129 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-48d64cd2-f035-4eaf-a04a-c8d399a31802 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:26.451873 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-48d64cd2-f035-4eaf-a04a-c8d399a31802 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.119365 Jul 12 12:02:26.452443 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1522/2866] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:26 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:26.733810 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4817ef16-2001-467d-97e4-a39bb2c402a4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:26.734647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4817ef16-2001-467d-97e4-a39bb2c402a4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:26.742554 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4817ef16-2001-467d-97e4-a39bb2c402a4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:26.743040 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4817ef16-2001-467d-97e4-a39bb2c402a4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:26.743804 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4817ef16-2001-467d-97e4-a39bb2c402a4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:26.744323 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4817ef16-2001-467d-97e4-a39bb2c402a4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:26.891224 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4817ef16-2001-467d-97e4-a39bb2c402a4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:26.907412 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4817ef16-2001-467d-97e4-a39bb2c402a4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:26.908763 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4817ef16-2001-467d-97e4-a39bb2c402a4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:26.910051 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4817ef16-2001-467d-97e4-a39bb2c402a4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.180458 Jul 12 12:02:26.920283 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1345/2867] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:26 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:26.920536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-49140758-391c-4d7c-ba46-83b9a1626f05 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:26.920536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-49140758-391c-4d7c-ba46-83b9a1626f05 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:26.920536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-49140758-391c-4d7c-ba46-83b9a1626f05 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:26.920536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-49140758-391c-4d7c-ba46-83b9a1626f05 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:26.920536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-49140758-391c-4d7c-ba46-83b9a1626f05 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:26.921381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-49140758-391c-4d7c-ba46-83b9a1626f05 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:26.934839 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f8d9be29-50a8-4940-8ef9-15763aff9915 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:26.935855 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f8d9be29-50a8-4940-8ef9-15763aff9915 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:26.944852 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f8d9be29-50a8-4940-8ef9-15763aff9915 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:26.945514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f8d9be29-50a8-4940-8ef9-15763aff9915 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:26.946714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f8d9be29-50a8-4940-8ef9-15763aff9915 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:26.947336 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f8d9be29-50a8-4940-8ef9-15763aff9915 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:26.958678 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-49140758-391c-4d7c-ba46-83b9a1626f05 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:26.959588 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-49140758-391c-4d7c-ba46-83b9a1626f05 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:26.959888 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-49140758-391c-4d7c-ba46-83b9a1626f05 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lazy-loading 'fault' on Instance uuid 0eefd015-61dc-4aea-8dc9-4faabaf9a869 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:02:27.007076 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-49140758-391c-4d7c-ba46-83b9a1626f05 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c8a66c40024ed4b583cf187350a9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f630a8015def485db0ac46681a162960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:27.022213 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-49140758-391c-4d7c-ba46-83b9a1626f05 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 200 len: 1313 microversion: 2.1 time: 0.114612 Jul 12 12:02:27.024525 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1523/2868] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:26 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 1313 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:02:27.078861 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-acd87280-f6c1-4a97-9958-efe4e414c240 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:27.079490 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-acd87280-f6c1-4a97-9958-efe4e414c240 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:27.085862 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-acd87280-f6c1-4a97-9958-efe4e414c240 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:27.086320 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-acd87280-f6c1-4a97-9958-efe4e414c240 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:27.087097 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-acd87280-f6c1-4a97-9958-efe4e414c240 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:27.087535 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-acd87280-f6c1-4a97-9958-efe4e414c240 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:27.129584 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f8d9be29-50a8-4940-8ef9-15763aff9915 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:27.137802 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f8d9be29-50a8-4940-8ef9-15763aff9915 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1506 microversion: 2.1 time: 0.210291 Jul 12 12:02:27.145178 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1346/2869] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:26 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:27.184976 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5e648b71-e4e1-4799-a77f-65f9d817a0f1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:27.184976 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5e648b71-e4e1-4799-a77f-65f9d817a0f1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:27.192000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5e648b71-e4e1-4799-a77f-65f9d817a0f1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:27.192487 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5e648b71-e4e1-4799-a77f-65f9d817a0f1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:27.193351 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5e648b71-e4e1-4799-a77f-65f9d817a0f1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:27.193800 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5e648b71-e4e1-4799-a77f-65f9d817a0f1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:27.206028 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-acd87280-f6c1-4a97-9958-efe4e414c240 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:27.220889 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-acd87280-f6c1-4a97-9958-efe4e414c240 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:27.224180 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-acd87280-f6c1-4a97-9958-efe4e414c240 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:27.225683 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-acd87280-f6c1-4a97-9958-efe4e414c240 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.150947 Jul 12 12:02:27.226759 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1524/2870] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:27 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:27.350070 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5e648b71-e4e1-4799-a77f-65f9d817a0f1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:27.358333 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5e648b71-e4e1-4799-a77f-65f9d817a0f1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1317 microversion: 2.1 time: 0.185019 Jul 12 12:02:27.358915 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1347/2871] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:27 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:27.470491 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e734e935-bad0-4541-a80f-951143a8012e tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:27.471397 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e734e935-bad0-4541-a80f-951143a8012e tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:27.482658 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e734e935-bad0-4541-a80f-951143a8012e tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:27.484365 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e734e935-bad0-4541-a80f-951143a8012e tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:27.485184 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e734e935-bad0-4541-a80f-951143a8012e tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:27.485619 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e734e935-bad0-4541-a80f-951143a8012e tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:27.603149 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e734e935-bad0-4541-a80f-951143a8012e tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:27.613928 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e734e935-bad0-4541-a80f-951143a8012e tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:27.616222 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e734e935-bad0-4541-a80f-951143a8012e tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:27.617610 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e734e935-bad0-4541-a80f-951143a8012e tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.151285 Jul 12 12:02:27.618342 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1525/2872] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:27 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:27.934936 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f12ccaf7-9bc2-44c3-8d07-313a811b7bbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:27.936405 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f12ccaf7-9bc2-44c3-8d07-313a811b7bbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:27.944210 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f12ccaf7-9bc2-44c3-8d07-313a811b7bbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:27.944664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f12ccaf7-9bc2-44c3-8d07-313a811b7bbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:27.945667 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f12ccaf7-9bc2-44c3-8d07-313a811b7bbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:27.946111 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f12ccaf7-9bc2-44c3-8d07-313a811b7bbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:28.040955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4341a42c-2571-4d11-ac5b-63d811958da6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:28.041856 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4341a42c-2571-4d11-ac5b-63d811958da6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] [instance: 0eefd015-61dc-4aea-8dc9-4faabaf9a869] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:28.052158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4341a42c-2571-4d11-ac5b-63d811958da6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:28.052707 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4341a42c-2571-4d11-ac5b-63d811958da6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:28.053848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4341a42c-2571-4d11-ac5b-63d811958da6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:28.054033 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4341a42c-2571-4d11-ac5b-63d811958da6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:28.070210 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-4341a42c-2571-4d11-ac5b-63d811958da6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] HTTP exception thrown: Instance 0eefd015-61dc-4aea-8dc9-4faabaf9a869 could not be found. Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4341a42c-2571-4d11-ac5b-63d811958da6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Request method failure captured: Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 HTTP/1.1 Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWKmL0PKu8GjRTBtrrj_XvDRihVt_MuektaWxa6CfzloD9ekS9qZdVQ4oe9i4P4S-sJiMxLYuTn6LFZ9bHkolEieelEaxnmdYmd57GIt7in5-bZLcX7SM1m9CXjODzzHpltCdNceTRsFxCjXDr7THU09TjKzxvaDSSpcvI59WyyJ66A Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f630a8015def485db0ac46681a162960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f630a8015def485db0ac46681a162960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f630a8015def485db0ac46681a162960", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: f630a8015def485db0ac46681a162960 Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-976144579 Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: f0c8a66c40024ed4b583cf187350a9e0 Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ListServersNegativeTestJSON-976144579-project Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 0eefd015-61dc-4aea-8dc9-4faabaf9a869 could not be found. Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '0eefd015-61dc-4aea-8dc9-4faabaf9a869'} Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eefd015-61dc-4aea-8dc9-4faabaf9a869 could not be found. Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eefd015-61dc-4aea-8dc9-4faabaf9a869 could not be found. Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:28.072885 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:28.078431 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:28.078431 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:28.078431 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:28.078431 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:02:28.078431 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:02:28.078431 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eefd015-61dc-4aea-8dc9-4faabaf9a869 could not be found. Jul 12 12:02:28.078431 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:28.078431 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4341a42c-2571-4d11-ac5b-63d811958da6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] Returning 404 to user: Instance 0eefd015-61dc-4aea-8dc9-4faabaf9a869 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:02:28.078431 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4341a42c-2571-4d11-ac5b-63d811958da6 tempest-ListServersNegativeTestJSON-976144579 tempest-ListServersNegativeTestJSON-976144579-project] 10.222.0.50 "GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869" status: 404 len: 111 microversion: 2.1 time: 0.039704 Jul 12 12:02:28.078431 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1526/2873] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:28 2022] GET /compute/v2.1/servers/0eefd015-61dc-4aea-8dc9-4faabaf9a869 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 12:02:28.155592 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9e23aafc-e64f-4d88-8d0c-b20d90e0d0e5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:28.156608 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9e23aafc-e64f-4d88-8d0c-b20d90e0d0e5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:28.165860 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9e23aafc-e64f-4d88-8d0c-b20d90e0d0e5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:28.166323 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9e23aafc-e64f-4d88-8d0c-b20d90e0d0e5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:28.167131 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9e23aafc-e64f-4d88-8d0c-b20d90e0d0e5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:28.167585 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9e23aafc-e64f-4d88-8d0c-b20d90e0d0e5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:28.219730 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f12ccaf7-9bc2-44c3-8d07-313a811b7bbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:28.228817 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f12ccaf7-9bc2-44c3-8d07-313a811b7bbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:28.230573 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f12ccaf7-9bc2-44c3-8d07-313a811b7bbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:28.231837 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f12ccaf7-9bc2-44c3-8d07-313a811b7bbb tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.301006 Jul 12 12:02:28.232451 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1348/2874] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:27 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:28.244968 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-29ace0d7-4222-4168-92c6-b6b5c9128e1e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:28.245704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-29ace0d7-4222-4168-92c6-b6b5c9128e1e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:28.255731 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-29ace0d7-4222-4168-92c6-b6b5c9128e1e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:28.264401 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-29ace0d7-4222-4168-92c6-b6b5c9128e1e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:28.265445 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-29ace0d7-4222-4168-92c6-b6b5c9128e1e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:28.265906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-29ace0d7-4222-4168-92c6-b6b5c9128e1e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:28.287073 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9e23aafc-e64f-4d88-8d0c-b20d90e0d0e5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:28.297738 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9e23aafc-e64f-4d88-8d0c-b20d90e0d0e5 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 200 len: 1464 microversion: 2.1 time: 0.146710 Jul 12 12:02:28.316946 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1527/2875] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:28 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:02:28.375771 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e22bb887-6fbb-40a7-b4cd-c75521e71da1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:28.376898 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e22bb887-6fbb-40a7-b4cd-c75521e71da1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:28.392643 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e22bb887-6fbb-40a7-b4cd-c75521e71da1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:28.393653 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e22bb887-6fbb-40a7-b4cd-c75521e71da1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:28.394797 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e22bb887-6fbb-40a7-b4cd-c75521e71da1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:28.395436 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e22bb887-6fbb-40a7-b4cd-c75521e71da1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:28.480717 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:28.502869 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-29ace0d7-4222-4168-92c6-b6b5c9128e1e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:28.506540 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:28.515819 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-29ace0d7-4222-4168-92c6-b6b5c9128e1e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:28.517848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-29ace0d7-4222-4168-92c6-b6b5c9128e1e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:28.519212 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-29ace0d7-4222-4168-92c6-b6b5c9128e1e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.278344 Jul 12 12:02:28.532560 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1349/2876] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:28 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:28.541041 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-768a537d-d4e0-4e1d-aafc-9c7b87df84f8 req-2ec38a71-efd9-47d9-bbbe-a3347b94219e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e6138b-cb03-4d22-85cb-648fc991cd77", "name": "network-vif-deleted", "tag": "96e36a3f-9966-4f6e-b737-3fa8ad4f51d2"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:28.551051 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-768a537d-d4e0-4e1d-aafc-9c7b87df84f8 req-2ec38a71-efd9-47d9-bbbe-a3347b94219e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:28.551973 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-768a537d-d4e0-4e1d-aafc-9c7b87df84f8 req-2ec38a71-efd9-47d9-bbbe-a3347b94219e service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:28.565504 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-768a537d-d4e0-4e1d-aafc-9c7b87df84f8 req-2ec38a71-efd9-47d9-bbbe-a3347b94219e service nova] Creating event network-vif-deleted:96e36a3f-9966-4f6e-b737-3fa8ad4f51d2 for instance f6e6138b-cb03-4d22-85cb-648fc991cd77 on n-h1-849104-4 Jul 12 12:02:28.574186 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-768a537d-d4e0-4e1d-aafc-9c7b87df84f8 req-2ec38a71-efd9-47d9-bbbe-a3347b94219e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040265 Jul 12 12:02:28.576800 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1350/2877] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:28.638787 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ba829ff8-38bc-4c64-84f4-3524a5a88134 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:28.639707 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ba829ff8-38bc-4c64-84f4-3524a5a88134 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:28.646724 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=4 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:28.648693 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ba829ff8-38bc-4c64-84f4-3524a5a88134 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:28.649389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ba829ff8-38bc-4c64-84f4-3524a5a88134 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:28.650250 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ba829ff8-38bc-4c64-84f4-3524a5a88134 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:28.650699 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ba829ff8-38bc-4c64-84f4-3524a5a88134 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:28.702086 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e22bb887-6fbb-40a7-b4cd-c75521e71da1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:28.713818 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e22bb887-6fbb-40a7-b4cd-c75521e71da1 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1317 microversion: 2.1 time: 0.342823 Jul 12 12:02:28.715297 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1528/2878] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:28 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:02:28.736273 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ba829ff8-38bc-4c64-84f4-3524a5a88134 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:28.748296 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ba829ff8-38bc-4c64-84f4-3524a5a88134 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:28.750728 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ba829ff8-38bc-4c64-84f4-3524a5a88134 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:28.752355 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ba829ff8-38bc-4c64-84f4-3524a5a88134 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.118272 Jul 12 12:02:28.753662 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1351/2879] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:28 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:29.254129 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d162cbbb-716a-4e93-aab7-e5a10c23961f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:29.255652 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d162cbbb-716a-4e93-aab7-e5a10c23961f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:29.263802 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d162cbbb-716a-4e93-aab7-e5a10c23961f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:29.264581 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d162cbbb-716a-4e93-aab7-e5a10c23961f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:29.265550 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d162cbbb-716a-4e93-aab7-e5a10c23961f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:29.266142 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d162cbbb-716a-4e93-aab7-e5a10c23961f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:29.315536 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c9420b8f-0c19-4641-83e7-4927a713d195 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:29.316363 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c9420b8f-0c19-4641-83e7-4927a713d195 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: f6e6138b-cb03-4d22-85cb-648fc991cd77] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:29.320597 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=4 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:29.327493 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c9420b8f-0c19-4641-83e7-4927a713d195 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:29.327954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c9420b8f-0c19-4641-83e7-4927a713d195 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:29.328868 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c9420b8f-0c19-4641-83e7-4927a713d195 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:29.329315 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c9420b8f-0c19-4641-83e7-4927a713d195 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:29.349613 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-c9420b8f-0c19-4641-83e7-4927a713d195 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] HTTP exception thrown: Instance f6e6138b-cb03-4d22-85cb-648fc991cd77 could not be found. Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c9420b8f-0c19-4641-83e7-4927a713d195 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Request method failure captured: Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 HTTP/1.1 Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWJRn4dMU7Nzct3vx1xthLAXJTTc2azU7wqPqP0js7QtpOhM2oV7_V-SZLEAq2BugZVxND-PDhFEN8qTD2U4NxwF3ofNexnknZV0O9-i6Lz-x6W1bREeagzE7f5pAOCeJgEq_-3k-of953rLhUxL3oeuiFbF0XtxoMKcw5wP1jNMBJ0 Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 9c2da0a7a8cc49eaa09a6aff6f977dae Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-ServerRescueTestJSON-876897287 Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9c2da0a7a8cc49eaa09a6aff6f977dae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9c2da0a7a8cc49eaa09a6aff6f977dae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9c2da0a7a8cc49eaa09a6aff6f977dae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9c2da0a7a8cc49eaa09a6aff6f977dae", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-ServerRescueTestJSON-876897287 Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 9c2da0a7a8cc49eaa09a6aff6f977dae Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-ServerRescueTestJSON-876897287 Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-ServerRescueTestJSON-876897287-project Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 4731a65ac69548eaaa6ccb9049662968 Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-ServerRescueTestJSON-876897287-project Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance f6e6138b-cb03-4d22-85cb-648fc991cd77 could not be found. Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'f6e6138b-cb03-4d22-85cb-648fc991cd77'} Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6e6138b-cb03-4d22-85cb-648fc991cd77 could not be found. Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6e6138b-cb03-4d22-85cb-648fc991cd77 could not be found. Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:29.353469 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:29.363390 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:29.363390 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:29.363390 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:29.363390 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:02:29.363390 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:02:29.363390 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6e6138b-cb03-4d22-85cb-648fc991cd77 could not be found. Jul 12 12:02:29.363390 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:29.363390 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c9420b8f-0c19-4641-83e7-4927a713d195 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Returning 404 to user: Instance f6e6138b-cb03-4d22-85cb-648fc991cd77 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:02:29.363390 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c9420b8f-0c19-4641-83e7-4927a713d195 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77" status: 404 len: 111 microversion: 2.1 time: 0.043483 Jul 12 12:02:29.363390 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1352/2880] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:29 2022] GET /compute/v2.1/servers/f6e6138b-cb03-4d22-85cb-648fc991cd77 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 12:02:29.365077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-93edb268-0af9-4f7d-9485-3980fca2ac96 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:29.365576 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-93edb268-0af9-4f7d-9485-3980fca2ac96 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:29.373785 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93edb268-0af9-4f7d-9485-3980fca2ac96 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:29.374244 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93edb268-0af9-4f7d-9485-3980fca2ac96 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:29.375049 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93edb268-0af9-4f7d-9485-3980fca2ac96 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:29.375514 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-93edb268-0af9-4f7d-9485-3980fca2ac96 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:29.428877 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-93edb268-0af9-4f7d-9485-3980fca2ac96 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:02:29.529875 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=12 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:29.578077 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-93edb268-0af9-4f7d-9485-3980fca2ac96 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 204 len: 0 microversion: 2.1 time: 0.216842 Jul 12 12:02:29.581998 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1353/2881] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:02:29 2022] DELETE /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:02:29.596382 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-aee29c9c-8ca0-4450-8375-5b5a34b77285 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:29.597333 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-aee29c9c-8ca0-4450-8375-5b5a34b77285 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:29.615161 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aee29c9c-8ca0-4450-8375-5b5a34b77285 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:29.615945 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aee29c9c-8ca0-4450-8375-5b5a34b77285 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:29.617398 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aee29c9c-8ca0-4450-8375-5b5a34b77285 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:29.618314 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aee29c9c-8ca0-4450-8375-5b5a34b77285 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:29.627010 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d162cbbb-716a-4e93-aab7-e5a10c23961f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:29.647218 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d162cbbb-716a-4e93-aab7-e5a10c23961f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:29.678005 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d162cbbb-716a-4e93-aab7-e5a10c23961f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:29.681226 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d162cbbb-716a-4e93-aab7-e5a10c23961f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.432642 Jul 12 12:02:29.685697 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1529/2882] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:29 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:29.694641 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c9684eeb-73cd-4fa6-b8a7-7f5a98a6eeb3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:29.695434 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c9684eeb-73cd-4fa6-b8a7-7f5a98a6eeb3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:29.703040 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c9684eeb-73cd-4fa6-b8a7-7f5a98a6eeb3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:29.704443 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c9684eeb-73cd-4fa6-b8a7-7f5a98a6eeb3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:29.705715 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c9684eeb-73cd-4fa6-b8a7-7f5a98a6eeb3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:29.706910 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c9684eeb-73cd-4fa6-b8a7-7f5a98a6eeb3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:29.770956 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-aee29c9c-8ca0-4450-8375-5b5a34b77285 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:29.786411 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-aee29c9c-8ca0-4450-8375-5b5a34b77285 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:29.788289 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-aee29c9c-8ca0-4450-8375-5b5a34b77285 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:29.790529 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-aee29c9c-8ca0-4450-8375-5b5a34b77285 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.206784 Jul 12 12:02:29.791698 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1354/2883] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:29 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:29.799123 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bb7cd1fc-b195-4aaa-b530-cca70211a3f2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:29.802335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-bb7cd1fc-b195-4aaa-b530-cca70211a3f2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:29.815522 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb7cd1fc-b195-4aaa-b530-cca70211a3f2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:29.816441 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb7cd1fc-b195-4aaa-b530-cca70211a3f2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:29.818055 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb7cd1fc-b195-4aaa-b530-cca70211a3f2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:29.819073 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bb7cd1fc-b195-4aaa-b530-cca70211a3f2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:30.002243 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bb7cd1fc-b195-4aaa-b530-cca70211a3f2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:30.008385 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c9684eeb-73cd-4fa6-b8a7-7f5a98a6eeb3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:30.010963 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bb7cd1fc-b195-4aaa-b530-cca70211a3f2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1317 microversion: 2.1 time: 0.217435 Jul 12 12:02:30.018403 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c9684eeb-73cd-4fa6-b8a7-7f5a98a6eeb3 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1492 microversion: 2.1 time: 0.328960 Jul 12 12:02:30.029918 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1355/2884] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:29 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:30.029918 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2ca8020a-90d9-48e5-a6fc-90388d25bb73 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:30.030884 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-2ca8020a-90d9-48e5-a6fc-90388d25bb73 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:30.042499 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2ca8020a-90d9-48e5-a6fc-90388d25bb73 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:30.043357 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1530/2885] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:29 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1492 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:30.043890 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2ca8020a-90d9-48e5-a6fc-90388d25bb73 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:30.045362 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2ca8020a-90d9-48e5-a6fc-90388d25bb73 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:30.046258 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-2ca8020a-90d9-48e5-a6fc-90388d25bb73 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:30.148280 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2ca8020a-90d9-48e5-a6fc-90388d25bb73 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:30.158059 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2ca8020a-90d9-48e5-a6fc-90388d25bb73 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:30.160115 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-2ca8020a-90d9-48e5-a6fc-90388d25bb73 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:30.161499 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2ca8020a-90d9-48e5-a6fc-90388d25bb73 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.136648 Jul 12 12:02:30.162273 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1356/2886] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:30 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:30.706369 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-22940b71-132f-4985-9121-174813d3628b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:30.707860 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-22940b71-132f-4985-9121-174813d3628b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:30.717753 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22940b71-132f-4985-9121-174813d3628b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:30.718561 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22940b71-132f-4985-9121-174813d3628b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:30.719606 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22940b71-132f-4985-9121-174813d3628b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:30.720433 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-22940b71-132f-4985-9121-174813d3628b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:30.815966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c2a8ab62-3d8a-412e-8efb-2d6d3c77002b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:30.817543 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c2a8ab62-3d8a-412e-8efb-2d6d3c77002b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:30.829299 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2a8ab62-3d8a-412e-8efb-2d6d3c77002b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:30.830556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2a8ab62-3d8a-412e-8efb-2d6d3c77002b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:30.832853 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2a8ab62-3d8a-412e-8efb-2d6d3c77002b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:30.833821 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c2a8ab62-3d8a-412e-8efb-2d6d3c77002b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:30.935582 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c2a8ab62-3d8a-412e-8efb-2d6d3c77002b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:30.952670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c2a8ab62-3d8a-412e-8efb-2d6d3c77002b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:30.955049 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c2a8ab62-3d8a-412e-8efb-2d6d3c77002b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:30.956717 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c2a8ab62-3d8a-412e-8efb-2d6d3c77002b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.146173 Jul 12 12:02:30.957928 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1357/2887] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:30 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:31.032646 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-65483123-6a50-4dfb-b038-f6bb7bbdac3f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:31.033283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-65483123-6a50-4dfb-b038-f6bb7bbdac3f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:31.044691 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-65483123-6a50-4dfb-b038-f6bb7bbdac3f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:31.048985 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-65483123-6a50-4dfb-b038-f6bb7bbdac3f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:31.051893 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-65483123-6a50-4dfb-b038-f6bb7bbdac3f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:31.052417 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-65483123-6a50-4dfb-b038-f6bb7bbdac3f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:31.341607 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-65483123-6a50-4dfb-b038-f6bb7bbdac3f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:31.358215 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-65483123-6a50-4dfb-b038-f6bb7bbdac3f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1317 microversion: 2.1 time: 0.330896 Jul 12 12:02:31.360129 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1358/2888] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:31 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:31.372025 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-dbc58101-af03-40c0-809a-f3c285f58e25 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:31.372918 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-dbc58101-af03-40c0-809a-f3c285f58e25 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:31.388223 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dbc58101-af03-40c0-809a-f3c285f58e25 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:31.388675 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dbc58101-af03-40c0-809a-f3c285f58e25 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:31.389467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dbc58101-af03-40c0-809a-f3c285f58e25 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:31.389910 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-dbc58101-af03-40c0-809a-f3c285f58e25 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:31.542400 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-22940b71-132f-4985-9121-174813d3628b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:31.556237 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:31.562361 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-22940b71-132f-4985-9121-174813d3628b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:31.564391 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-22940b71-132f-4985-9121-174813d3628b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:31.566021 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-22940b71-132f-4985-9121-174813d3628b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.864682 Jul 12 12:02:31.577298 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1531/2889] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:30 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:31.584471 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-697300ec-9be6-43ee-91e5-4a4aa29e6a9c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:31.585661 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-697300ec-9be6-43ee-91e5-4a4aa29e6a9c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:31.594840 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-697300ec-9be6-43ee-91e5-4a4aa29e6a9c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:31.595707 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-697300ec-9be6-43ee-91e5-4a4aa29e6a9c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:31.596874 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-697300ec-9be6-43ee-91e5-4a4aa29e6a9c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:31.597822 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-697300ec-9be6-43ee-91e5-4a4aa29e6a9c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:31.633386 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-dbc58101-af03-40c0-809a-f3c285f58e25 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:31.646756 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-dbc58101-af03-40c0-809a-f3c285f58e25 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1492 microversion: 2.1 time: 0.284520 Jul 12 12:02:31.647729 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1359/2890] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:31 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1492 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:31.653751 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-0044b25e-8556-44df-a0e2-154755d690fd req-b30aa840-233a-4af8-91e2-103c084b04ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c11deeb-3a1a-477f-ab1c-cd66a5fef930", "name": "network-vif-plugged", "status": "completed", "tag": "4f655b24-a3d1-4d12-bfc2-6fee676ef485"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:31.663799 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-0044b25e-8556-44df-a0e2-154755d690fd req-b30aa840-233a-4af8-91e2-103c084b04ac service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:31.664407 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-0044b25e-8556-44df-a0e2-154755d690fd req-b30aa840-233a-4af8-91e2-103c084b04ac service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:31.684246 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-0044b25e-8556-44df-a0e2-154755d690fd req-b30aa840-233a-4af8-91e2-103c084b04ac service nova] Creating event network-vif-plugged:4f655b24-a3d1-4d12-bfc2-6fee676ef485 for instance 7c11deeb-3a1a-477f-ab1c-cd66a5fef930 on n-h2-849104-4 Jul 12 12:02:31.690581 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-0044b25e-8556-44df-a0e2-154755d690fd req-b30aa840-233a-4af8-91e2-103c084b04ac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041373 Jul 12 12:02:31.692153 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1360/2891] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:31.704170 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-697300ec-9be6-43ee-91e5-4a4aa29e6a9c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:31.713974 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-697300ec-9be6-43ee-91e5-4a4aa29e6a9c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:31.715616 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-697300ec-9be6-43ee-91e5-4a4aa29e6a9c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:31.716929 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-697300ec-9be6-43ee-91e5-4a4aa29e6a9c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.137203 Jul 12 12:02:31.717912 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1532/2892] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:31 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:31.983389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-137f1060-809c-497d-9b11-d336fdb8bc9b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:31.984782 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-137f1060-809c-497d-9b11-d336fdb8bc9b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:32.003639 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-137f1060-809c-497d-9b11-d336fdb8bc9b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:32.003959 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-137f1060-809c-497d-9b11-d336fdb8bc9b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:32.010087 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-137f1060-809c-497d-9b11-d336fdb8bc9b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:32.011773 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-137f1060-809c-497d-9b11-d336fdb8bc9b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:32.147210 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-137f1060-809c-497d-9b11-d336fdb8bc9b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:32.161536 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-137f1060-809c-497d-9b11-d336fdb8bc9b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:32.164895 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-137f1060-809c-497d-9b11-d336fdb8bc9b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:32.167134 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-137f1060-809c-497d-9b11-d336fdb8bc9b tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.190694 Jul 12 12:02:32.169258 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1361/2893] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:31 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:32.379721 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d289a9a6-138a-4f74-8a34-c09c340815b5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:32.381452 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d289a9a6-138a-4f74-8a34-c09c340815b5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:32.393555 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d289a9a6-138a-4f74-8a34-c09c340815b5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:32.394818 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d289a9a6-138a-4f74-8a34-c09c340815b5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:32.397135 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d289a9a6-138a-4f74-8a34-c09c340815b5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:32.398206 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d289a9a6-138a-4f74-8a34-c09c340815b5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:32.588482 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6f0cad73-2ad1-40f8-80d2-3f0937a53be5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:32.589511 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6f0cad73-2ad1-40f8-80d2-3f0937a53be5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:32.607043 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f0cad73-2ad1-40f8-80d2-3f0937a53be5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:32.607467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f0cad73-2ad1-40f8-80d2-3f0937a53be5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:32.609982 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f0cad73-2ad1-40f8-80d2-3f0937a53be5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:32.610591 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6f0cad73-2ad1-40f8-80d2-3f0937a53be5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:32.697024 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d289a9a6-138a-4f74-8a34-c09c340815b5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:32.714122 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d289a9a6-138a-4f74-8a34-c09c340815b5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1317 microversion: 2.1 time: 0.341669 Jul 12 12:02:32.715826 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1533/2894] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:32 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:32.725020 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-60d55e8a-2c1e-4a70-b821-dc37cec7b5c6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:32.725869 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-60d55e8a-2c1e-4a70-b821-dc37cec7b5c6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:32.750419 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-60d55e8a-2c1e-4a70-b821-dc37cec7b5c6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:32.751222 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-60d55e8a-2c1e-4a70-b821-dc37cec7b5c6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:32.752226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-60d55e8a-2c1e-4a70-b821-dc37cec7b5c6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:32.752844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-60d55e8a-2c1e-4a70-b821-dc37cec7b5c6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:32.995106 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6f0cad73-2ad1-40f8-80d2-3f0937a53be5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:33.008563 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6f0cad73-2ad1-40f8-80d2-3f0937a53be5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:33.023885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6f0cad73-2ad1-40f8-80d2-3f0937a53be5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:33.025553 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6f0cad73-2ad1-40f8-80d2-3f0937a53be5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.441813 Jul 12 12:02:33.036077 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1362/2895] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:32 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:33.036077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-70044e96-af71-4fd6-a369-807ca68366dc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:33.036077 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-70044e96-af71-4fd6-a369-807ca68366dc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:33.037045 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:33.049778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-70044e96-af71-4fd6-a369-807ca68366dc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:33.050332 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-70044e96-af71-4fd6-a369-807ca68366dc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:33.067818 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-70044e96-af71-4fd6-a369-807ca68366dc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:33.072596 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-70044e96-af71-4fd6-a369-807ca68366dc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:33.106800 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-60d55e8a-2c1e-4a70-b821-dc37cec7b5c6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:33.114576 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-60d55e8a-2c1e-4a70-b821-dc37cec7b5c6 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1492 microversion: 2.1 time: 0.397380 Jul 12 12:02:33.115103 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1534/2896] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:32 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1492 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:33.198659 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ceebb105-6adc-41e6-b187-041fc5903c3e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:33.199725 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ceebb105-6adc-41e6-b187-041fc5903c3e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:33.200823 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-70044e96-af71-4fd6-a369-807ca68366dc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:33.207285 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ceebb105-6adc-41e6-b187-041fc5903c3e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:33.208162 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ceebb105-6adc-41e6-b187-041fc5903c3e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:33.209266 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ceebb105-6adc-41e6-b187-041fc5903c3e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:33.210147 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ceebb105-6adc-41e6-b187-041fc5903c3e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:33.215282 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-70044e96-af71-4fd6-a369-807ca68366dc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:33.219672 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-70044e96-af71-4fd6-a369-807ca68366dc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:33.222082 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-70044e96-af71-4fd6-a369-807ca68366dc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.194061 Jul 12 12:02:33.223570 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1363/2897] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:33 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:33.314080 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ceebb105-6adc-41e6-b187-041fc5903c3e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:33.329057 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ceebb105-6adc-41e6-b187-041fc5903c3e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:33.331852 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ceebb105-6adc-41e6-b187-041fc5903c3e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:33.333976 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ceebb105-6adc-41e6-b187-041fc5903c3e tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.140372 Jul 12 12:02:33.335356 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1535/2898] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:33 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:33.676966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-f5d9ed71-ff36-4fe6-b865-1891a2bac16c req-7cfa0dd8-ec11-41cc-9fc6-c296f3db487d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e01337-f4c5-4f7d-ad6c-b84e035f064c", "name": "network-vif-deleted", "tag": "c5022b36-eb9d-406c-baba-17ffa943e001"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:33.686306 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-f5d9ed71-ff36-4fe6-b865-1891a2bac16c req-7cfa0dd8-ec11-41cc-9fc6-c296f3db487d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:33.686814 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-f5d9ed71-ff36-4fe6-b865-1891a2bac16c req-7cfa0dd8-ec11-41cc-9fc6-c296f3db487d service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:33.708802 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-f5d9ed71-ff36-4fe6-b865-1891a2bac16c req-7cfa0dd8-ec11-41cc-9fc6-c296f3db487d service nova] Creating event network-vif-deleted:c5022b36-eb9d-406c-baba-17ffa943e001 for instance e8e01337-f4c5-4f7d-ad6c-b84e035f064c on n-h2-849104-4 Jul 12 12:02:33.716419 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-f5d9ed71-ff36-4fe6-b865-1891a2bac16c req-7cfa0dd8-ec11-41cc-9fc6-c296f3db487d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042091 Jul 12 12:02:33.716419 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1364/2899] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:02:33.742490 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6481b177-b83b-4f97-85cb-142c114d0bdd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:33.744170 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6481b177-b83b-4f97-85cb-142c114d0bdd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:33.754278 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6481b177-b83b-4f97-85cb-142c114d0bdd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:33.754761 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6481b177-b83b-4f97-85cb-142c114d0bdd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:33.756215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6481b177-b83b-4f97-85cb-142c114d0bdd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:33.756215 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6481b177-b83b-4f97-85cb-142c114d0bdd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:33.968983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6481b177-b83b-4f97-85cb-142c114d0bdd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:33.979045 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6481b177-b83b-4f97-85cb-142c114d0bdd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1317 microversion: 2.1 time: 0.245552 Jul 12 12:02:33.980878 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1536/2900] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:33 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:34.047673 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-eae906bd-f094-4c0f-bafc-122ecc18d273 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:34.048580 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-eae906bd-f094-4c0f-bafc-122ecc18d273 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:34.056410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eae906bd-f094-4c0f-bafc-122ecc18d273 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:34.057146 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eae906bd-f094-4c0f-bafc-122ecc18d273 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:34.059793 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eae906bd-f094-4c0f-bafc-122ecc18d273 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:34.060699 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-eae906bd-f094-4c0f-bafc-122ecc18d273 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:34.141022 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e8b3c0c2-f9f1-4507-b304-e8200acf5151 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:34.142337 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e8b3c0c2-f9f1-4507-b304-e8200acf5151 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:34.155901 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e8b3c0c2-f9f1-4507-b304-e8200acf5151 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:34.157322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e8b3c0c2-f9f1-4507-b304-e8200acf5151 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:34.159015 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e8b3c0c2-f9f1-4507-b304-e8200acf5151 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:34.160024 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e8b3c0c2-f9f1-4507-b304-e8200acf5151 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:34.242019 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e8b3c0c2-f9f1-4507-b304-e8200acf5151 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:34.242964 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e8b3c0c2-f9f1-4507-b304-e8200acf5151 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:34.243710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-e8b3c0c2-f9f1-4507-b304-e8200acf5151 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lazy-loading 'fault' on Instance uuid e8e01337-f4c5-4f7d-ad6c-b84e035f064c {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:02:34.311715 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e8b3c0c2-f9f1-4507-b304-e8200acf5151 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4731a65ac69548eaaa6ccb9049662968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2da0a7a8cc49eaa09a6aff6f977dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:34.325339 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e8b3c0c2-f9f1-4507-b304-e8200acf5151 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 200 len: 1304 microversion: 2.1 time: 0.195347 Jul 12 12:02:34.327540 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1537/2901] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:34 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 1304 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:34.336695 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eae906bd-f094-4c0f-bafc-122ecc18d273 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:34.351697 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eae906bd-f094-4c0f-bafc-122ecc18d273 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:34.352689 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f3bab8c7-ce45-43c7-becc-6d72f6f974d8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:34.354902 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-eae906bd-f094-4c0f-bafc-122ecc18d273 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:34.356430 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f3bab8c7-ce45-43c7-becc-6d72f6f974d8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:34.357147 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-eae906bd-f094-4c0f-bafc-122ecc18d273 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.314378 Jul 12 12:02:34.362271 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1365/2902] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:34 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:34.366690 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f3bab8c7-ce45-43c7-becc-6d72f6f974d8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:34.369530 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f3bab8c7-ce45-43c7-becc-6d72f6f974d8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:34.370692 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f3bab8c7-ce45-43c7-becc-6d72f6f974d8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:34.371406 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f3bab8c7-ce45-43c7-becc-6d72f6f974d8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:34.374854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-215857dd-7b38-43a8-8412-a75988d95076 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:34.375940 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-215857dd-7b38-43a8-8412-a75988d95076 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:34.385283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-215857dd-7b38-43a8-8412-a75988d95076 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:34.386184 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-215857dd-7b38-43a8-8412-a75988d95076 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:34.387422 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-215857dd-7b38-43a8-8412-a75988d95076 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:34.388428 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-215857dd-7b38-43a8-8412-a75988d95076 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:34.483326 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f3bab8c7-ce45-43c7-becc-6d72f6f974d8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:34.493112 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-215857dd-7b38-43a8-8412-a75988d95076 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:34.497473 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f3bab8c7-ce45-43c7-becc-6d72f6f974d8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:34.500695 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f3bab8c7-ce45-43c7-becc-6d72f6f974d8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:34.502592 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f3bab8c7-ce45-43c7-becc-6d72f6f974d8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.173696 Jul 12 12:02:34.503496 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1538/2903] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:34 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:34.517403 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-215857dd-7b38-43a8-8412-a75988d95076 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:34.519289 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-215857dd-7b38-43a8-8412-a75988d95076 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:34.520368 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-215857dd-7b38-43a8-8412-a75988d95076 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.155282 Jul 12 12:02:34.521519 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1366/2904] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:34 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:35.004768 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-febbfe95-6016-4535-9e27-caa3ca0d3405 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:35.005585 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-febbfe95-6016-4535-9e27-caa3ca0d3405 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:35.014539 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-febbfe95-6016-4535-9e27-caa3ca0d3405 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.015253 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-febbfe95-6016-4535-9e27-caa3ca0d3405 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.016253 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-febbfe95-6016-4535-9e27-caa3ca0d3405 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.016931 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-febbfe95-6016-4535-9e27-caa3ca0d3405 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.191381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-febbfe95-6016-4535-9e27-caa3ca0d3405 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:35.199866 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-febbfe95-6016-4535-9e27-caa3ca0d3405 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1507 microversion: 2.1 time: 0.201888 Jul 12 12:02:35.211357 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1539/2905] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:34 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:35.218085 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-329ad367-2e50-415a-83d4-966dc0bc4f6d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:35.218789 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-329ad367-2e50-415a-83d4-966dc0bc4f6d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:35.227679 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-329ad367-2e50-415a-83d4-966dc0bc4f6d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.228367 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-329ad367-2e50-415a-83d4-966dc0bc4f6d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.229276 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-329ad367-2e50-415a-83d4-966dc0bc4f6d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.229828 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-329ad367-2e50-415a-83d4-966dc0bc4f6d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.256289 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:35.343628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-df6a90af-c6fb-418d-9b87-9b3cc3ef8be1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:35.344332 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-df6a90af-c6fb-418d-9b87-9b3cc3ef8be1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] [instance: e8e01337-f4c5-4f7d-ad6c-b84e035f064c] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:35.352677 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-df6a90af-c6fb-418d-9b87-9b3cc3ef8be1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.353715 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-df6a90af-c6fb-418d-9b87-9b3cc3ef8be1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.354768 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-df6a90af-c6fb-418d-9b87-9b3cc3ef8be1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.355583 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-df6a90af-c6fb-418d-9b87-9b3cc3ef8be1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.370542 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-df6a90af-c6fb-418d-9b87-9b3cc3ef8be1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] HTTP exception thrown: Instance e8e01337-f4c5-4f7d-ad6c-b84e035f064c could not be found. Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-df6a90af-c6fb-418d-9b87-9b3cc3ef8be1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Request method failure captured: Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c HTTP/1.1 Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWJRn4dMU7Nzct3vx1xthLAXJTTc2azU7wqPqP0js7QtpOhM2oV7_V-SZLEAq2BugZVxND-PDhFEN8qTD2U4NxwF3ofNexnknZV0O9-i6Lz-x6W1bREeagzE7f5pAOCeJgEq_-3k-of953rLhUxL3oeuiFbF0XtxoMKcw5wP1jNMBJ0 Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 9c2da0a7a8cc49eaa09a6aff6f977dae Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServerRescueTestJSON-876897287 Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9c2da0a7a8cc49eaa09a6aff6f977dae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9c2da0a7a8cc49eaa09a6aff6f977dae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9c2da0a7a8cc49eaa09a6aff6f977dae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9c2da0a7a8cc49eaa09a6aff6f977dae", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServerRescueTestJSON-876897287 Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 9c2da0a7a8cc49eaa09a6aff6f977dae Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServerRescueTestJSON-876897287 Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServerRescueTestJSON-876897287-project Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 4731a65ac69548eaaa6ccb9049662968 Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServerRescueTestJSON-876897287-project Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance e8e01337-f4c5-4f7d-ad6c-b84e035f064c could not be found. Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'e8e01337-f4c5-4f7d-ad6c-b84e035f064c'} Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e01337-f4c5-4f7d-ad6c-b84e035f064c could not be found. Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e01337-f4c5-4f7d-ad6c-b84e035f064c could not be found. Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:35.384802 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:35.391703 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:35.391703 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:35.391703 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:35.391703 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:02:35.391703 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:02:35.391703 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e01337-f4c5-4f7d-ad6c-b84e035f064c could not be found. Jul 12 12:02:35.391703 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:35.391703 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-df6a90af-c6fb-418d-9b87-9b3cc3ef8be1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] Returning 404 to user: Instance e8e01337-f4c5-4f7d-ad6c-b84e035f064c could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:02:35.391703 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-df6a90af-c6fb-418d-9b87-9b3cc3ef8be1 tempest-ServerRescueTestJSON-876897287 tempest-ServerRescueTestJSON-876897287-project] 10.222.0.50 "GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c" status: 404 len: 111 microversion: 2.1 time: 0.047428 Jul 12 12:02:35.391703 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1540/2906] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:35 2022] GET /compute/v2.1/servers/e8e01337-f4c5-4f7d-ad6c-b84e035f064c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 12:02:35.413675 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2bdc2b34-da03-4a0c-9317-d60f05748658 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:35.414884 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2bdc2b34-da03-4a0c-9317-d60f05748658 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:35.430586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2bdc2b34-da03-4a0c-9317-d60f05748658 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.430696 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2bdc2b34-da03-4a0c-9317-d60f05748658 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.431598 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2bdc2b34-da03-4a0c-9317-d60f05748658 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.432646 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2bdc2b34-da03-4a0c-9317-d60f05748658 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.439052 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-329ad367-2e50-415a-83d4-966dc0bc4f6d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:35.450473 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-329ad367-2e50-415a-83d4-966dc0bc4f6d tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1507 microversion: 2.1 time: 0.237478 Jul 12 12:02:35.451688 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1367/2907] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:35 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:35.477071 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-aee4ae33-0e63-40f6-b309-3b425818ae97 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:35.481563 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-aee4ae33-0e63-40f6-b309-3b425818ae97 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:35.492850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aee4ae33-0e63-40f6-b309-3b425818ae97 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.493755 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aee4ae33-0e63-40f6-b309-3b425818ae97 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.494933 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aee4ae33-0e63-40f6-b309-3b425818ae97 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.495723 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aee4ae33-0e63-40f6-b309-3b425818ae97 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.625147 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-aee4ae33-0e63-40f6-b309-3b425818ae97 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "PUT /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1079 microversion: 2.1 time: 0.157305 Jul 12 12:02:35.641648 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1368/2908] 10.222.0.50 () {60 vars in 1255 bytes} [Tue Jul 12 12:02:35 2022] PUT /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1079 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:35.658608 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1f62fc14-45e6-4b33-a021-be1308643171 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:35.659848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1f62fc14-45e6-4b33-a021-be1308643171 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:35.678943 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f62fc14-45e6-4b33-a021-be1308643171 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.680399 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f62fc14-45e6-4b33-a021-be1308643171 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.684097 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f62fc14-45e6-4b33-a021-be1308643171 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.686360 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1f62fc14-45e6-4b33-a021-be1308643171 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.803414 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2bdc2b34-da03-4a0c-9317-d60f05748658 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:35.819284 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2bdc2b34-da03-4a0c-9317-d60f05748658 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:35.822985 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2bdc2b34-da03-4a0c-9317-d60f05748658 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:35.826756 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2bdc2b34-da03-4a0c-9317-d60f05748658 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.437549 Jul 12 12:02:35.828270 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1541/2909] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:35 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:35.833749 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-65052db1-88c5-4328-8d61-ba8bfd04b04f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:35.834717 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-65052db1-88c5-4328-8d61-ba8bfd04b04f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:35.843450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65052db1-88c5-4328-8d61-ba8bfd04b04f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.844270 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65052db1-88c5-4328-8d61-ba8bfd04b04f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.847136 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65052db1-88c5-4328-8d61-ba8bfd04b04f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.848367 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-65052db1-88c5-4328-8d61-ba8bfd04b04f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.918156 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1f62fc14-45e6-4b33-a021-be1308643171 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:35.939397 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1f62fc14-45e6-4b33-a021-be1308643171 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:35.941556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1f62fc14-45e6-4b33-a021-be1308643171 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:35.943280 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1f62fc14-45e6-4b33-a021-be1308643171 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.298684 Jul 12 12:02:35.944477 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1369/2910] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:35 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:35.950433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-adf36007-79f5-432b-82d5-af1e6ae8e3a0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:35.951350 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-adf36007-79f5-432b-82d5-af1e6ae8e3a0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:35.961114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-adf36007-79f5-432b-82d5-af1e6ae8e3a0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.961952 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-adf36007-79f5-432b-82d5-af1e6ae8e3a0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.962968 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-adf36007-79f5-432b-82d5-af1e6ae8e3a0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:35.963674 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-adf36007-79f5-432b-82d5-af1e6ae8e3a0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:35.972917 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-65052db1-88c5-4328-8d61-ba8bfd04b04f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:35.993414 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-65052db1-88c5-4328-8d61-ba8bfd04b04f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:35.995168 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-65052db1-88c5-4328-8d61-ba8bfd04b04f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:36.005453 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-65052db1-88c5-4328-8d61-ba8bfd04b04f tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.171967 Jul 12 12:02:36.008355 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1542/2911] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:35 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:36.232014 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-adf36007-79f5-432b-82d5-af1e6ae8e3a0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:36.248375 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-adf36007-79f5-432b-82d5-af1e6ae8e3a0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1505 microversion: 2.1 time: 0.302563 Jul 12 12:02:36.249557 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1370/2912] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:35 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:36.265993 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2e543d1f-db06-4c2e-980b-1e5b8b0829b3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:36.266616 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2e543d1f-db06-4c2e-980b-1e5b8b0829b3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:36.274262 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e543d1f-db06-4c2e-980b-1e5b8b0829b3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:36.274725 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e543d1f-db06-4c2e-980b-1e5b8b0829b3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:36.275583 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e543d1f-db06-4c2e-980b-1e5b8b0829b3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:36.276065 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-2e543d1f-db06-4c2e-980b-1e5b8b0829b3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:36.653973 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2e543d1f-db06-4c2e-980b-1e5b8b0829b3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:36.665093 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2e543d1f-db06-4c2e-980b-1e5b8b0829b3 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1505 microversion: 2.1 time: 0.403582 Jul 12 12:02:36.676724 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1543/2913] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:36 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:36.687252 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:36.688920 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:36.695931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:36.696505 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:36.697359 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:36.698002 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:36.813526 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:02:36.814506 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:02:36.815605 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:02:36.816349 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:02:36.817215 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:02:36.881179 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bceb88b8-6d80-49bd-9ac1-59a58695b988 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:36.884501 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bceb88b8-6d80-49bd-9ac1-59a58695b988 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:36.918076 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:36.932675 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:36.933430 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:36.934905 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:36.935746 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:36.940500 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bceb88b8-6d80-49bd-9ac1-59a58695b988 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:36.946216 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bceb88b8-6d80-49bd-9ac1-59a58695b988 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:36.950924 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bceb88b8-6d80-49bd-9ac1-59a58695b988 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:36.954619 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bceb88b8-6d80-49bd-9ac1-59a58695b988 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:36.978912 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c5661671-d04a-413f-925e-39c6ff061de2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "POST /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930/action" status: 202 len: 1111 microversion: 2.1 time: 0.296206 Jul 12 12:02:36.980595 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1371/2914] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 12:02:36 2022] POST /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930/action => generated 1111 bytes in 299 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 12 12:02:36.996082 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a5fcec7a-9670-4200-9788-c72d2043290c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:36.997545 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a5fcec7a-9670-4200-9788-c72d2043290c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:37.010294 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5fcec7a-9670-4200-9788-c72d2043290c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:37.010959 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5fcec7a-9670-4200-9788-c72d2043290c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:37.012616 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5fcec7a-9670-4200-9788-c72d2043290c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:37.013389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5fcec7a-9670-4200-9788-c72d2043290c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:37.129021 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a5fcec7a-9670-4200-9788-c72d2043290c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:37.144773 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a5fcec7a-9670-4200-9788-c72d2043290c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:37.147084 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a5fcec7a-9670-4200-9788-c72d2043290c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:37.149501 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a5fcec7a-9670-4200-9788-c72d2043290c tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.166516 Jul 12 12:02:37.162497 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1372/2915] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:36 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:37.171558 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1397c6c5-ffe7-4aad-84ee-acad8628f5b0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:37.172850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1397c6c5-ffe7-4aad-84ee-acad8628f5b0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:37.186408 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1397c6c5-ffe7-4aad-84ee-acad8628f5b0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:37.187780 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1397c6c5-ffe7-4aad-84ee-acad8628f5b0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:37.189401 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1397c6c5-ffe7-4aad-84ee-acad8628f5b0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:37.190119 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1397c6c5-ffe7-4aad-84ee-acad8628f5b0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:37.410743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1397c6c5-ffe7-4aad-84ee-acad8628f5b0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:37.423645 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1397c6c5-ffe7-4aad-84ee-acad8628f5b0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.258880 Jul 12 12:02:37.425377 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1373/2916] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:37 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:37.442647 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f9c40558-ff95-4b71-95fd-9a0dc4de7e8c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:37.443281 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f9c40558-ff95-4b71-95fd-9a0dc4de7e8c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:37.461183 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f9c40558-ff95-4b71-95fd-9a0dc4de7e8c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:37.462107 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f9c40558-ff95-4b71-95fd-9a0dc4de7e8c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:37.463364 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f9c40558-ff95-4b71-95fd-9a0dc4de7e8c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:37.464080 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f9c40558-ff95-4b71-95fd-9a0dc4de7e8c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:37.611867 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bceb88b8-6d80-49bd-9ac1-59a58695b988 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:37.651322 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f9c40558-ff95-4b71-95fd-9a0dc4de7e8c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:37.669963 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f9c40558-ff95-4b71-95fd-9a0dc4de7e8c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:37.675627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bceb88b8-6d80-49bd-9ac1-59a58695b988 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:37.684931 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f9c40558-ff95-4b71-95fd-9a0dc4de7e8c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbdfd4821d54068b9d88d02b7e4665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93f657cdcbc43d7bbb578d424322e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:37.685461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bceb88b8-6d80-49bd-9ac1-59a58695b988 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:37.686740 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bceb88b8-6d80-49bd-9ac1-59a58695b988 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.842850 Jul 12 12:02:37.693612 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f9c40558-ff95-4b71-95fd-9a0dc4de7e8c tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 200 len: 1604 microversion: 2.42 time: 0.267123 Jul 12 12:02:37.698117 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1374/2917] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:37 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 1604 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:37.698950 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1544/2918] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:36 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:38.177305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-0b26c268-99ba-4ccd-b546-b81d3b3d6cfb tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:38.178266 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-0b26c268-99ba-4ccd-b546-b81d3b3d6cfb tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:38.188599 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b26c268-99ba-4ccd-b546-b81d3b3d6cfb tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:38.189052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b26c268-99ba-4ccd-b546-b81d3b3d6cfb tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:38.195734 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b26c268-99ba-4ccd-b546-b81d3b3d6cfb tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:38.196309 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-0b26c268-99ba-4ccd-b546-b81d3b3d6cfb tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:38.349203 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0b26c268-99ba-4ccd-b546-b81d3b3d6cfb tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:38.362319 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0b26c268-99ba-4ccd-b546-b81d3b3d6cfb tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:38.371552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-0b26c268-99ba-4ccd-b546-b81d3b3d6cfb tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:38.378803 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-0b26c268-99ba-4ccd-b546-b81d3b3d6cfb tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.206780 Jul 12 12:02:38.381954 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1545/2919] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:38 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:38.452204 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e0645e3e-6f95-427e-805d-598397dfefb0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:38.457393 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e0645e3e-6f95-427e-805d-598397dfefb0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:38.485705 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0645e3e-6f95-427e-805d-598397dfefb0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:38.486945 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0645e3e-6f95-427e-805d-598397dfefb0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:38.491966 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0645e3e-6f95-427e-805d-598397dfefb0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:38.493121 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e0645e3e-6f95-427e-805d-598397dfefb0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:38.707168 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f3fdcf9a-2515-413d-8a92-5cba14a183fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:38.708773 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f3fdcf9a-2515-413d-8a92-5cba14a183fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:38.721428 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf9a-2515-413d-8a92-5cba14a183fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:38.722152 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf9a-2515-413d-8a92-5cba14a183fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:38.723246 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf9a-2515-413d-8a92-5cba14a183fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:38.725011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf9a-2515-413d-8a92-5cba14a183fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:39.351243 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f3fdcf9a-2515-413d-8a92-5cba14a183fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:39.360288 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e0645e3e-6f95-427e-805d-598397dfefb0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:39.364476 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f3fdcf9a-2515-413d-8a92-5cba14a183fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:39.370213 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e0645e3e-6f95-427e-805d-598397dfefb0 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.930652 Jul 12 12:02:39.370897 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1375/2920] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:38 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:39.380742 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f3fdcf9a-2515-413d-8a92-5cba14a183fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:39.380742 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f3fdcf9a-2515-413d-8a92-5cba14a183fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.672644 Jul 12 12:02:39.381061 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fd699909-676a-4570-8ebd-1f096714afe5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:39.381234 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fd699909-676a-4570-8ebd-1f096714afe5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:39.390457 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1546/2921] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:38 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:39.398982 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f1e5b68e-d5bb-4f91-9234-96372bd2c170 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:39.399712 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f1e5b68e-d5bb-4f91-9234-96372bd2c170 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:39.400921 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd699909-676a-4570-8ebd-1f096714afe5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:39.401378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd699909-676a-4570-8ebd-1f096714afe5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:39.412657 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd699909-676a-4570-8ebd-1f096714afe5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:39.413727 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fd699909-676a-4570-8ebd-1f096714afe5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:39.415591 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f1e5b68e-d5bb-4f91-9234-96372bd2c170 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:39.416059 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f1e5b68e-d5bb-4f91-9234-96372bd2c170 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:39.417231 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f1e5b68e-d5bb-4f91-9234-96372bd2c170 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:39.417863 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f1e5b68e-d5bb-4f91-9234-96372bd2c170 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:39.456917 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-fd699909-676a-4570-8ebd-1f096714afe5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] HTTP exception thrown: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fd699909-676a-4570-8ebd-1f096714afe5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Request method failure captured: Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 HTTP/1.1 Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWEfTBFdJQsjHtzdQpdykoGiODNaRgcNZi6aoF3Z0_T9qYLsqys-pp9fhfUTXwbwfHCL8LsOFzXM-6LbN-TRJEL0E1caXTdrYG40JEIpspQ15KHlZa5NoTuccbUEFewV5ZbutBIWLPDKAae0qUkeBb-h7YMT2-OBbmntC2YM9sbJD-Y Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Openstack-Nova-Api-Version: 2.42 Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: f93f657cdcbc43d7bbb578d424322e05 Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1471085467 Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f93f657cdcbc43d7bbb578d424322e05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f93f657cdcbc43d7bbb578d424322e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f93f657cdcbc43d7bbb578d424322e05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f93f657cdcbc43d7bbb578d424322e05", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1471085467 Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: f93f657cdcbc43d7bbb578d424322e05 Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1471085467 Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-TaggedBootDevicesTest_v242-1471085467-project Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 9dbdfd4821d54068b9d88d02b7e4665f Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1471085467-project Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'bf15ce48-6829-4bdf-9b73-570b093f9725'} Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:39.458866 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:39.463267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:39.463267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:39.463267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:39.463267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:39.463267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:02:39.463267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:02:39.463267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:39.463267 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:02:39.463267 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fd699909-676a-4570-8ebd-1f096714afe5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Returning 404 to user: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:02:39.466932 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fd699909-676a-4570-8ebd-1f096714afe5 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 404 len: 111 microversion: 2.42 time: 0.083663 Jul 12 12:02:39.470427 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1376/2922] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:39 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 12:02:39.479395 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1151ab53-090d-43f3-a813-3e4fb6724ec6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '.version_select at 0x7f5e0a780700>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:39.536308 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1151ab53-090d-43f3-a813-3e4fb6724ec6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-180241138" status: 204 len: 0 microversion: 2.42 time: 0.063785 Jul 12 12:02:39.538625 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1377/2923] 10.222.0.50 () {60 vars in 1258 bytes} [Tue Jul 12 12:02:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-180241138 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 12:02:39.756663 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f1e5b68e-d5bb-4f91-9234-96372bd2c170 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:39.798958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f1e5b68e-d5bb-4f91-9234-96372bd2c170 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:39.801511 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f1e5b68e-d5bb-4f91-9234-96372bd2c170 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:39.808091 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f1e5b68e-d5bb-4f91-9234-96372bd2c170 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.413145 Jul 12 12:02:39.809691 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1547/2924] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:39 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:40.194662 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-480df999-581d-40e2-b81b-20c6765da4e1 req-e8bf904a-976e-49cd-b3b4-8cbc51365864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6834c01a-284c-47fc-8939-403833f0ebd8", "name": "network-vif-unplugged", "status": "completed", "tag": "5ac103df-1ff9-40af-8256-5349b52e1acc"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:40.215378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-480df999-581d-40e2-b81b-20c6765da4e1 req-e8bf904a-976e-49cd-b3b4-8cbc51365864 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:40.216406 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-480df999-581d-40e2-b81b-20c6765da4e1 req-e8bf904a-976e-49cd-b3b4-8cbc51365864 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:40.252023 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-480df999-581d-40e2-b81b-20c6765da4e1 req-e8bf904a-976e-49cd-b3b4-8cbc51365864 service nova] Creating event network-vif-unplugged:5ac103df-1ff9-40af-8256-5349b52e1acc for instance 6834c01a-284c-47fc-8939-403833f0ebd8 on n-h1-849104-4 Jul 12 12:02:40.257645 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-480df999-581d-40e2-b81b-20c6765da4e1 req-e8bf904a-976e-49cd-b3b4-8cbc51365864 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066599 Jul 12 12:02:40.259309 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1378/2925] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:40.387882 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-db8ef847-1511-42e1-8b15-94bfebb6df48 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:40.388890 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-db8ef847-1511-42e1-8b15-94bfebb6df48 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:40.398364 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-1b55e496-51a7-4667-9d13-40740cb5fc41 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:40.399879 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-1b55e496-51a7-4667-9d13-40740cb5fc41 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:40.416085 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db8ef847-1511-42e1-8b15-94bfebb6df48 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:40.419139 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1b55e496-51a7-4667-9d13-40740cb5fc41 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:40.420100 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db8ef847-1511-42e1-8b15-94bfebb6df48 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:40.421137 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db8ef847-1511-42e1-8b15-94bfebb6df48 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:40.421868 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1b55e496-51a7-4667-9d13-40740cb5fc41 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:40.423078 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-db8ef847-1511-42e1-8b15-94bfebb6df48 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:40.423656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1b55e496-51a7-4667-9d13-40740cb5fc41 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:40.425422 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-1b55e496-51a7-4667-9d13-40740cb5fc41 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:40.883738 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1b55e496-51a7-4667-9d13-40740cb5fc41 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:40.918365 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1b55e496-51a7-4667-9d13-40740cb5fc41 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:40.932379 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-1b55e496-51a7-4667-9d13-40740cb5fc41 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:40.939082 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-1b55e496-51a7-4667-9d13-40740cb5fc41 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.541987 Jul 12 12:02:40.947481 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1379/2926] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:40 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:40.956465 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-aebdb97a-5be7-4e92-bdea-4ea145240d25 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:40.958093 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-aebdb97a-5be7-4e92-bdea-4ea145240d25 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:40.982010 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aebdb97a-5be7-4e92-bdea-4ea145240d25 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:40.983530 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aebdb97a-5be7-4e92-bdea-4ea145240d25 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:40.985330 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aebdb97a-5be7-4e92-bdea-4ea145240d25 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:40.986042 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-aebdb97a-5be7-4e92-bdea-4ea145240d25 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:41.120987 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-aebdb97a-5be7-4e92-bdea-4ea145240d25 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:41.135363 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-aebdb97a-5be7-4e92-bdea-4ea145240d25 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:41.140290 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-aebdb97a-5be7-4e92-bdea-4ea145240d25 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:41.143159 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-aebdb97a-5be7-4e92-bdea-4ea145240d25 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.193010 Jul 12 12:02:41.145961 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1380/2927] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:40 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:41.290807 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-db8ef847-1511-42e1-8b15-94bfebb6df48 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:41.295927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:41.307460 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-db8ef847-1511-42e1-8b15-94bfebb6df48 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.923553 Jul 12 12:02:41.316561 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1548/2928] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:40 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:41.960675 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-480cb7f1-0590-43c8-89d6-503a187690fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:41.962431 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-480cb7f1-0590-43c8-89d6-503a187690fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:41.986243 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-480cb7f1-0590-43c8-89d6-503a187690fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:41.987214 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-480cb7f1-0590-43c8-89d6-503a187690fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:41.988278 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-480cb7f1-0590-43c8-89d6-503a187690fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:41.993954 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-480cb7f1-0590-43c8-89d6-503a187690fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:42.167233 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f9035012-dd8e-4348-8b38-41c0a9398473 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:42.168129 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f9035012-dd8e-4348-8b38-41c0a9398473 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:42.200241 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9035012-dd8e-4348-8b38-41c0a9398473 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:42.205387 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9035012-dd8e-4348-8b38-41c0a9398473 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:42.213414 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9035012-dd8e-4348-8b38-41c0a9398473 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:42.215317 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f9035012-dd8e-4348-8b38-41c0a9398473 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:42.490639 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f9035012-dd8e-4348-8b38-41c0a9398473 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:42.523498 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f9035012-dd8e-4348-8b38-41c0a9398473 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:42.526818 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f9035012-dd8e-4348-8b38-41c0a9398473 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:42.534857 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-480cb7f1-0590-43c8-89d6-503a187690fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:42.547768 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f9035012-dd8e-4348-8b38-41c0a9398473 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.385138 Jul 12 12:02:42.558871 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1549/2929] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:42 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:42.584007 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-480cb7f1-0590-43c8-89d6-503a187690fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:42.589178 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-289bb517-c849-49a1-b817-5c955603d705 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:42.590767 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-289bb517-c849-49a1-b817-5c955603d705 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:42.594937 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-480cb7f1-0590-43c8-89d6-503a187690fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:42.597409 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-480cb7f1-0590-43c8-89d6-503a187690fa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.641371 Jul 12 12:02:42.598877 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1381/2930] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:41 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:42.618193 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-761068dc-9806-4615-9b2e-921bcf2836fa req-0b916519-cb25-44ce-b526-d307f250f05c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6834c01a-284c-47fc-8939-403833f0ebd8", "tag": "5ac103df-1ff9-40af-8256-5349b52e1acc"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:42.625936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-289bb517-c849-49a1-b817-5c955603d705 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:42.627116 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-289bb517-c849-49a1-b817-5c955603d705 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:42.628857 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-289bb517-c849-49a1-b817-5c955603d705 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:42.632792 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-289bb517-c849-49a1-b817-5c955603d705 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:42.664010 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-761068dc-9806-4615-9b2e-921bcf2836fa req-0b916519-cb25-44ce-b526-d307f250f05c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:42.665038 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-761068dc-9806-4615-9b2e-921bcf2836fa req-0b916519-cb25-44ce-b526-d307f250f05c service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:42.713430 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-761068dc-9806-4615-9b2e-921bcf2836fa req-0b916519-cb25-44ce-b526-d307f250f05c service nova] Creating event network-changed:5ac103df-1ff9-40af-8256-5349b52e1acc for instance 6834c01a-284c-47fc-8939-403833f0ebd8 on n-h1-849104-4 Jul 12 12:02:42.723073 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-761068dc-9806-4615-9b2e-921bcf2836fa req-0b916519-cb25-44ce-b526-d307f250f05c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117539 Jul 12 12:02:42.723977 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1382/2931] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:43.598861 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bf0a18bd-b08d-415c-9253-50db60648b39 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:43.609683 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-bf0a18bd-b08d-415c-9253-50db60648b39 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:43.671738 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bf0a18bd-b08d-415c-9253-50db60648b39 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:43.672988 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bf0a18bd-b08d-415c-9253-50db60648b39 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:43.674740 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bf0a18bd-b08d-415c-9253-50db60648b39 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:43.675848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bf0a18bd-b08d-415c-9253-50db60648b39 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:43.822084 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bf0a18bd-b08d-415c-9253-50db60648b39 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:43.848451 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bf0a18bd-b08d-415c-9253-50db60648b39 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:43.853666 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bf0a18bd-b08d-415c-9253-50db60648b39 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:43.857554 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bf0a18bd-b08d-415c-9253-50db60648b39 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.268949 Jul 12 12:02:43.859422 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1383/2932] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:43 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:43.870006 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8832f686-16e4-48da-b777-3a5a772677b4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:43.871704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8832f686-16e4-48da-b777-3a5a772677b4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:43.887866 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8832f686-16e4-48da-b777-3a5a772677b4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:43.894189 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8832f686-16e4-48da-b777-3a5a772677b4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:43.896819 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8832f686-16e4-48da-b777-3a5a772677b4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:43.898062 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8832f686-16e4-48da-b777-3a5a772677b4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:43.952772 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:44.149424 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-289bb517-c849-49a1-b817-5c955603d705 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:44.232206 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-289bb517-c849-49a1-b817-5c955603d705 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 1.668784 Jul 12 12:02:44.255157 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1550/2933] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:42 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:44.452507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8832f686-16e4-48da-b777-3a5a772677b4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:44.472714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8832f686-16e4-48da-b777-3a5a772677b4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:44.481457 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8832f686-16e4-48da-b777-3a5a772677b4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:44.487377 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8832f686-16e4-48da-b777-3a5a772677b4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.625671 Jul 12 12:02:44.489863 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1384/2934] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:43 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:44.891960 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-957bd14c-2e65-4665-886e-4f7ed48d06ee tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:44.893283 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-957bd14c-2e65-4665-886e-4f7ed48d06ee tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:44.904635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-957bd14c-2e65-4665-886e-4f7ed48d06ee tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:44.907065 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-957bd14c-2e65-4665-886e-4f7ed48d06ee tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:44.908304 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-957bd14c-2e65-4665-886e-4f7ed48d06ee tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:44.916542 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-957bd14c-2e65-4665-886e-4f7ed48d06ee tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:45.065660 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-957bd14c-2e65-4665-886e-4f7ed48d06ee tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:45.087550 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-957bd14c-2e65-4665-886e-4f7ed48d06ee tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:45.089184 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-957bd14c-2e65-4665-886e-4f7ed48d06ee tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:45.090945 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-957bd14c-2e65-4665-886e-4f7ed48d06ee tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.203077 Jul 12 12:02:45.103482 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1551/2935] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:44 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:45.271928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f6e25458-f3f6-4bc0-a1f9-ea4c46a30342 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:45.271928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f6e25458-f3f6-4bc0-a1f9-ea4c46a30342 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:45.295619 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f6e25458-f3f6-4bc0-a1f9-ea4c46a30342 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:45.296819 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f6e25458-f3f6-4bc0-a1f9-ea4c46a30342 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:45.298994 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f6e25458-f3f6-4bc0-a1f9-ea4c46a30342 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:45.302467 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f6e25458-f3f6-4bc0-a1f9-ea4c46a30342 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:45.510522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-420c52e7-618c-4692-882b-1e4a04217ea1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:45.511715 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-420c52e7-618c-4692-882b-1e4a04217ea1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:45.537437 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-420c52e7-618c-4692-882b-1e4a04217ea1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:45.538289 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-420c52e7-618c-4692-882b-1e4a04217ea1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:45.539317 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-420c52e7-618c-4692-882b-1e4a04217ea1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:45.539763 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-420c52e7-618c-4692-882b-1e4a04217ea1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:45.999087 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-420c52e7-618c-4692-882b-1e4a04217ea1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:46.037525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-420c52e7-618c-4692-882b-1e4a04217ea1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:46.043172 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-420c52e7-618c-4692-882b-1e4a04217ea1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:46.046640 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-420c52e7-618c-4692-882b-1e4a04217ea1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.539886 Jul 12 12:02:46.051421 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1552/2936] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:45 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:46.066899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f6e25458-f3f6-4bc0-a1f9-ea4c46a30342 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:46.079767 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f6e25458-f3f6-4bc0-a1f9-ea4c46a30342 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.819174 Jul 12 12:02:46.109765 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1385/2937] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:45 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:46.114285 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6a15714e-126c-42a7-9e5d-4f74a2805931 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:46.115158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6a15714e-126c-42a7-9e5d-4f74a2805931 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:46.140293 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a15714e-126c-42a7-9e5d-4f74a2805931 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:46.141071 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a15714e-126c-42a7-9e5d-4f74a2805931 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:46.142420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a15714e-126c-42a7-9e5d-4f74a2805931 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:46.142880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6a15714e-126c-42a7-9e5d-4f74a2805931 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:46.439325 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6a15714e-126c-42a7-9e5d-4f74a2805931 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:46.459275 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6a15714e-126c-42a7-9e5d-4f74a2805931 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:46.465881 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6a15714e-126c-42a7-9e5d-4f74a2805931 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:46.467118 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6a15714e-126c-42a7-9e5d-4f74a2805931 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.358987 Jul 12 12:02:46.474530 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1553/2938] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:46 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:02:47.073987 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a5966ad0-4c47-4c58-b06b-9495186710fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:47.074863 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a5966ad0-4c47-4c58-b06b-9495186710fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:47.098918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-61faf2e2-a5a9-481f-863c-981b688ffe14 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:47.100186 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-61faf2e2-a5a9-481f-863c-981b688ffe14 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:47.105520 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5966ad0-4c47-4c58-b06b-9495186710fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:47.106317 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5966ad0-4c47-4c58-b06b-9495186710fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:47.114034 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5966ad0-4c47-4c58-b06b-9495186710fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:47.114863 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a5966ad0-4c47-4c58-b06b-9495186710fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:47.132053 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61faf2e2-a5a9-481f-863c-981b688ffe14 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:47.138630 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61faf2e2-a5a9-481f-863c-981b688ffe14 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:47.142370 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61faf2e2-a5a9-481f-863c-981b688ffe14 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:47.144568 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-61faf2e2-a5a9-481f-863c-981b688ffe14 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:47.629727 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-61faf2e2-a5a9-481f-863c-981b688ffe14 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:47.656463 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-61faf2e2-a5a9-481f-863c-981b688ffe14 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.562247 Jul 12 12:02:47.687190 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1554/2939] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:47 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:47.708416 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a5966ad0-4c47-4c58-b06b-9495186710fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:47.714927 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9185e95a-3141-402f-8fc1-e4deac22e3c4 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:47.716618 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9185e95a-3141-402f-8fc1-e4deac22e3c4 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:47.742035 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a5966ad0-4c47-4c58-b06b-9495186710fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:47.750533 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a5966ad0-4c47-4c58-b06b-9495186710fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:47.763788 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a5966ad0-4c47-4c58-b06b-9495186710fc tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.691674 Jul 12 12:02:47.765746 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1386/2940] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:47 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:47.767308 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9185e95a-3141-402f-8fc1-e4deac22e3c4 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:47.771678 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9185e95a-3141-402f-8fc1-e4deac22e3c4 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:47.776855 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9185e95a-3141-402f-8fc1-e4deac22e3c4 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:47.782988 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9185e95a-3141-402f-8fc1-e4deac22e3c4 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:47.799025 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c77e085f-a1c7-4321-b839-45090a99ff25 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:47.806472 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c77e085f-a1c7-4321-b839-45090a99ff25 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:47.823114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c77e085f-a1c7-4321-b839-45090a99ff25 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:47.824180 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c77e085f-a1c7-4321-b839-45090a99ff25 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:47.824994 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c77e085f-a1c7-4321-b839-45090a99ff25 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:47.825442 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c77e085f-a1c7-4321-b839-45090a99ff25 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:47.903675 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c77e085f-a1c7-4321-b839-45090a99ff25 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.131650 Jul 12 12:02:47.907015 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1387/2941] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 12:02:47 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 12:02:48.021655 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6006c398-66af-40d9-be7c-9726458d9fea tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:48.022907 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6006c398-66af-40d9-be7c-9726458d9fea tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:48.049934 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6006c398-66af-40d9-be7c-9726458d9fea tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:48.054885 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6006c398-66af-40d9-be7c-9726458d9fea tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:48.060125 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6006c398-66af-40d9-be7c-9726458d9fea tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:48.061074 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6006c398-66af-40d9-be7c-9726458d9fea tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:48.148552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9185e95a-3141-402f-8fc1-e4deac22e3c4 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:48.164607 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6006c398-66af-40d9-be7c-9726458d9fea tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.147537 Jul 12 12:02:48.166329 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1388/2942] 10.222.0.50 () {58 vars in 1301 bytes} [Tue Jul 12 12:02:48 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998/os-volume_attachments => generated 25 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 12:02:48.172341 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9185e95a-3141-402f-8fc1-e4deac22e3c4 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:48.176836 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9185e95a-3141-402f-8fc1-e4deac22e3c4 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:48.183737 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9185e95a-3141-402f-8fc1-e4deac22e3c4 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1366 microversion: 2.57 time: 0.493651 Jul 12 12:02:48.187152 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1555/2943] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:47 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1366 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:48.294201 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4094f994-4bab-4637-b044-742be4b2252d tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:48.294807 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4094f994-4bab-4637-b044-742be4b2252d tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:48.304756 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4094f994-4bab-4637-b044-742be4b2252d tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:48.305297 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4094f994-4bab-4637-b044-742be4b2252d tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:48.306238 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4094f994-4bab-4637-b044-742be4b2252d tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:48.306776 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4094f994-4bab-4637-b044-742be4b2252d tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:48.362718 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4094f994-4bab-4637-b044-742be4b2252d tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:02:48.552704 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4094f994-4bab-4637-b044-742be4b2252d tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 204 len: 0 microversion: 2.1 time: 0.262295 Jul 12 12:02:48.554158 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1389/2944] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:02:48 2022] DELETE /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:02:48.568516 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-470ffbe0-aaf7-47d2-adcf-6116bde23a77 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:48.570305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-470ffbe0-aaf7-47d2-adcf-6116bde23a77 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:48.579603 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:48.584611 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-470ffbe0-aaf7-47d2-adcf-6116bde23a77 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:48.585817 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-470ffbe0-aaf7-47d2-adcf-6116bde23a77 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:48.587509 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-470ffbe0-aaf7-47d2-adcf-6116bde23a77 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:48.588720 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-470ffbe0-aaf7-47d2-adcf-6116bde23a77 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:48.697216 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-324b4d63-aab8-4e3a-aab4-e28f24a228a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:48.699806 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-324b4d63-aab8-4e3a-aab4-e28f24a228a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:48.718103 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-324b4d63-aab8-4e3a-aab4-e28f24a228a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:48.718410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-324b4d63-aab8-4e3a-aab4-e28f24a228a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:48.726173 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-324b4d63-aab8-4e3a-aab4-e28f24a228a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:48.726435 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-324b4d63-aab8-4e3a-aab4-e28f24a228a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:48.920268 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-324b4d63-aab8-4e3a-aab4-e28f24a228a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:48.935774 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-324b4d63-aab8-4e3a-aab4-e28f24a228a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.245375 Jul 12 12:02:48.953687 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1390/2945] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:48 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:49.223443 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a335a9ea-5141-433e-8819-779122ab1441 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Action: 'create', calling method: .version_select at 0x7f5e0b074d30>, body: {"keypair": {"name": "tempest-keypair-228147427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+HGSgih24bqRbzx8uKmgbAMfJXpSmPToNhOp8ku2lEFsv5LI07jeqvjUiakyVWcA/SefHRk68A023jGC97VGSQ9x5Rqgav3E2DP07aYtte9Wt2vxlmLYn3JZr29QACcw=="}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:49.268145 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a335a9ea-5141-433e-8819-779122ab1441 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Getting quotas for project 47db0ac76b374ba08a1693a94ddff731. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:02:49.280766 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-a335a9ea-5141-433e-8819-779122ab1441 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Getting quotas for user 9c54b84fd2154250b8dc326b87923c47 and project 47db0ac76b374ba08a1693a94ddff731. Resources: {'key_pairs'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:02:49.362452 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a335a9ea-5141-433e-8819-779122ab1441 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.406327 Jul 12 12:02:49.368638 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1391/2946] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Jul 12 12:02:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:49.387591 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d7953114-e101-446c-bd27-b71f38b46fa2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:49.399534 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d7953114-e101-446c-bd27-b71f38b46fa2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:49.412390 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7953114-e101-446c-bd27-b71f38b46fa2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:49.413610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7953114-e101-446c-bd27-b71f38b46fa2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:49.415396 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7953114-e101-446c-bd27-b71f38b46fa2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:49.416550 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d7953114-e101-446c-bd27-b71f38b46fa2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:49.750594 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-470ffbe0-aaf7-47d2-adcf-6116bde23a77 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:49.782638 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-470ffbe0-aaf7-47d2-adcf-6116bde23a77 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1680 microversion: 2.1 time: 1.221438 Jul 12 12:02:49.783707 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1556/2947] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:48 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1680 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:49.823334 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-854efaa9-6881-4b00-974c-a405dfb65d51 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:49.842761 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-854efaa9-6881-4b00-974c-a405dfb65d51 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:49.869227 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-854efaa9-6881-4b00-974c-a405dfb65d51 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:49.875021 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-854efaa9-6881-4b00-974c-a405dfb65d51 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:49.880764 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-854efaa9-6881-4b00-974c-a405dfb65d51 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:49.896169 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-854efaa9-6881-4b00-974c-a405dfb65d51 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:50.132976 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-854efaa9-6881-4b00-974c-a405dfb65d51 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:50.156658 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-854efaa9-6881-4b00-974c-a405dfb65d51 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:50.159678 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-854efaa9-6881-4b00-974c-a405dfb65d51 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:50.162706 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-854efaa9-6881-4b00-974c-a405dfb65d51 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1372 microversion: 2.57 time: 0.367077 Jul 12 12:02:50.164577 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1557/2948] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:49 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:50.225920 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-bdeb7be1-ba49-459e-bc33-e85f4ef9fd57 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:50.227631 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-bdeb7be1-ba49-459e-bc33-e85f4ef9fd57 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:50.240525 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bdeb7be1-ba49-459e-bc33-e85f4ef9fd57 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:50.241699 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bdeb7be1-ba49-459e-bc33-e85f4ef9fd57 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:50.243837 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bdeb7be1-ba49-459e-bc33-e85f4ef9fd57 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:50.246474 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-bdeb7be1-ba49-459e-bc33-e85f4ef9fd57 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:50.404093 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d7953114-e101-446c-bd27-b71f38b46fa2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:50.422103 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d7953114-e101-446c-bd27-b71f38b46fa2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:50.431425 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d7953114-e101-446c-bd27-b71f38b46fa2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:50.434260 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d7953114-e101-446c-bd27-b71f38b46fa2 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 1.061213 Jul 12 12:02:50.437371 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1392/2949] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:49 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:50.448943 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-284bdc2e-66d0-4d8e-942b-ecb8b9894dbd req-24c07ab8-5f60-4c07-ba12-5b235768630b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6834c01a-284c-47fc-8939-403833f0ebd8", "name": "network-vif-unplugged", "status": "completed", "tag": "5ac103df-1ff9-40af-8256-5349b52e1acc"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:50.484260 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-284bdc2e-66d0-4d8e-942b-ecb8b9894dbd req-24c07ab8-5f60-4c07-ba12-5b235768630b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:50.485084 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-284bdc2e-66d0-4d8e-942b-ecb8b9894dbd req-24c07ab8-5f60-4c07-ba12-5b235768630b service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:50.543447 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-284bdc2e-66d0-4d8e-942b-ecb8b9894dbd req-24c07ab8-5f60-4c07-ba12-5b235768630b service nova] Creating event network-vif-unplugged:5ac103df-1ff9-40af-8256-5349b52e1acc for instance 6834c01a-284c-47fc-8939-403833f0ebd8 on n-h1-849104-4 Jul 12 12:02:50.562349 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-284bdc2e-66d0-4d8e-942b-ecb8b9894dbd req-24c07ab8-5f60-4c07-ba12-5b235768630b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122701 Jul 12 12:02:50.569540 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1393/2950] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:50.759043 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-bdeb7be1-ba49-459e-bc33-e85f4ef9fd57 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:50.778804 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-bdeb7be1-ba49-459e-bc33-e85f4ef9fd57 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.612174 Jul 12 12:02:50.779677 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1558/2951] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:50 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:50.814562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f54290d5-d45c-43f1-9cd5-a4408eea3a9e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:50.820320 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f54290d5-d45c-43f1-9cd5-a4408eea3a9e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:50.847850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f54290d5-d45c-43f1-9cd5-a4408eea3a9e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:50.852274 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f54290d5-d45c-43f1-9cd5-a4408eea3a9e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:50.853882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f54290d5-d45c-43f1-9cd5-a4408eea3a9e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:50.855343 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f54290d5-d45c-43f1-9cd5-a4408eea3a9e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:50.961978 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-42bb05cd-344c-475f-9f68-9f634e4b61a6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:50.967381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-42bb05cd-344c-475f-9f68-9f634e4b61a6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:50.993219 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-42bb05cd-344c-475f-9f68-9f634e4b61a6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:50.995585 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-42bb05cd-344c-475f-9f68-9f634e4b61a6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:51.002612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-42bb05cd-344c-475f-9f68-9f634e4b61a6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:51.003593 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-42bb05cd-344c-475f-9f68-9f634e4b61a6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:51.048514 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-42bb05cd-344c-475f-9f68-9f634e4b61a6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] HTTP exception thrown: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-42bb05cd-344c-475f-9f68-9f634e4b61a6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Request method failure captured: Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: request: DELETE /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 HTTP/1.1 Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWEfTBFdJQsjHtzdQpdykoGiODNaRgcNZi6aoF3Z0_T9qYLsqys-pp9fhfUTXwbwfHCL8LsOFzXM-6LbN-TRJEL0E1caXTdrYG40JEIpspQ15KHlZa5NoTuccbUEFewV5ZbutBIWLPDKAae0qUkeBb-h7YMT2-OBbmntC2YM9sbJD-Y Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Openstack-Nova-Api-Version: 2.42 Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: f93f657cdcbc43d7bbb578d424322e05 Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1471085467 Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f93f657cdcbc43d7bbb578d424322e05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f93f657cdcbc43d7bbb578d424322e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f93f657cdcbc43d7bbb578d424322e05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f93f657cdcbc43d7bbb578d424322e05", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1471085467 Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: f93f657cdcbc43d7bbb578d424322e05 Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1471085467 Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-TaggedBootDevicesTest_v242-1471085467-project Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 9dbdfd4821d54068b9d88d02b7e4665f Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1471085467-project Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'bf15ce48-6829-4bdf-9b73-570b093f9725'} Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:02:51.053543 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:02:51.062149 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:51.062149 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:51.062149 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:51.062149 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:51.062149 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:51.062149 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:51.062149 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:51.062149 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:02:51.062149 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:02:51.062149 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:51.062149 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:51.064342 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-42bb05cd-344c-475f-9f68-9f634e4b61a6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Returning 404 to user: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:02:51.065643 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-42bb05cd-344c-475f-9f68-9f634e4b61a6 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 404 len: 111 microversion: 2.42 time: 0.114922 Jul 12 12:02:51.077274 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1559/2952] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 12:02:50 2022] DELETE /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 12:02:51.098700 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-24cffc82-1a48-4d1d-b0f4-377890fe0246 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:51.100810 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-24cffc82-1a48-4d1d-b0f4-377890fe0246 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] [instance: bf15ce48-6829-4bdf-9b73-570b093f9725] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:51.122176 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24cffc82-1a48-4d1d-b0f4-377890fe0246 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:51.128755 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24cffc82-1a48-4d1d-b0f4-377890fe0246 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:51.132846 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24cffc82-1a48-4d1d-b0f4-377890fe0246 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:51.135042 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-24cffc82-1a48-4d1d-b0f4-377890fe0246 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:51.203221 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-24cffc82-1a48-4d1d-b0f4-377890fe0246 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] HTTP exception thrown: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-24cffc82-1a48-4d1d-b0f4-377890fe0246 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Request method failure captured: Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 HTTP/1.1 Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWEfTBFdJQsjHtzdQpdykoGiODNaRgcNZi6aoF3Z0_T9qYLsqys-pp9fhfUTXwbwfHCL8LsOFzXM-6LbN-TRJEL0E1caXTdrYG40JEIpspQ15KHlZa5NoTuccbUEFewV5ZbutBIWLPDKAae0qUkeBb-h7YMT2-OBbmntC2YM9sbJD-Y Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Openstack-Nova-Api-Version: 2.42 Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: f93f657cdcbc43d7bbb578d424322e05 Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1471085467 Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f93f657cdcbc43d7bbb578d424322e05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f93f657cdcbc43d7bbb578d424322e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f93f657cdcbc43d7bbb578d424322e05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f93f657cdcbc43d7bbb578d424322e05", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1471085467 Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: f93f657cdcbc43d7bbb578d424322e05 Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1471085467 Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-TaggedBootDevicesTest_v242-1471085467-project Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: 9dbdfd4821d54068b9d88d02b7e4665f Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1471085467-project Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'bf15ce48-6829-4bdf-9b73-570b093f9725'} Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:51.208851 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:51.220876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:51.220876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:51.220876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:51.220876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:51.220876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:02:51.220876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:02:51.220876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. Jul 12 12:02:51.220876 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:51.225611 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-24cffc82-1a48-4d1d-b0f4-377890fe0246 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] Returning 404 to user: Instance bf15ce48-6829-4bdf-9b73-570b093f9725 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:02:51.227935 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-24cffc82-1a48-4d1d-b0f4-377890fe0246 tempest-TaggedBootDevicesTest_v242-1471085467 tempest-TaggedBootDevicesTest_v242-1471085467-project] 10.222.0.50 "GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725" status: 404 len: 111 microversion: 2.42 time: 0.148437 Jul 12 12:02:51.233049 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1560/2953] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:51 2022] GET /compute/v2.1/servers/bf15ce48-6829-4bdf-9b73-570b093f9725 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 12:02:51.257255 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c02110ad-a2d6-4b62-9372-3c159b9c7cd9 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:51.258907 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c02110ad-a2d6-4b62-9372-3c159b9c7cd9 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:51.271509 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c02110ad-a2d6-4b62-9372-3c159b9c7cd9 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:51.273181 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c02110ad-a2d6-4b62-9372-3c159b9c7cd9 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:51.274954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c02110ad-a2d6-4b62-9372-3c159b9c7cd9 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:51.276196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c02110ad-a2d6-4b62-9372-3c159b9c7cd9 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:51.710967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c02110ad-a2d6-4b62-9372-3c159b9c7cd9 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:51.721394 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c02110ad-a2d6-4b62-9372-3c159b9c7cd9 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:51.723845 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c02110ad-a2d6-4b62-9372-3c159b9c7cd9 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:51.726069 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c02110ad-a2d6-4b62-9372-3c159b9c7cd9 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1372 microversion: 2.57 time: 0.488621 Jul 12 12:02:51.727423 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1561/2954] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:51 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1372 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:51.733894 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-070bcb06-c592-40e1-804f-e9c06670ea5b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:51.735017 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-070bcb06-c592-40e1-804f-e9c06670ea5b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:51.778594 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-070bcb06-c592-40e1-804f-e9c06670ea5b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:51.780299 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-070bcb06-c592-40e1-804f-e9c06670ea5b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:51.781329 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-070bcb06-c592-40e1-804f-e9c06670ea5b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:51.782932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-070bcb06-c592-40e1-804f-e9c06670ea5b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:52.035686 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f54290d5-d45c-43f1-9cd5-a4408eea3a9e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:52.047943 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f54290d5-d45c-43f1-9cd5-a4408eea3a9e tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1680 microversion: 2.1 time: 1.241271 Jul 12 12:02:52.050042 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1394/2955] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:50 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1680 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:52.065921 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c8c39ccd-d8bf-4ece-846c-3d1a27d6df90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:52.069211 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c8c39ccd-d8bf-4ece-846c-3d1a27d6df90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:52.088003 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c8c39ccd-d8bf-4ece-846c-3d1a27d6df90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:52.088774 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c8c39ccd-d8bf-4ece-846c-3d1a27d6df90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:52.090430 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c8c39ccd-d8bf-4ece-846c-3d1a27d6df90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:52.093035 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c8c39ccd-d8bf-4ece-846c-3d1a27d6df90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:52.735282 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c8c39ccd-d8bf-4ece-846c-3d1a27d6df90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:52.749206 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c8c39ccd-d8bf-4ece-846c-3d1a27d6df90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.686856 Jul 12 12:02:52.753870 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1395/2956] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:52 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:52.765334 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-fa46ed19-758f-4c1e-a9b9-35e8a095a207 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:52.765969 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-fa46ed19-758f-4c1e-a9b9-35e8a095a207 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:52.782590 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa46ed19-758f-4c1e-a9b9-35e8a095a207 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:52.787981 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa46ed19-758f-4c1e-a9b9-35e8a095a207 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:52.789386 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa46ed19-758f-4c1e-a9b9-35e8a095a207 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:52.790056 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-fa46ed19-758f-4c1e-a9b9-35e8a095a207 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:52.865967 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-070bcb06-c592-40e1-804f-e9c06670ea5b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:52.882163 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-070bcb06-c592-40e1-804f-e9c06670ea5b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:52.889631 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-070bcb06-c592-40e1-804f-e9c06670ea5b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:52.892640 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-070bcb06-c592-40e1-804f-e9c06670ea5b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 1.163215 Jul 12 12:02:52.897740 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1562/2957] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:51 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:52.970457 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fa46ed19-758f-4c1e-a9b9-35e8a095a207 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:52.987337 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fa46ed19-758f-4c1e-a9b9-35e8a095a207 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:52.990008 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-fa46ed19-758f-4c1e-a9b9-35e8a095a207 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:52.996965 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-fa46ed19-758f-4c1e-a9b9-35e8a095a207 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1372 microversion: 2.57 time: 0.239191 Jul 12 12:02:52.998355 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1396/2958] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:52 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1372 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:53.069667 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3beb6668-5fc5-4129-97e2-93ee9f43633c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:53.070726 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3beb6668-5fc5-4129-97e2-93ee9f43633c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:53.096300 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3beb6668-5fc5-4129-97e2-93ee9f43633c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:53.099381 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3beb6668-5fc5-4129-97e2-93ee9f43633c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:53.103411 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3beb6668-5fc5-4129-97e2-93ee9f43633c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:53.104665 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3beb6668-5fc5-4129-97e2-93ee9f43633c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:53.770978 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-7aa61655-603e-4177-b5f9-1bb633d05e82 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:53.772240 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-7aa61655-603e-4177-b5f9-1bb633d05e82 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:53.791341 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7aa61655-603e-4177-b5f9-1bb633d05e82 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:53.793216 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7aa61655-603e-4177-b5f9-1bb633d05e82 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:53.801556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7aa61655-603e-4177-b5f9-1bb633d05e82 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:53.803134 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-7aa61655-603e-4177-b5f9-1bb633d05e82 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:53.976642 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3beb6668-5fc5-4129-97e2-93ee9f43633c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:54.016465 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3beb6668-5fc5-4129-97e2-93ee9f43633c tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1680 microversion: 2.1 time: 0.952900 Jul 12 12:02:54.018712 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1563/2959] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:53 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1680 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:54.029645 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-c1d34691-5013-4f18-95ae-242b2c9e295c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:54.036818 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-c1d34691-5013-4f18-95ae-242b2c9e295c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:54.057364 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c1d34691-5013-4f18-95ae-242b2c9e295c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:54.061146 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c1d34691-5013-4f18-95ae-242b2c9e295c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:54.062835 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c1d34691-5013-4f18-95ae-242b2c9e295c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:54.067166 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-c1d34691-5013-4f18-95ae-242b2c9e295c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:54.482441 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-7aa61655-603e-4177-b5f9-1bb633d05e82 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:54.493043 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-7aa61655-603e-4177-b5f9-1bb633d05e82 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.725918 Jul 12 12:02:54.495411 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1397/2960] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:53 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:02:54.501308 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-59fe1504-2b8a-4d68-800d-8124d48967c8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:54.512645 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-59fe1504-2b8a-4d68-800d-8124d48967c8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:54.543189 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-59fe1504-2b8a-4d68-800d-8124d48967c8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:54.543704 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-59fe1504-2b8a-4d68-800d-8124d48967c8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:54.544524 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-59fe1504-2b8a-4d68-800d-8124d48967c8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:54.544970 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-59fe1504-2b8a-4d68-800d-8124d48967c8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:54.786248 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-59fe1504-2b8a-4d68-800d-8124d48967c8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:54.808201 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-59fe1504-2b8a-4d68-800d-8124d48967c8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:54.814750 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-59fe1504-2b8a-4d68-800d-8124d48967c8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:54.817109 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-59fe1504-2b8a-4d68-800d-8124d48967c8 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1357 microversion: 2.57 time: 0.320309 Jul 12 12:02:54.820227 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1398/2961] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:54 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1357 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:54.850076 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c39bb62e-48a8-4eca-99fc-838dcfe3eb70 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:54.850846 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c39bb62e-48a8-4eca-99fc-838dcfe3eb70 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:54.858945 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c39bb62e-48a8-4eca-99fc-838dcfe3eb70 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:54.864659 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c39bb62e-48a8-4eca-99fc-838dcfe3eb70 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:54.866126 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c39bb62e-48a8-4eca-99fc-838dcfe3eb70 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:54.866854 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c39bb62e-48a8-4eca-99fc-838dcfe3eb70 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:54.968669 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c39bb62e-48a8-4eca-99fc-838dcfe3eb70 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:02:55.122303 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:55.193386 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:55.222499 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c39bb62e-48a8-4eca-99fc-838dcfe3eb70 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 204 len: 0 microversion: 2.57 time: 0.376300 Jul 12 12:02:55.223671 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1399/2962] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 12:02:54 2022] DELETE /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 12:02:55.241130 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-8cff2484-84fe-49a2-b527-f59b581289a5 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:55.242848 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-8cff2484-84fe-49a2-b527-f59b581289a5 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:55.259516 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8cff2484-84fe-49a2-b527-f59b581289a5 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:55.260265 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8cff2484-84fe-49a2-b527-f59b581289a5 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:55.261429 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8cff2484-84fe-49a2-b527-f59b581289a5 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:55.262229 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-8cff2484-84fe-49a2-b527-f59b581289a5 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:55.304131 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c1d34691-5013-4f18-95ae-242b2c9e295c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:55.322599 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c1d34691-5013-4f18-95ae-242b2c9e295c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:55.327955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-c1d34691-5013-4f18-95ae-242b2c9e295c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:55.332093 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-c1d34691-5013-4f18-95ae-242b2c9e295c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 1.311700 Jul 12 12:02:55.345331 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1564/2963] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:54 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:55.364258 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-60d918e2-049e-418b-9146-ec85cd3870ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:55.366475 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-60d918e2-049e-418b-9146-ec85cd3870ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:55.377335 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-60d918e2-049e-418b-9146-ec85cd3870ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:55.378208 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-60d918e2-049e-418b-9146-ec85cd3870ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:55.379334 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-60d918e2-049e-418b-9146-ec85cd3870ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:55.379928 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-60d918e2-049e-418b-9146-ec85cd3870ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:55.472544 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-60d918e2-049e-418b-9146-ec85cd3870ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:55.488333 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-60d918e2-049e-418b-9146-ec85cd3870ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:55.489954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-60d918e2-049e-418b-9146-ec85cd3870ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:55.491164 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-60d918e2-049e-418b-9146-ec85cd3870ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1363 microversion: 2.57 time: 0.144815 Jul 12 12:02:55.497055 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1565/2964] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:55 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:55.510852 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-cd29c179-db90-40d7-97fb-f16e9e1e39d4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:55.511457 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-cd29c179-db90-40d7-97fb-f16e9e1e39d4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:55.526187 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd29c179-db90-40d7-97fb-f16e9e1e39d4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:55.531372 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd29c179-db90-40d7-97fb-f16e9e1e39d4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:55.537036 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd29c179-db90-40d7-97fb-f16e9e1e39d4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:55.538862 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-cd29c179-db90-40d7-97fb-f16e9e1e39d4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:55.564691 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-8cff2484-84fe-49a2-b527-f59b581289a5 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:55.574877 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-8cff2484-84fe-49a2-b527-f59b581289a5 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1613 microversion: 2.1 time: 0.349709 Jul 12 12:02:55.575481 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1400/2965] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:55 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1613 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:55.920805 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-cd29c179-db90-40d7-97fb-f16e9e1e39d4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:55.925538 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:55.940011 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-cd29c179-db90-40d7-97fb-f16e9e1e39d4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.432192 Jul 12 12:02:55.943803 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1566/2966] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:55 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:56.154749 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-410f4753-3c6c-4aec-884a-aa66d4c0985b req-f59dbef2-d21b-4439-abbf-529ad4626248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea153f9-9c62-4a41-a8be-4bdf4c5d3998", "name": "network-vif-deleted", "tag": "019bd511-acab-4a0b-948a-24a1fb3e56ad"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:56.200911 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-410f4753-3c6c-4aec-884a-aa66d4c0985b req-f59dbef2-d21b-4439-abbf-529ad4626248 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:56.201627 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-410f4753-3c6c-4aec-884a-aa66d4c0985b req-f59dbef2-d21b-4439-abbf-529ad4626248 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:56.226728 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-410f4753-3c6c-4aec-884a-aa66d4c0985b req-f59dbef2-d21b-4439-abbf-529ad4626248 service nova] Creating event network-vif-deleted:019bd511-acab-4a0b-948a-24a1fb3e56ad for instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 on n-h2-849104-4 Jul 12 12:02:56.244363 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-410f4753-3c6c-4aec-884a-aa66d4c0985b req-f59dbef2-d21b-4439-abbf-529ad4626248 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097924 Jul 12 12:02:56.245622 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1401/2967] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:02:56.353235 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-436dc58d-4c3e-4984-9cf4-94067a0f9300 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:56.354372 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-436dc58d-4c3e-4984-9cf4-94067a0f9300 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:56.367139 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-436dc58d-4c3e-4984-9cf4-94067a0f9300 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:56.371769 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-436dc58d-4c3e-4984-9cf4-94067a0f9300 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:56.373091 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-436dc58d-4c3e-4984-9cf4-94067a0f9300 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:56.373708 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-436dc58d-4c3e-4984-9cf4-94067a0f9300 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:56.519710 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e8c64ac5-3f75-43a0-b6c8-28eed57adadc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:56.520743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e8c64ac5-3f75-43a0-b6c8-28eed57adadc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:56.534927 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8c64ac5-3f75-43a0-b6c8-28eed57adadc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:56.538718 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8c64ac5-3f75-43a0-b6c8-28eed57adadc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:56.543421 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8c64ac5-3f75-43a0-b6c8-28eed57adadc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:56.544111 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e8c64ac5-3f75-43a0-b6c8-28eed57adadc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:57.403434 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e8c64ac5-3f75-43a0-b6c8-28eed57adadc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:57.426289 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e8c64ac5-3f75-43a0-b6c8-28eed57adadc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:57.429153 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e8c64ac5-3f75-43a0-b6c8-28eed57adadc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:57.437140 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e8c64ac5-3f75-43a0-b6c8-28eed57adadc tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1363 microversion: 2.57 time: 0.923078 Jul 12 12:02:57.438390 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1402/2968] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:56 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1363 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:57.451531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-bd274e3c-8709-4411-b942-911d43b01310 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:57.453281 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-bd274e3c-8709-4411-b942-911d43b01310 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:57.469711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bd274e3c-8709-4411-b942-911d43b01310 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:57.470563 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bd274e3c-8709-4411-b942-911d43b01310 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:57.471955 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bd274e3c-8709-4411-b942-911d43b01310 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:57.473083 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bd274e3c-8709-4411-b942-911d43b01310 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:57.564719 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bd274e3c-8709-4411-b942-911d43b01310 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:57.565581 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-bd274e3c-8709-4411-b942-911d43b01310 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:57.566335 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-bd274e3c-8709-4411-b942-911d43b01310 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lazy-loading 'fault' on Instance uuid cea153f9-9c62-4a41-a8be-4bdf4c5d3998 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:02:57.734844 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-436dc58d-4c3e-4984-9cf4-94067a0f9300 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:57.750819 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-436dc58d-4c3e-4984-9cf4-94067a0f9300 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:57.752767 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-436dc58d-4c3e-4984-9cf4-94067a0f9300 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:57.757611 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-436dc58d-4c3e-4984-9cf4-94067a0f9300 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 1.409170 Jul 12 12:02:57.759444 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-bd274e3c-8709-4411-b942-911d43b01310 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a99251f6314c1298b54cdaef4ce916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fad99a609b4c8cb44c8d83adae2f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:57.759869 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1567/2969] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:56 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:57.772431 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-bd274e3c-8709-4411-b942-911d43b01310 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 200 len: 1330 microversion: 2.1 time: 0.330804 Jul 12 12:02:57.777302 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1403/2970] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:57 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 1330 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:57.803185 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3595eb64-6345-4661-ac2f-6d64b31353ae tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:57.810242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3595eb64-6345-4661-ac2f-6d64b31353ae tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:57.822716 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3595eb64-6345-4661-ac2f-6d64b31353ae tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:57.824980 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3595eb64-6345-4661-ac2f-6d64b31353ae tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:57.827867 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3595eb64-6345-4661-ac2f-6d64b31353ae tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:57.830733 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3595eb64-6345-4661-ac2f-6d64b31353ae tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:57.902381 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-78215303", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fde4f811-9aff-4d3d-a105-a4e77174abc8"}], "security_groups": [{"name": "tempest-securitygroup--1238399631"}], "key_name": "tempest-keypair-228147427", "user_data": "}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:02:58.322852 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] validate_networks() for [('fde4f811-9aff-4d3d-a105-a4e77174abc8', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 12:02:58.367526 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3595eb64-6345-4661-ac2f-6d64b31353ae tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:58.422760 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3595eb64-6345-4661-ac2f-6d64b31353ae tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.657681 Jul 12 12:02:58.428232 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1568/2971] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:57 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:02:58.461963 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b2ac8885-ad18-42e8-b17d-dcd510db72ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:58.463507 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b2ac8885-ad18-42e8-b17d-dcd510db72ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:58.479101 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b2ac8885-ad18-42e8-b17d-dcd510db72ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:58.482207 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b2ac8885-ad18-42e8-b17d-dcd510db72ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:58.483363 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b2ac8885-ad18-42e8-b17d-dcd510db72ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:58.485581 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b2ac8885-ad18-42e8-b17d-dcd510db72ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:58.602991 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b2ac8885-ad18-42e8-b17d-dcd510db72ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:58.616171 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b2ac8885-ad18-42e8-b17d-dcd510db72ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:58.622045 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b2ac8885-ad18-42e8-b17d-dcd510db72ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb93594c074611b82b9723c964cbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499ed556665744c1bbeff02b60965343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:58.624990 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b2ac8885-ad18-42e8-b17d-dcd510db72ec tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 200 len: 1363 microversion: 2.57 time: 0.169660 Jul 12 12:02:58.644526 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1569/2972] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:58 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:58.783324 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a5e25364-ed36-4528-960d-003f5be6e87f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:58.785260 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a5e25364-ed36-4528-960d-003f5be6e87f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:58.819129 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5e25364-ed36-4528-960d-003f5be6e87f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:58.819918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5e25364-ed36-4528-960d-003f5be6e87f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:58.821794 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5e25364-ed36-4528-960d-003f5be6e87f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:58.824183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a5e25364-ed36-4528-960d-003f5be6e87f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:59.296850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=4 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:02:59.661196 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a5e25364-ed36-4528-960d-003f5be6e87f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:59.680634 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a5e25364-ed36-4528-960d-003f5be6e87f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:59.684634 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a5e25364-ed36-4528-960d-003f5be6e87f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:02:59.696631 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a5e25364-ed36-4528-960d-003f5be6e87f tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1485 microversion: 2.25 time: 0.920091 Jul 12 12:02:59.697756 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1570/2973] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:02:58 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1485 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:02:59.713713 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d75abf18-72d3-4a4e-aa04-feab34635714 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:59.717851 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d75abf18-72d3-4a4e-aa04-feab34635714 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:59.735732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d75abf18-72d3-4a4e-aa04-feab34635714 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:59.736217 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d75abf18-72d3-4a4e-aa04-feab34635714 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:59.737007 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d75abf18-72d3-4a4e-aa04-feab34635714 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:59.742948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d75abf18-72d3-4a4e-aa04-feab34635714 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:59.773822 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-d75abf18-72d3-4a4e-aa04-feab34635714 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] HTTP exception thrown: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d75abf18-72d3-4a4e-aa04-feab34635714 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Request method failure captured: Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 HTTP/1.1 Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWIh0HzYslRf6eM0zsCoVoNeJUnfwPfscHrAH8RjoIwboOwDO1w81Yd6kcOnNs585iyjxYu3ZOAT1Zf25QHaXzpob0SGjRUuXoQl_ldmIKjnbfSF9vynxDKQ1PXmiSBPju4uGX9V6d8CwGJ8Z36t2XVRb6GkDiu1FwPkMynDcN6JPV8 Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 15fad99a609b4c8cb44c8d83adae2f62 Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1028067481 Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/15fad99a609b4c8cb44c8d83adae2f62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/15fad99a609b4c8cb44c8d83adae2f62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/15fad99a609b4c8cb44c8d83adae2f62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_15fad99a609b4c8cb44c8d83adae2f62", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1028067481 Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 15fad99a609b4c8cb44c8d83adae2f62 Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1028067481 Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-AttachSCSIVolumeTestJSON-1028067481-project Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: c0a99251f6314c1298b54cdaef4ce916 Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1028067481-project Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'cea153f9-9c62-4a41-a8be-4bdf4c5d3998'} Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:02:59.775611 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:59.780909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:02:59.780909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:02:59.780909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:02:59.780909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:02:59.780909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:02:59.780909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:02:59.780909 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:02:59.782386 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d75abf18-72d3-4a4e-aa04-feab34635714 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Returning 404 to user: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:02:59.783413 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d75abf18-72d3-4a4e-aa04-feab34635714 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 404 len: 111 microversion: 2.1 time: 0.084419 Jul 12 12:02:59.784989 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1571/2974] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:59 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 12:02:59.790303 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-03318b53-6d6b-4f70-8009-2a7beb1e16c4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:02:59.791159 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-03318b53-6d6b-4f70-8009-2a7beb1e16c4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:02:59.802155 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-03318b53-6d6b-4f70-8009-2a7beb1e16c4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:59.802920 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-03318b53-6d6b-4f70-8009-2a7beb1e16c4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:02:59.804094 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-03318b53-6d6b-4f70-8009-2a7beb1e16c4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:02:59.806916 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-03318b53-6d6b-4f70-8009-2a7beb1e16c4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:00.334650 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-03318b53-6d6b-4f70-8009-2a7beb1e16c4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:00.345022 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-03318b53-6d6b-4f70-8009-2a7beb1e16c4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.558764 Jul 12 12:03:00.348718 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1572/2975] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:02:59 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:00.363724 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-adbac19c-5524-4f5a-ae67-6987e88ab882 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:00.365130 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-adbac19c-5524-4f5a-ae67-6987e88ab882 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] [instance: b448e55a-2b7b-4817-8aee-144fd4a41a25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:00.383688 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-adbac19c-5524-4f5a-ae67-6987e88ab882 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:00.387326 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-adbac19c-5524-4f5a-ae67-6987e88ab882 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:00.388478 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-adbac19c-5524-4f5a-ae67-6987e88ab882 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:00.389361 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-adbac19c-5524-4f5a-ae67-6987e88ab882 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:00.424321 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-adbac19c-5524-4f5a-ae67-6987e88ab882 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] HTTP exception thrown: Instance b448e55a-2b7b-4817-8aee-144fd4a41a25 could not be found. Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-adbac19c-5524-4f5a-ae67-6987e88ab882 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Request method failure captured: Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 HTTP/1.1 Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWK9Au4UecvMbg_jkv1KEqe3etBCh8ToCU1b95stS0DIAnw6jP-CC2tLbDu5k9B9q1YYGWGJjwij9ZF7Qt_zjvVEMH3esNbKx6PT_z9Ib7klAZU65Ou5qIJY7pgrWhZsnduQlUteoGdOOyU2R1Akb9DWfQSdWPuN2O4QbRqJc6cHsyA Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Openstack-Nova-Api-Version: 2.57 Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 499ed556665744c1bbeff02b60965343 Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-ServerShowV257Test-535349183 Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/499ed556665744c1bbeff02b60965343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/499ed556665744c1bbeff02b60965343"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/499ed556665744c1bbeff02b60965343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_499ed556665744c1bbeff02b60965343", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-ServerShowV257Test-535349183 Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 499ed556665744c1bbeff02b60965343 Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-ServerShowV257Test-535349183 Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-ServerShowV257Test-535349183-project Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: e9eb93594c074611b82b9723c964cbe7 Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-ServerShowV257Test-535349183-project Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance b448e55a-2b7b-4817-8aee-144fd4a41a25 could not be found. Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'b448e55a-2b7b-4817-8aee-144fd4a41a25'} Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b448e55a-2b7b-4817-8aee-144fd4a41a25 could not be found. Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b448e55a-2b7b-4817-8aee-144fd4a41a25 could not be found. Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:00.430308 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:00.435241 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:00.435241 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:03:00.435241 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:03:00.435241 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:03:00.435241 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:03:00.435241 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b448e55a-2b7b-4817-8aee-144fd4a41a25 could not be found. Jul 12 12:03:00.435241 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:00.450992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-adbac19c-5524-4f5a-ae67-6987e88ab882 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] Returning 404 to user: Instance b448e55a-2b7b-4817-8aee-144fd4a41a25 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:03:00.452231 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-adbac19c-5524-4f5a-ae67-6987e88ab882 tempest-ServerShowV257Test-535349183 tempest-ServerShowV257Test-535349183-project] 10.222.0.50 "GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25" status: 404 len: 111 microversion: 2.57 time: 0.099458 Jul 12 12:03:00.453049 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1573/2976] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:00 2022] GET /compute/v2.1/servers/b448e55a-2b7b-4817-8aee-144fd4a41a25 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 12:03:00.472959 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-59900809-1c78-4fe0-8523-70d0967d49fb tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '.version_select at 0x7f5e099f3160>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:00.540580 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-59900809-1c78-4fe0-8523-70d0967d49fb tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-279994026" status: 202 len: 0 microversion: 2.1 time: 0.083370 Jul 12 12:03:00.548520 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1574/2977] 10.222.0.50 () {58 vars in 1217 bytes} [Tue Jul 12 12:03:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-279994026 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 12:03:00.721463 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5bed1da2-1b1e-404f-8ae8-c4a270ce91f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:00.724934 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5bed1da2-1b1e-404f-8ae8-c4a270ce91f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:00.734360 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5bed1da2-1b1e-404f-8ae8-c4a270ce91f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:00.735259 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5bed1da2-1b1e-404f-8ae8-c4a270ce91f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:00.736652 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5bed1da2-1b1e-404f-8ae8-c4a270ce91f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:00.737537 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5bed1da2-1b1e-404f-8ae8-c4a270ce91f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:01.047000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:03:01.047640 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:03:01.048861 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:03:01.049558 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:03:01.050256 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:03:01.068479 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:01.069334 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:01.070378 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:01.071066 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:01.097067 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Getting quotas for project 47db0ac76b374ba08a1693a94ddff731. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:03:01.104562 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Getting quotas for user 9c54b84fd2154250b8dc326b87923c47 and project 47db0ac76b374ba08a1693a94ddff731. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:03:01.122765 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 12:03:01.125946 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:03:01.219147 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5bed1da2-1b1e-404f-8ae8-c4a270ce91f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:01.227387 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5bed1da2-1b1e-404f-8ae8-c4a270ce91f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:01.230462 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-5bed1da2-1b1e-404f-8ae8-c4a270ce91f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:01.237608 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5bed1da2-1b1e-404f-8ae8-c4a270ce91f3 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1475 microversion: 2.25 time: 0.521292 Jul 12 12:03:01.252339 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1575/2978] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:00 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1475 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:01.256734 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ff226ba3-c3e8-459d-8c99-ee5766ae9f7f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.358970 Jul 12 12:03:01.259732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3ad25759-75a8-497e-b8fe-b22608f1ef6b tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '.version_select at 0x7f5e13ab01f0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:01.261890 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1404/2979] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 12:02:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 3365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 12:03:01.269735 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3ad25759-75a8-497e-b8fe-b22608f1ef6b tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:01.270420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3ad25759-75a8-497e-b8fe-b22608f1ef6b tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:01.285629 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-50daa1f3-3bb1-403d-93ea-2b7c43f69e9f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:01.287819 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-50daa1f3-3bb1-403d-93ea-2b7c43f69e9f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:01.336075 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3ad25759-75a8-497e-b8fe-b22608f1ef6b tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.082307 Jul 12 12:03:01.352932 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1576/2980] 10.222.0.50 () {60 vars in 1183 bytes} [Tue Jul 12 12:03:01 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:01.364612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-55cc0815-bbac-467a-90e4-613503a1930a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:01.370028 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-55cc0815-bbac-467a-90e4-613503a1930a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:01.396517 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-55cc0815-bbac-467a-90e4-613503a1930a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:01.397127 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-55cc0815-bbac-467a-90e4-613503a1930a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:01.400880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-55cc0815-bbac-467a-90e4-613503a1930a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:01.403218 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-55cc0815-bbac-467a-90e4-613503a1930a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:01.803141 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.objects.instance [None req-55cc0815-bbac-467a-90e4-613503a1930a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] Lazy-loading 'services' on Instance uuid 6834c01a-284c-47fc-8939-403833f0ebd8 {{(pid=125984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:03:01.839047 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-55cc0815-bbac-467a-90e4-613503a1930a tempest-LiveAutoBlockMigrationV225Test-1801829632 tempest-LiveAutoBlockMigrationV225Test-1801829632-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1966 microversion: 2.25 time: 0.484368 Jul 12 12:03:01.846011 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1577/2981] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:01 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1966 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:01.880933 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-a42dd6a6-515b-4bdd-aa10-93b7de1c556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:01.883529 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-a42dd6a6-515b-4bdd-aa10-93b7de1c556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:01.906502 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a42dd6a6-515b-4bdd-aa10-93b7de1c556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:01.907253 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a42dd6a6-515b-4bdd-aa10-93b7de1c556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:01.908935 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a42dd6a6-515b-4bdd-aa10-93b7de1c556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:01.912572 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-a42dd6a6-515b-4bdd-aa10-93b7de1c556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:02.200912 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-a42dd6a6-515b-4bdd-aa10-93b7de1c556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:02.212480 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-a42dd6a6-515b-4bdd-aa10-93b7de1c556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.363724 Jul 12 12:03:02.213427 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1578/2982] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:01 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:02.330029 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-50daa1f3-3bb1-403d-93ea-2b7c43f69e9f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c54b84fd2154250b8dc326b87923c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47db0ac76b374ba08a1693a94ddff731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:02.345656 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-50daa1f3-3bb1-403d-93ea-2b7c43f69e9f tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1" status: 200 len: 1236 microversion: 2.1 time: 1.074148 Jul 12 12:03:02.348155 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1405/2983] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:01 2022] GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1 => generated 1236 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:02.362725 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-11bf3d31-5795-4c65-9191-ee7cad067e58 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:02.364192 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-11bf3d31-5795-4c65-9191-ee7cad067e58 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:02.383020 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11bf3d31-5795-4c65-9191-ee7cad067e58 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:02.385432 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11bf3d31-5795-4c65-9191-ee7cad067e58 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:02.387110 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11bf3d31-5795-4c65-9191-ee7cad067e58 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:02.389681 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11bf3d31-5795-4c65-9191-ee7cad067e58 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:02.438588 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-11bf3d31-5795-4c65-9191-ee7cad067e58 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:03:02.674504 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-11bf3d31-5795-4c65-9191-ee7cad067e58 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 204 len: 0 microversion: 2.25 time: 0.323053 Jul 12 12:03:02.679702 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1406/2984] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 12:03:02 2022] DELETE /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 12:03:02.690877 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-074b63c3-ef77-4057-b520-75af6af25049 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:02.691612 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-074b63c3-ef77-4057-b520-75af6af25049 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:02.712579 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-074b63c3-ef77-4057-b520-75af6af25049 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:02.713041 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-074b63c3-ef77-4057-b520-75af6af25049 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:02.715748 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-074b63c3-ef77-4057-b520-75af6af25049 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:02.716295 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-074b63c3-ef77-4057-b520-75af6af25049 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:02.756924 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-430832312", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:02.897409 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] validate_networks() for [('ec496341-5a8b-4236-ab1e-a53bab837b9f', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 12:03:03.593597 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-074b63c3-ef77-4057-b520-75af6af25049 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:03.602760 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-074b63c3-ef77-4057-b520-75af6af25049 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:03.612531 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-074b63c3-ef77-4057-b520-75af6af25049 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:03.614189 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-074b63c3-ef77-4057-b520-75af6af25049 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1481 microversion: 2.25 time: 0.932956 Jul 12 12:03:03.614328 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:03:03.614834 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:03:03.615557 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:03:03.615747 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1407/2985] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:02 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1481 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:03.615916 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:03:03.616243 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:03:03.622199 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-683c6b30-a4e3-4d45-9e1b-21d8b524b9ef tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:03.625021 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-683c6b30-a4e3-4d45-9e1b-21d8b524b9ef tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:03.636186 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:03.637035 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:03.638246 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:03.638971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:03.642540 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-683c6b30-a4e3-4d45-9e1b-21d8b524b9ef tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:03.643020 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-683c6b30-a4e3-4d45-9e1b-21d8b524b9ef tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:03.643930 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-683c6b30-a4e3-4d45-9e1b-21d8b524b9ef tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:03.644502 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-683c6b30-a4e3-4d45-9e1b-21d8b524b9ef tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:03.664346 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Getting quotas for project b086b36480d443e799aaca3922305beb. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:03:03.674872 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Getting quotas for user 1122d2f0df264c94ab8d3ef08aff8f5f and project b086b36480d443e799aaca3922305beb. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:03:03.695432 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 12:03:03.700994 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 10e8509a-e132-4188-9ea8-f7ea3043f672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:03:03.760472 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-5600d908-d570-49b2-9990-91bde3c2655d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.544008 Jul 12 12:03:03.762055 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1579/2986] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 12:03:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 12:03:03.768044 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1da0511e-f877-4dcf-8d2c-d11fcadc3f41 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:03.770504 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1da0511e-f877-4dcf-8d2c-d11fcadc3f41 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:03.780144 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1da0511e-f877-4dcf-8d2c-d11fcadc3f41 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:03.780925 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1da0511e-f877-4dcf-8d2c-d11fcadc3f41 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:03.781925 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1da0511e-f877-4dcf-8d2c-d11fcadc3f41 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:03.782686 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1da0511e-f877-4dcf-8d2c-d11fcadc3f41 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:03.931372 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-1da0511e-f877-4dcf-8d2c-d11fcadc3f41 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c54b84fd2154250b8dc326b87923c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47db0ac76b374ba08a1693a94ddff731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:03.944805 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1da0511e-f877-4dcf-8d2c-d11fcadc3f41 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1" status: 200 len: 1294 microversion: 2.1 time: 0.181388 Jul 12 12:03:03.946025 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1580/2987] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:03 2022] GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1 => generated 1294 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:04.212840 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7dff7698-fdda-4f60-9b68-4de9ff673a56 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] Action: 'create', calling method: .version_select at 0x7f5e099f34c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-911186076", "metadata": {"Type": "work"}}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:04.389488 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-683c6b30-a4e3-4d45-9e1b-21d8b524b9ef tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:04.402222 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-683c6b30-a4e3-4d45-9e1b-21d8b524b9ef tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.784825 Jul 12 12:03:04.402831 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1408/2988] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:03 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:04.415581 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d347301c-d8c3-4ebb-8e5c-0db93d386867 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:04.421233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d347301c-d8c3-4ebb-8e5c-0db93d386867 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 10e8509a-e132-4188-9ea8-f7ea3043f672] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:04.587351 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d347301c-d8c3-4ebb-8e5c-0db93d386867 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:04.596657 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d347301c-d8c3-4ebb-8e5c-0db93d386867 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/10e8509a-e132-4188-9ea8-f7ea3043f672" status: 200 len: 1221 microversion: 2.1 time: 0.190582 Jul 12 12:03:04.597293 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1409/2989] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:04 2022] GET /compute/v2.1/servers/10e8509a-e132-4188-9ea8-f7ea3043f672 => generated 1221 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:04.659538 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a28f96c8-2089-4a2a-b953-5cc77ca51b21 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:04.661433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a28f96c8-2089-4a2a-b953-5cc77ca51b21 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:04.703329 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a28f96c8-2089-4a2a-b953-5cc77ca51b21 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:04.704101 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a28f96c8-2089-4a2a-b953-5cc77ca51b21 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:04.704985 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a28f96c8-2089-4a2a-b953-5cc77ca51b21 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:04.721425 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a28f96c8-2089-4a2a-b953-5cc77ca51b21 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:05.217990 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7dff7698-fdda-4f60-9b68-4de9ff673a56 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.270597 Jul 12 12:03:05.225501 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1581/2990] 10.222.0.50 () {60 vars in 1155 bytes} [Tue Jul 12 12:03:03 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1272 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 12:03:05.231746 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1582583597", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:05.379452 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.network.neutron [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] validate_networks() for [('ec496341-5a8b-4236-ab1e-a53bab837b9f', None, None, None, None, None)] {{(pid=125984) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 12:03:06.358943 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Flavor limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:03:06.359691 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Image limits 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:03:06.360420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Flavor pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:03:06.361444 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Image pref 0:0:0 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:03:06.362239 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.virt.hardware [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:03:06.374423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:06.376400 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:06.378219 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:06.379170 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:06.412158 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Getting quotas for project b086b36480d443e799aaca3922305beb. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:03:06.418373 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.quota [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Getting quotas for user 1122d2f0df264c94ab8d3ef08aff8f5f and project b086b36480d443e799aaca3922305beb. Resources: {'cores', 'instances', 'ram'} {{(pid=125984) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:03:06.463179 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Going to run 1 instances... {{(pid=125984) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 12:03:06.466057 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:03:06.496984 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a28f96c8-2089-4a2a-b953-5cc77ca51b21 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:06.514323 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a28f96c8-2089-4a2a-b953-5cc77ca51b21 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:06.517525 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-a28f96c8-2089-4a2a-b953-5cc77ca51b21 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:06.520408 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a28f96c8-2089-4a2a-b953-5cc77ca51b21 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1481 microversion: 2.25 time: 1.884438 Jul 12 12:03:06.531900 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1410/2991] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:04 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1481 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:06.545911 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-979973cb-7f0a-4545-9044-aa391d4a29b4 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:06.546906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-979973cb-7f0a-4545-9044-aa391d4a29b4 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:06.564629 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-979973cb-7f0a-4545-9044-aa391d4a29b4 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:06.569046 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-979973cb-7f0a-4545-9044-aa391d4a29b4 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:06.577133 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b6e41f2c-91cf-4de1-86ea-ac8eb5a75df8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.344102 Jul 12 12:03:06.578938 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1582/2992] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 12:03:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 12:03:06.582902 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-979973cb-7f0a-4545-9044-aa391d4a29b4 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:06.584296 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-979973cb-7f0a-4545-9044-aa391d4a29b4 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:06.590922 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2f1c51b6-d290-4639-86a1-78ea7fe53b86 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] Calling method '.version_select at 0x7f5e0994dee0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:06.721221 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2f1c51b6-d290-4639-86a1-78ea7fe53b86 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5" status: 200 len: 352 microversion: 2.1 time: 0.138419 Jul 12 12:03:06.721818 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1583/2993] 10.222.0.50 () {58 vars in 1244 bytes} [Tue Jul 12 12:03:06 2022] GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5 => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:06.727862 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-d3c95d59-1eea-42c5-a682-e20a23d32e1b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:06.730856 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-d3c95d59-1eea-42c5-a682-e20a23d32e1b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:06.738793 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d3c95d59-1eea-42c5-a682-e20a23d32e1b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:06.739575 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d3c95d59-1eea-42c5-a682-e20a23d32e1b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:06.740710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d3c95d59-1eea-42c5-a682-e20a23d32e1b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:06.741232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-d3c95d59-1eea-42c5-a682-e20a23d32e1b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:06.867617 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-979973cb-7f0a-4545-9044-aa391d4a29b4 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c54b84fd2154250b8dc326b87923c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47db0ac76b374ba08a1693a94ddff731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:06.893175 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-979973cb-7f0a-4545-9044-aa391d4a29b4 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1" status: 200 len: 1294 microversion: 2.1 time: 0.363546 Jul 12 12:03:06.893788 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1411/2994] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:06 2022] GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1 => generated 1294 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:06.907915 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b4022304-eae8-47e6-9f0c-7a334be82774 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:06.913317 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b4022304-eae8-47e6-9f0c-7a334be82774 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:07.194405 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-d3c95d59-1eea-42c5-a682-e20a23d32e1b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:07.203697 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-d3c95d59-1eea-42c5-a682-e20a23d32e1b tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 0.480655 Jul 12 12:03:07.204485 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1584/2995] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:06 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:07.219088 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b4022304-eae8-47e6-9f0c-7a334be82774 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:07.226744 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b4022304-eae8-47e6-9f0c-7a334be82774 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1222 microversion: 2.1 time: 0.330778 Jul 12 12:03:07.230452 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1412/2996] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:06 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1222 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:07.538833 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4d00ee1f-70dc-4e53-9437-feb7e34a6ace tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:07.539546 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4d00ee1f-70dc-4e53-9437-feb7e34a6ace tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:07.560365 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4d00ee1f-70dc-4e53-9437-feb7e34a6ace tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:07.560965 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4d00ee1f-70dc-4e53-9437-feb7e34a6ace tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:07.561861 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4d00ee1f-70dc-4e53-9437-feb7e34a6ace tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:07.562400 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4d00ee1f-70dc-4e53-9437-feb7e34a6ace tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:07.735281 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3f84506d-83ba-44e3-bd55-313195ba9c05 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] Calling method '.version_select at 0x7f5e13b9dd30>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:07.806589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4d00ee1f-70dc-4e53-9437-feb7e34a6ace tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:07.827507 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4d00ee1f-70dc-4e53-9437-feb7e34a6ace tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:07.840724 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4d00ee1f-70dc-4e53-9437-feb7e34a6ace tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:07.844142 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4d00ee1f-70dc-4e53-9437-feb7e34a6ace tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1481 microversion: 2.25 time: 0.309180 Jul 12 12:03:07.849564 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1585/2997] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:07 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1481 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:07.852990 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3f84506d-83ba-44e3-bd55-313195ba9c05 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5" status: 200 len: 353 microversion: 2.1 time: 0.118818 Jul 12 12:03:07.854146 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1413/2998] 10.222.0.50 () {58 vars in 1244 bytes} [Tue Jul 12 12:03:07 2022] GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:03:07.865005 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-089bf603-5f97-4ff0-b618-4624ba06dccb tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] Calling method '.version_select at 0x7f5e13ab0430>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:07.912267 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-37bd888e-efa1-4f8e-be09-7063a76d6662 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:07.912904 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-37bd888e-efa1-4f8e-be09-7063a76d6662 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:07.926681 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37bd888e-efa1-4f8e-be09-7063a76d6662 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:07.927227 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37bd888e-efa1-4f8e-be09-7063a76d6662 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:07.928563 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37bd888e-efa1-4f8e-be09-7063a76d6662 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:07.930416 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-37bd888e-efa1-4f8e-be09-7063a76d6662 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:07.940022 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-089bf603-5f97-4ff0-b618-4624ba06dccb tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5" status: 200 len: 353 microversion: 2.1 time: 0.078574 Jul 12 12:03:07.940615 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1586/2999] 10.222.0.50 () {58 vars in 1244 bytes} [Tue Jul 12 12:03:07 2022] GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5 => generated 353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:07.953221 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f8e26b5d-aac2-4869-a2b5-90efb6fa00b1 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] Calling method '.version_select at 0x7f5e099491f0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:08.057306 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f8e26b5d-aac2-4869-a2b5-90efb6fa00b1 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5" status: 202 len: 0 microversion: 2.1 time: 0.108359 Jul 12 12:03:08.057928 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1587/3000] 10.222.0.50 () {58 vars in 1247 bytes} [Tue Jul 12 12:03:07 2022] DELETE /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 12:03:08.066129 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-11bbae10-60ad-43c8-87ae-cd04f7a601d1 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] Calling method '.version_select at 0x7f5e09b710d0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:08.232247 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-11bbae10-60ad-43c8-87ae-cd04f7a601d1 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5" status: 200 len: 352 microversion: 2.1 time: 0.169955 Jul 12 12:03:08.233515 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1588/3001] 10.222.0.50 () {58 vars in 1244 bytes} [Tue Jul 12 12:03:08 2022] GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5 => generated 352 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:03:08.239097 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3420d782-87ee-4ede-8754-9db9474a7632 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:08.239975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3420d782-87ee-4ede-8754-9db9474a7632 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:08.260396 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3420d782-87ee-4ede-8754-9db9474a7632 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:08.261912 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3420d782-87ee-4ede-8754-9db9474a7632 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:08.267710 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3420d782-87ee-4ede-8754-9db9474a7632 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:08.268547 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3420d782-87ee-4ede-8754-9db9474a7632 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:08.415156 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-37bd888e-efa1-4f8e-be09-7063a76d6662 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c54b84fd2154250b8dc326b87923c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47db0ac76b374ba08a1693a94ddff731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:08.433256 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-37bd888e-efa1-4f8e-be09-7063a76d6662 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1" status: 200 len: 1294 microversion: 2.1 time: 0.520901 Jul 12 12:03:08.447579 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1414/3002] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:07 2022] GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1 => generated 1294 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:08.462262 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-17e318c4-c63d-40cf-b2c7-b234741ef4d0 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:08.462933 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-17e318c4-c63d-40cf-b2c7-b234741ef4d0 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:08.477621 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-17e318c4-c63d-40cf-b2c7-b234741ef4d0 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:08.479961 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-17e318c4-c63d-40cf-b2c7-b234741ef4d0 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:08.480840 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-17e318c4-c63d-40cf-b2c7-b234741ef4d0 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:08.481300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-17e318c4-c63d-40cf-b2c7-b234741ef4d0 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:08.750271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-17e318c4-c63d-40cf-b2c7-b234741ef4d0 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:08.764709 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-17e318c4-c63d-40cf-b2c7-b234741ef4d0 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1282 microversion: 2.1 time: 0.312168 Jul 12 12:03:08.768777 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1415/3003] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:08 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1282 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:08.785033 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-ee967adc-2e25-42c6-957d-cf771820eb76 req-b52ef656-0d54-47ad-b214-cd6cc0334e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6834c01a-284c-47fc-8939-403833f0ebd8", "name": "network-vif-deleted", "tag": "5ac103df-1ff9-40af-8256-5349b52e1acc"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:08.812230 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-ee967adc-2e25-42c6-957d-cf771820eb76 req-b52ef656-0d54-47ad-b214-cd6cc0334e01 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:08.816750 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-ee967adc-2e25-42c6-957d-cf771820eb76 req-b52ef656-0d54-47ad-b214-cd6cc0334e01 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:08.849365 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-ee967adc-2e25-42c6-957d-cf771820eb76 req-b52ef656-0d54-47ad-b214-cd6cc0334e01 service nova] Creating event network-vif-deleted:5ac103df-1ff9-40af-8256-5349b52e1acc for instance 6834c01a-284c-47fc-8939-403833f0ebd8 on n-h2-849104-4 Jul 12 12:03:08.868216 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-ee967adc-2e25-42c6-957d-cf771820eb76 req-b52ef656-0d54-47ad-b214-cd6cc0334e01 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095558 Jul 12 12:03:08.869226 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1416/3004] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:08.886815 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-16442af1-1a8d-4c45-811e-261a6f6fb953 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:08.888217 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-16442af1-1a8d-4c45-811e-261a6f6fb953 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:08.907510 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16442af1-1a8d-4c45-811e-261a6f6fb953 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:08.907755 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16442af1-1a8d-4c45-811e-261a6f6fb953 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:08.916397 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16442af1-1a8d-4c45-811e-261a6f6fb953 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:08.918286 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-16442af1-1a8d-4c45-811e-261a6f6fb953 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:09.151685 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-16442af1-1a8d-4c45-811e-261a6f6fb953 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:09.169840 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-16442af1-1a8d-4c45-811e-261a6f6fb953 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:09.171757 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-16442af1-1a8d-4c45-811e-261a6f6fb953 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:09.175518 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-16442af1-1a8d-4c45-811e-261a6f6fb953 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1439 microversion: 2.25 time: 0.305391 Jul 12 12:03:09.190392 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1417/3005] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:08 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1439 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:09.245973 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-2ab96d44-9e66-490b-b99b-4b9245950a3f tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] Calling method '.version_select at 0x7f5e0abf6e50>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:09.274614 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3420d782-87ee-4ede-8754-9db9474a7632 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:09.293073 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3420d782-87ee-4ede-8754-9db9474a7632 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1516 microversion: 2.1 time: 1.049301 Jul 12 12:03:09.293825 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1589/3006] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:08 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1516 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:09.350402 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-2ab96d44-9e66-490b-b99b-4b9245950a3f tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5" status: 200 len: 352 microversion: 2.1 time: 0.109059 Jul 12 12:03:09.351338 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1418/3007] 10.222.0.50 () {58 vars in 1244 bytes} [Tue Jul 12 12:03:09 2022] GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:03:09.452120 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6feb1140-5918-4b8d-9f92-510349527867 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:09.453362 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6feb1140-5918-4b8d-9f92-510349527867 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:09.479153 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6feb1140-5918-4b8d-9f92-510349527867 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:09.483020 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6feb1140-5918-4b8d-9f92-510349527867 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:09.483913 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6feb1140-5918-4b8d-9f92-510349527867 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:09.484397 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6feb1140-5918-4b8d-9f92-510349527867 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:09.788720 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4d2fddc4-740d-4de8-96d9-ab39ba300e08 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:09.790653 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4d2fddc4-740d-4de8-96d9-ab39ba300e08 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:09.860127 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4d2fddc4-740d-4de8-96d9-ab39ba300e08 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:09.866778 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4d2fddc4-740d-4de8-96d9-ab39ba300e08 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:09.879623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4d2fddc4-740d-4de8-96d9-ab39ba300e08 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:09.880924 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4d2fddc4-740d-4de8-96d9-ab39ba300e08 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:10.082565 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6feb1140-5918-4b8d-9f92-510349527867 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c54b84fd2154250b8dc326b87923c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47db0ac76b374ba08a1693a94ddff731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:10.095670 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6feb1140-5918-4b8d-9f92-510349527867 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1" status: 200 len: 1362 microversion: 2.1 time: 0.648784 Jul 12 12:03:10.097535 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1590/3008] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:09 2022] GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1 => generated 1362 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:10.200873 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-00eb78b3-bdeb-47e3-824a-069152cc13d7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:10.201408 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-00eb78b3-bdeb-47e3-824a-069152cc13d7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:10.227962 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-00eb78b3-bdeb-47e3-824a-069152cc13d7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:10.228768 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-00eb78b3-bdeb-47e3-824a-069152cc13d7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:10.229670 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-00eb78b3-bdeb-47e3-824a-069152cc13d7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:10.230121 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-00eb78b3-bdeb-47e3-824a-069152cc13d7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:10.318100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4d2fddc4-740d-4de8-96d9-ab39ba300e08 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:10.377136 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4d2fddc4-740d-4de8-96d9-ab39ba300e08 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1280 microversion: 2.1 time: 0.581254 Jul 12 12:03:10.393712 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1419/3009] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:09 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1280 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:03:10.414960 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-274a3b27-07b8-4196-b3c2-9553533d462f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:10.416080 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-274a3b27-07b8-4196-b3c2-9553533d462f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:10.462922 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-274a3b27-07b8-4196-b3c2-9553533d462f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:10.468676 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-274a3b27-07b8-4196-b3c2-9553533d462f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:10.470535 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-274a3b27-07b8-4196-b3c2-9553533d462f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:10.471551 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-274a3b27-07b8-4196-b3c2-9553533d462f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:10.619589 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-00eb78b3-bdeb-47e3-824a-069152cc13d7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:10.650212 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-00eb78b3-bdeb-47e3-824a-069152cc13d7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:10.658984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-00eb78b3-bdeb-47e3-824a-069152cc13d7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:10.669040 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-00eb78b3-bdeb-47e3-824a-069152cc13d7 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1264 microversion: 2.25 time: 0.474370 Jul 12 12:03:10.670370 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1591/3010] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:10 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1264 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:10.687441 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-8f4c99a2-46ff-497a-b970-c399ceae4a3b tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] Calling method '.version_select at 0x7f5e09ae2430>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:10.797343 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-8f4c99a2-46ff-497a-b970-c399ceae4a3b tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5" status: 200 len: 352 microversion: 2.1 time: 0.124946 Jul 12 12:03:10.804750 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1592/3011] 10.222.0.50 () {58 vars in 1244 bytes} [Tue Jul 12 12:03:10 2022] GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:11.086089 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:11.115800 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f5f4459b-57bb-4ed3-8172-b2e1a06159fa tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:11.117423 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f5f4459b-57bb-4ed3-8172-b2e1a06159fa tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:11.159565 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5f4459b-57bb-4ed3-8172-b2e1a06159fa tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:11.191983 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5f4459b-57bb-4ed3-8172-b2e1a06159fa tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:11.197555 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5f4459b-57bb-4ed3-8172-b2e1a06159fa tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:11.199247 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5f4459b-57bb-4ed3-8172-b2e1a06159fa tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:11.310668 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:11.665433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-274a3b27-07b8-4196-b3c2-9553533d462f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:11.710793 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-274a3b27-07b8-4196-b3c2-9553533d462f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1522 microversion: 2.1 time: 1.315196 Jul 12 12:03:11.720055 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1420/3012] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:10 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1522 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:11.748307 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ae7c1b16-1a06-4bff-8629-1e35f95fb3fe tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:11.750046 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ae7c1b16-1a06-4bff-8629-1e35f95fb3fe tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:11.793329 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae7c1b16-1a06-4bff-8629-1e35f95fb3fe tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:11.795439 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae7c1b16-1a06-4bff-8629-1e35f95fb3fe tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:11.801815 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae7c1b16-1a06-4bff-8629-1e35f95fb3fe tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:11.808902 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ae7c1b16-1a06-4bff-8629-1e35f95fb3fe tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:11.825743 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:11.843080 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f5f4459b-57bb-4ed3-8172-b2e1a06159fa tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c54b84fd2154250b8dc326b87923c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47db0ac76b374ba08a1693a94ddff731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:11.887608 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f5f4459b-57bb-4ed3-8172-b2e1a06159fa tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1" status: 200 len: 1362 microversion: 2.1 time: 0.777980 Jul 12 12:03:11.893280 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1593/3013] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:11 2022] GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1 => generated 1362 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:03:11.941954 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-269d6d19-bfc5-4885-a909-e2a0e6f06ed4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:11.963432 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-269d6d19-bfc5-4885-a909-e2a0e6f06ed4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:12.008437 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-269d6d19-bfc5-4885-a909-e2a0e6f06ed4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:12.011108 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-269d6d19-bfc5-4885-a909-e2a0e6f06ed4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:12.014756 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-269d6d19-bfc5-4885-a909-e2a0e6f06ed4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:12.015908 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-269d6d19-bfc5-4885-a909-e2a0e6f06ed4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:12.379505 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-269d6d19-bfc5-4885-a909-e2a0e6f06ed4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:12.388388 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-269d6d19-bfc5-4885-a909-e2a0e6f06ed4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:12.404420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-269d6d19-bfc5-4885-a909-e2a0e6f06ed4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:12.405901 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-269d6d19-bfc5-4885-a909-e2a0e6f06ed4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1264 microversion: 2.25 time: 0.510649 Jul 12 12:03:12.420739 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1594/3014] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:11 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1264 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:12.426046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-38664d99-c69e-4790-991d-d7609a96da4b tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] Calling method '.version_select at 0x7f5e09949310>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:12.594677 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-38664d99-c69e-4790-991d-d7609a96da4b tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5" status: 200 len: 352 microversion: 2.1 time: 0.172454 Jul 12 12:03:12.595269 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1595/3015] 10.222.0.50 () {58 vars in 1244 bytes} [Tue Jul 12 12:03:12 2022] GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5 => generated 352 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:12.742732 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b46686ae-6fb9-456d-82b9-a4a95096c893 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:12.743596 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b46686ae-6fb9-456d-82b9-a4a95096c893 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:12.756782 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b46686ae-6fb9-456d-82b9-a4a95096c893 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:12.757250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b46686ae-6fb9-456d-82b9-a4a95096c893 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:12.758046 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b46686ae-6fb9-456d-82b9-a4a95096c893 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:12.758494 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b46686ae-6fb9-456d-82b9-a4a95096c893 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:12.812721 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ae7c1b16-1a06-4bff-8629-1e35f95fb3fe tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:12.831601 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ae7c1b16-1a06-4bff-8629-1e35f95fb3fe tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1322 microversion: 2.1 time: 1.106921 Jul 12 12:03:12.840115 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1421/3016] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:11 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1322 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:12.912167 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f5f36bec-792a-4b2b-bf30-32dfea7ce2ee tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:12.924212 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f5f36bec-792a-4b2b-bf30-32dfea7ce2ee tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:12.950765 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5f36bec-792a-4b2b-bf30-32dfea7ce2ee tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:12.952979 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5f36bec-792a-4b2b-bf30-32dfea7ce2ee tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:12.955163 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5f36bec-792a-4b2b-bf30-32dfea7ce2ee tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:12.957670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f5f36bec-792a-4b2b-bf30-32dfea7ce2ee tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:13.626678 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f5f36bec-792a-4b2b-bf30-32dfea7ce2ee tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c54b84fd2154250b8dc326b87923c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47db0ac76b374ba08a1693a94ddff731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:13.636005 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f5f36bec-792a-4b2b-bf30-32dfea7ce2ee tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1" status: 200 len: 1362 microversion: 2.1 time: 0.729191 Jul 12 12:03:13.650256 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1422/3017] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:12 2022] GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1 => generated 1362 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:13.655899 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-eeb0bf86-0507-4d40-81d6-3236c24a9230 req-20784c81-c0de-4ce5-b428-5c57ddf052d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb8c998f-98d6-43d7-a11a-b0a648cccae1", "tag": "66c28bf3-b6db-4656-976e-ce75e0bd3288"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:13.694300 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-eeb0bf86-0507-4d40-81d6-3236c24a9230 req-20784c81-c0de-4ce5-b428-5c57ddf052d3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:13.697293 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-eeb0bf86-0507-4d40-81d6-3236c24a9230 req-20784c81-c0de-4ce5-b428-5c57ddf052d3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:13.758259 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-eeb0bf86-0507-4d40-81d6-3236c24a9230 req-20784c81-c0de-4ce5-b428-5c57ddf052d3 service nova] Creating event network-changed:66c28bf3-b6db-4656-976e-ce75e0bd3288 for instance eb8c998f-98d6-43d7-a11a-b0a648cccae1 on n-h1-849104-4 Jul 12 12:03:13.784942 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-eeb0bf86-0507-4d40-81d6-3236c24a9230 req-20784c81-c0de-4ce5-b428-5c57ddf052d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130504 Jul 12 12:03:13.790029 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1423/3018] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:13.816724 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3bee0f81-d2ad-4b31-bbd8-04d481a57a4c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:13.818158 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3bee0f81-d2ad-4b31-bbd8-04d481a57a4c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:13.852498 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3bee0f81-d2ad-4b31-bbd8-04d481a57a4c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:13.853121 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3bee0f81-d2ad-4b31-bbd8-04d481a57a4c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:13.854149 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3bee0f81-d2ad-4b31-bbd8-04d481a57a4c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:13.856571 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3bee0f81-d2ad-4b31-bbd8-04d481a57a4c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:14.226045 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3bee0f81-d2ad-4b31-bbd8-04d481a57a4c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:14.243666 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3bee0f81-d2ad-4b31-bbd8-04d481a57a4c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:14.258143 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3bee0f81-d2ad-4b31-bbd8-04d481a57a4c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:14.265044 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3bee0f81-d2ad-4b31-bbd8-04d481a57a4c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1264 microversion: 2.25 time: 0.465925 Jul 12 12:03:14.268751 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1424/3019] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:13 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1264 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:14.293900 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-889c5cf1-7846-4e84-b614-38a604c34fd8 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] Calling method '.version_select at 0x7f5e11b88820>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:14.377756 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-889c5cf1-7846-4e84-b614-38a604c34fd8 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] HTTP exception thrown: Volume 1b3951e2-d4e9-4524-8d25-02d8af6979d5 could not be found. Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-889c5cf1-7846-4e84-b614-38a604c34fd8 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] Request method failure captured: Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5 HTTP/1.1 Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWL38E0nSjsAeS0lOGbRCscV8SN8SgH5LjmLiCp2KfLViyC8eVTl0izxzMP6lb7t3RP6j5n_hC4TqpzuABG8eEGjb9mgJibW4CG4jrPLuKkgj006mDlI8ybnLMxMKp__C8FlyZiiPNDQwoXwBhcrQ3A0VdYLshdtf8gdkUNatpn70QU Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 4bdedf79bf954601932e07a7489f5d28 Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-VolumesGetTestJSON-54613746 Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bdedf79bf954601932e07a7489f5d28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bdedf79bf954601932e07a7489f5d28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4bdedf79bf954601932e07a7489f5d28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4bdedf79bf954601932e07a7489f5d28", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-VolumesGetTestJSON-54613746 Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 4bdedf79bf954601932e07a7489f5d28 Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-VolumesGetTestJSON-54613746 Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-VolumesGetTestJSON-54613746-project Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: 293c26b05f094ee1ba81e9d7213adee0 Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-VolumesGetTestJSON-54613746-project Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: method: Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: exception: Volume 1b3951e2-d4e9-4524-8d25-02d8af6979d5 could not be found. Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': '1b3951e2-d4e9-4524-8d25-02d8af6979d5'} Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b3951e2-d4e9-4524-8d25-02d8af6979d5 could not be found. (HTTP 404) (Request-ID: req-21579be2-8f34-4857-bcc8-4cc0ee9337ff) Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 12:03:14.380716 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b3951e2-d4e9-4524-8d25-02d8af6979d5 could not be found. Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b3951e2-d4e9-4524-8d25-02d8af6979d5 could not be found. Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b3951e2-d4e9-4524-8d25-02d8af6979d5 could not be found. Jul 12 12:03:14.386048 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:14.388668 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-889c5cf1-7846-4e84-b614-38a604c34fd8 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] Returning 404 to user: Volume 1b3951e2-d4e9-4524-8d25-02d8af6979d5 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:03:14.391796 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-889c5cf1-7846-4e84-b614-38a604c34fd8 tempest-VolumesGetTestJSON-54613746 tempest-VolumesGetTestJSON-54613746-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5" status: 404 len: 109 microversion: 2.1 time: 0.113600 Jul 12 12:03:14.393115 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1425/3020] 10.222.0.50 () {58 vars in 1244 bytes} [Tue Jul 12 12:03:14 2022] GET /compute/v2.1/os-volumes/1b3951e2-d4e9-4524-8d25-02d8af6979d5 => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 12:03:14.408615 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4f002cb0-e0e4-4540-9803-a835bbf6c14e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:14.409652 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4f002cb0-e0e4-4540-9803-a835bbf6c14e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:14.419610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4f002cb0-e0e4-4540-9803-a835bbf6c14e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:14.426016 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4f002cb0-e0e4-4540-9803-a835bbf6c14e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:14.427179 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4f002cb0-e0e4-4540-9803-a835bbf6c14e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:14.427872 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4f002cb0-e0e4-4540-9803-a835bbf6c14e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:14.452009 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b46686ae-6fb9-456d-82b9-a4a95096c893 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:14.462166 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b46686ae-6fb9-456d-82b9-a4a95096c893 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1522 microversion: 2.1 time: 1.723231 Jul 12 12:03:14.462758 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1596/3021] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:12 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1522 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:03:14.655474 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f5012130-39b7-4270-8a50-d8dcb05cbea9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:14.656288 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f5012130-39b7-4270-8a50-d8dcb05cbea9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:14.678778 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5012130-39b7-4270-8a50-d8dcb05cbea9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:14.680206 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5012130-39b7-4270-8a50-d8dcb05cbea9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:14.685178 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5012130-39b7-4270-8a50-d8dcb05cbea9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:14.686146 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f5012130-39b7-4270-8a50-d8dcb05cbea9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:15.649535 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f5012130-39b7-4270-8a50-d8dcb05cbea9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c54b84fd2154250b8dc326b87923c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47db0ac76b374ba08a1693a94ddff731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:15.666540 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4f002cb0-e0e4-4540-9803-a835bbf6c14e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:15.676344 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4f002cb0-e0e4-4540-9803-a835bbf6c14e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1322 microversion: 2.1 time: 1.281770 Jul 12 12:03:15.679728 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f5012130-39b7-4270-8a50-d8dcb05cbea9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1" status: 200 len: 1362 microversion: 2.1 time: 1.029550 Jul 12 12:03:15.680697 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1426/3022] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:14 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1322 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:15.692871 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1597/3023] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:14 2022] GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1 => generated 1362 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:15.698499 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ecf5b3be-9c8b-4692-a418-dcdda0718a11 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:15.700461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-d8657174-8b05-4f98-8247-e608fb2d5a94 req-9a531478-ff90-4366-be14-f56b7bb83fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ecb79d2-418a-40f3-bbd7-5075a19926a1", "tag": "d888ba8b-9b44-4f36-8099-a696071920dd"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:15.701321 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ecf5b3be-9c8b-4692-a418-dcdda0718a11 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:15.718555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ecf5b3be-9c8b-4692-a418-dcdda0718a11 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:15.719623 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ecf5b3be-9c8b-4692-a418-dcdda0718a11 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:15.720762 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ecf5b3be-9c8b-4692-a418-dcdda0718a11 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:15.723707 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ecf5b3be-9c8b-4692-a418-dcdda0718a11 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:15.727195 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d8657174-8b05-4f98-8247-e608fb2d5a94 req-9a531478-ff90-4366-be14-f56b7bb83fd3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:15.727973 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-d8657174-8b05-4f98-8247-e608fb2d5a94 req-9a531478-ff90-4366-be14-f56b7bb83fd3 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:15.766857 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-d8657174-8b05-4f98-8247-e608fb2d5a94 req-9a531478-ff90-4366-be14-f56b7bb83fd3 service nova] Creating event network-changed:d888ba8b-9b44-4f36-8099-a696071920dd for instance 6ecb79d2-418a-40f3-bbd7-5075a19926a1 on n-h1-849104-4 Jul 12 12:03:15.768462 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-ecf5b3be-9c8b-4692-a418-dcdda0718a11 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] HTTP exception thrown: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ecf5b3be-9c8b-4692-a418-dcdda0718a11 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Request method failure captured: Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: request: DELETE /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 HTTP/1.1 Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWIh0HzYslRf6eM0zsCoVoNeJUnfwPfscHrAH8RjoIwboOwDO1w81Yd6kcOnNs585iyjxYu3ZOAT1Zf25QHaXzpob0SGjRUuXoQl_ldmIKjnbfSF9vynxDKQ1PXmiSBPju4uGX9V6d8CwGJ8Z36t2XVRb6GkDiu1FwPkMynDcN6JPV8 Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 15fad99a609b4c8cb44c8d83adae2f62 Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1028067481 Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/15fad99a609b4c8cb44c8d83adae2f62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/15fad99a609b4c8cb44c8d83adae2f62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/15fad99a609b4c8cb44c8d83adae2f62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_15fad99a609b4c8cb44c8d83adae2f62", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1028067481 Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 15fad99a609b4c8cb44c8d83adae2f62 Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1028067481 Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AttachSCSIVolumeTestJSON-1028067481-project Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: c0a99251f6314c1298b54cdaef4ce916 Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1028067481-project Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'cea153f9-9c62-4a41-a8be-4bdf4c5d3998'} Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:03:15.776349 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:03:15.780648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:03:15.780648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:15.780648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:15.780648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:15.780648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:15.780648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:03:15.780648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:03:15.780648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:03:15.780648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:03:15.780648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:03:15.780648 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:15.785518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ecf5b3be-9c8b-4692-a418-dcdda0718a11 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Returning 404 to user: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:03:15.786755 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ecf5b3be-9c8b-4692-a418-dcdda0718a11 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 404 len: 111 microversion: 2.1 time: 0.104355 Jul 12 12:03:15.789935 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1427/3024] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:03:15 2022] DELETE /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 12:03:15.793614 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-d8657174-8b05-4f98-8247-e608fb2d5a94 req-9a531478-ff90-4366-be14-f56b7bb83fd3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098996 Jul 12 12:03:15.796134 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1598/3025] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:15.823415 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e30803b8-5784-4a8c-a4be-c910e8d97512 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:15.824737 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e30803b8-5784-4a8c-a4be-c910e8d97512 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:15.829062 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:15.846339 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e30803b8-5784-4a8c-a4be-c910e8d97512 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:15.847206 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e30803b8-5784-4a8c-a4be-c910e8d97512 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:15.848289 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e30803b8-5784-4a8c-a4be-c910e8d97512 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:15.851034 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e30803b8-5784-4a8c-a4be-c910e8d97512 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:16.020233 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e30803b8-5784-4a8c-a4be-c910e8d97512 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:16.031691 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e30803b8-5784-4a8c-a4be-c910e8d97512 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:16.043651 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e30803b8-5784-4a8c-a4be-c910e8d97512 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:16.045756 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e30803b8-5784-4a8c-a4be-c910e8d97512 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1264 microversion: 2.25 time: 0.248068 Jul 12 12:03:16.054025 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1599/3026] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:15 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1264 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:16.067815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-df9ff9a8-5b3b-4c5c-b591-9dc3fbdf2c42 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:16.069326 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-df9ff9a8-5b3b-4c5c-b591-9dc3fbdf2c42 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:16.096918 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-df9ff9a8-5b3b-4c5c-b591-9dc3fbdf2c42 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:16.099405 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-df9ff9a8-5b3b-4c5c-b591-9dc3fbdf2c42 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:16.103450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-df9ff9a8-5b3b-4c5c-b591-9dc3fbdf2c42 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:16.104761 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-df9ff9a8-5b3b-4c5c-b591-9dc3fbdf2c42 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:16.274965 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-13b6c825-c872-44a9-b31e-f6b1d135038a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:16.275483 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-13b6c825-c872-44a9-b31e-f6b1d135038a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:16.307807 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-13b6c825-c872-44a9-b31e-f6b1d135038a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:16.308415 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-13b6c825-c872-44a9-b31e-f6b1d135038a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:16.309233 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-13b6c825-c872-44a9-b31e-f6b1d135038a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:16.312389 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-13b6c825-c872-44a9-b31e-f6b1d135038a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:16.340446 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-13b6c825-c872-44a9-b31e-f6b1d135038a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:03:16.401354 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=4 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:16.438675 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=12 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:16.523137 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-13b6c825-c872-44a9-b31e-f6b1d135038a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "DELETE /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 204 len: 0 microversion: 2.32 time: 0.731146 Jul 12 12:03:16.524168 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1428/3027] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 12:03:15 2022] DELETE /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 12:03:16.532371 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3a0e6bb0-279b-4009-bb5f-01d1a6e5fa52 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:16.537356 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3a0e6bb0-279b-4009-bb5f-01d1a6e5fa52 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] [instance: cea153f9-9c62-4a41-a8be-4bdf4c5d3998] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:16.551964 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-df9ff9a8-5b3b-4c5c-b591-9dc3fbdf2c42 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:16.554374 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a0e6bb0-279b-4009-bb5f-01d1a6e5fa52 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:16.555007 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a0e6bb0-279b-4009-bb5f-01d1a6e5fa52 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:16.556010 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a0e6bb0-279b-4009-bb5f-01d1a6e5fa52 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:16.556651 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3a0e6bb0-279b-4009-bb5f-01d1a6e5fa52 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:16.565384 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-df9ff9a8-5b3b-4c5c-b591-9dc3fbdf2c42 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1522 microversion: 2.1 time: 0.509733 Jul 12 12:03:16.570453 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1600/3028] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:16 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:16.575433 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.wsgi [None req-3a0e6bb0-279b-4009-bb5f-01d1a6e5fa52 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] HTTP exception thrown: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3a0e6bb0-279b-4009-bb5f-01d1a6e5fa52 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Request method failure captured: Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: request: GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 HTTP/1.1 Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: Accept: application/json Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: Accept-Encoding: identity Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: Connection: close Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: Content-Length: 0 Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: Content-Type: application/json Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: Host: 10.222.0.50 Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: Openstack-System-Scope: None Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: User-Agent: python-urllib3/1.26.9 Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Auth-Token: gAAAAABizWIh0HzYslRf6eM0zsCoVoNeJUnfwPfscHrAH8RjoIwboOwDO1w81Yd6kcOnNs585iyjxYu3ZOAT1Zf25QHaXzpob0SGjRUuXoQl_ldmIKjnbfSF9vynxDKQ1PXmiSBPju4uGX9V6d8CwGJ8Z36t2XVRb6GkDiu1FwPkMynDcN6JPV8 Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Id: None Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Domain-Name: None Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Identity-Status: Confirmed Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Is-Admin-Project: True Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Id: default Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Domain-Name: Default Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Id: 15fad99a609b4c8cb44c8d83adae2f62 Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1028067481 Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Role: reader,member Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Roles: reader,member Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/15fad99a609b4c8cb44c8d83adae2f62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/15fad99a609b4c8cb44c8d83adae2f62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/15fad99a609b4c8cb44c8d83adae2f62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_15fad99a609b4c8cb44c8d83adae2f62", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1028067481 Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Id: 15fad99a609b4c8cb44c8d83adae2f62 Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1028067481 Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-User: tempest-AttachSCSIVolumeTestJSON-1028067481-project Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Id: default Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-User-Domain-Name: Default Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-User-Id: c0a99251f6314c1298b54cdaef4ce916 Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1028067481-project Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: method: > Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: exception: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: action_args: {'id': 'cea153f9-9c62-4a41-a8be-4bdf4c5d3998'} Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:16.580935 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:16.585602 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:16.585602 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:03:16.585602 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:03:16.585602 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:03:16.585602 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:03:16.585602 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. Jul 12 12:03:16.585602 n-d-849104-4 devstack@n-api.service[125983]: ERROR nova.api.openstack.wsgi Jul 12 12:03:16.585602 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3a0e6bb0-279b-4009-bb5f-01d1a6e5fa52 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] Returning 404 to user: Instance cea153f9-9c62-4a41-a8be-4bdf4c5d3998 could not be found. {{(pid=125983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:03:16.590483 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-77d41cfe-750f-422f-9f92-586582d41f7e req-25571a11-d5b5-4129-a898-6874e258c154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e8509a-e132-4188-9ea8-f7ea3043f672", "tag": "f7838fb6-b628-4f6c-9cca-97fab689858b"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:16.590984 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3a0e6bb0-279b-4009-bb5f-01d1a6e5fa52 tempest-AttachSCSIVolumeTestJSON-1028067481 tempest-AttachSCSIVolumeTestJSON-1028067481-project] 10.222.0.50 "GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998" status: 404 len: 111 microversion: 2.1 time: 0.055776 Jul 12 12:03:16.590984 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1429/3029] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:16 2022] GET /compute/v2.1/servers/cea153f9-9c62-4a41-a8be-4bdf4c5d3998 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 12:03:16.594169 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-7e1189f1-0e0d-4049-92f8-3ed18a5b9f42 req-a52cece9-31a8-4a3e-9a3c-3574d9b604c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c11deeb-3a1a-477f-ab1c-cd66a5fef930", "name": "network-vif-plugged", "status": "completed", "tag": "4f655b24-a3d1-4d12-bfc2-6fee676ef485"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:16.596326 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-77d41cfe-750f-422f-9f92-586582d41f7e req-25571a11-d5b5-4129-a898-6874e258c154 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:16.597001 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-77d41cfe-750f-422f-9f92-586582d41f7e req-25571a11-d5b5-4129-a898-6874e258c154 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:16.616491 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-7e1189f1-0e0d-4049-92f8-3ed18a5b9f42 req-a52cece9-31a8-4a3e-9a3c-3574d9b604c7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:16.616989 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-7e1189f1-0e0d-4049-92f8-3ed18a5b9f42 req-a52cece9-31a8-4a3e-9a3c-3574d9b604c7 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:16.626123 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-77d41cfe-750f-422f-9f92-586582d41f7e req-25571a11-d5b5-4129-a898-6874e258c154 service nova] Creating event network-changed:f7838fb6-b628-4f6c-9cca-97fab689858b for instance 10e8509a-e132-4188-9ea8-f7ea3043f672 on n-h2-849104-4 Jul 12 12:03:16.637437 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-77d41cfe-750f-422f-9f92-586582d41f7e req-25571a11-d5b5-4129-a898-6874e258c154 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065514 Jul 12 12:03:16.638541 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1601/3030] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:16.641469 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-7e1189f1-0e0d-4049-92f8-3ed18a5b9f42 req-a52cece9-31a8-4a3e-9a3c-3574d9b604c7 service nova] Creating event network-vif-plugged:4f655b24-a3d1-4d12-bfc2-6fee676ef485 for instance 7c11deeb-3a1a-477f-ab1c-cd66a5fef930 on n-h2-849104-4 Jul 12 12:03:16.650225 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-7e1189f1-0e0d-4049-92f8-3ed18a5b9f42 req-a52cece9-31a8-4a3e-9a3c-3574d9b604c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059497 Jul 12 12:03:16.651140 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1430/3031] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:16.670105 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-43eb04a4-59fa-47e0-a919-66568fd19ffb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:16.672156 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-43eb04a4-59fa-47e0-a919-66568fd19ffb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:16.694615 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43eb04a4-59fa-47e0-a919-66568fd19ffb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:16.695565 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43eb04a4-59fa-47e0-a919-66568fd19ffb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:16.696645 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43eb04a4-59fa-47e0-a919-66568fd19ffb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:16.696832 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9ae9bdfd-76b2-4eaa-81d6-01ac4dc6749d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:16.697496 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-43eb04a4-59fa-47e0-a919-66568fd19ffb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:16.698314 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9ae9bdfd-76b2-4eaa-81d6-01ac4dc6749d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:16.705889 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ae9bdfd-76b2-4eaa-81d6-01ac4dc6749d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:16.706515 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ae9bdfd-76b2-4eaa-81d6-01ac4dc6749d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:16.707320 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ae9bdfd-76b2-4eaa-81d6-01ac4dc6749d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:16.707769 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9ae9bdfd-76b2-4eaa-81d6-01ac4dc6749d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:17.226022 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=12 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:17.595804 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-43eb04a4-59fa-47e0-a919-66568fd19ffb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:17.609536 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-43eb04a4-59fa-47e0-a919-66568fd19ffb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:17.611288 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-43eb04a4-59fa-47e0-a919-66568fd19ffb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:17.612801 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-43eb04a4-59fa-47e0-a919-66568fd19ffb tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 2957 microversion: 2.32 time: 0.972572 Jul 12 12:03:17.613704 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1602/3032] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:16 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 2957 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:17.618624 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3f95168f-8e36-48fb-a47e-1feea9502de9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:17.619244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3f95168f-8e36-48fb-a47e-1feea9502de9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:17.630419 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f95168f-8e36-48fb-a47e-1feea9502de9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:17.631052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f95168f-8e36-48fb-a47e-1feea9502de9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:17.632628 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f95168f-8e36-48fb-a47e-1feea9502de9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:17.633096 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f95168f-8e36-48fb-a47e-1feea9502de9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:17.836210 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9ae9bdfd-76b2-4eaa-81d6-01ac4dc6749d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:17.851326 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9ae9bdfd-76b2-4eaa-81d6-01ac4dc6749d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1322 microversion: 2.1 time: 1.158591 Jul 12 12:03:17.854329 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1431/3033] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:16 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1322 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:17.873088 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-62014588-1879-45ad-9130-c46b201e8abe tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:17.882108 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-62014588-1879-45ad-9130-c46b201e8abe tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:17.892165 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-62014588-1879-45ad-9130-c46b201e8abe tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:17.894065 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-62014588-1879-45ad-9130-c46b201e8abe tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:17.894951 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-62014588-1879-45ad-9130-c46b201e8abe tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:17.904459 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-62014588-1879-45ad-9130-c46b201e8abe tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:18.006810 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-62014588-1879-45ad-9130-c46b201e8abe tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:18.020589 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-62014588-1879-45ad-9130-c46b201e8abe tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:18.022556 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-62014588-1879-45ad-9130-c46b201e8abe tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:18.025091 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-62014588-1879-45ad-9130-c46b201e8abe tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1264 microversion: 2.25 time: 0.159348 Jul 12 12:03:18.025684 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1432/3034] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:17 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:18.030965 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5874a845-02de-44b1-ac35-4d2da82da315 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:18.031789 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5874a845-02de-44b1-ac35-4d2da82da315 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:18.040246 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5874a845-02de-44b1-ac35-4d2da82da315 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:18.040968 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5874a845-02de-44b1-ac35-4d2da82da315 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:18.044825 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5874a845-02de-44b1-ac35-4d2da82da315 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:18.045555 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5874a845-02de-44b1-ac35-4d2da82da315 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:18.226598 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3f95168f-8e36-48fb-a47e-1feea9502de9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c54b84fd2154250b8dc326b87923c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47db0ac76b374ba08a1693a94ddff731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:18.242664 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3f95168f-8e36-48fb-a47e-1feea9502de9 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1" status: 200 len: 1362 microversion: 2.1 time: 0.626903 Jul 12 12:03:18.257372 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1603/3035] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:17 2022] GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1 => generated 1362 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:18.314092 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5874a845-02de-44b1-ac35-4d2da82da315 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:18.328667 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5874a845-02de-44b1-ac35-4d2da82da315 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1522 microversion: 2.1 time: 0.301397 Jul 12 12:03:18.329179 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1433/3036] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:18 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:18.636666 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3a25bf1a-2ebb-4815-9b37-947ddfeb6e31 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:18.637837 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3a25bf1a-2ebb-4815-9b37-947ddfeb6e31 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:18.654053 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3a25bf1a-2ebb-4815-9b37-947ddfeb6e31 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:18.655701 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3a25bf1a-2ebb-4815-9b37-947ddfeb6e31 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:18.660245 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3a25bf1a-2ebb-4815-9b37-947ddfeb6e31 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:18.662553 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3a25bf1a-2ebb-4815-9b37-947ddfeb6e31 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:18.871063 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3bbffdc4-2719-4d58-9f8c-7504a5cc6bc8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:18.871685 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3bbffdc4-2719-4d58-9f8c-7504a5cc6bc8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:18.873673 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:18.879979 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3bbffdc4-2719-4d58-9f8c-7504a5cc6bc8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:18.880471 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3bbffdc4-2719-4d58-9f8c-7504a5cc6bc8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:18.881267 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3bbffdc4-2719-4d58-9f8c-7504a5cc6bc8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:18.881714 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3bbffdc4-2719-4d58-9f8c-7504a5cc6bc8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:19.267072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3bbffdc4-2719-4d58-9f8c-7504a5cc6bc8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:19.278880 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3bbffdc4-2719-4d58-9f8c-7504a5cc6bc8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1322 microversion: 2.1 time: 0.411013 Jul 12 12:03:19.281235 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1434/3037] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:18 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:19.301507 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6567b9a0-220e-450e-81eb-1237ba6bd149 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:19.302127 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6567b9a0-220e-450e-81eb-1237ba6bd149 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:19.315230 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6567b9a0-220e-450e-81eb-1237ba6bd149 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:19.335971 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6567b9a0-220e-450e-81eb-1237ba6bd149 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:19.337418 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6567b9a0-220e-450e-81eb-1237ba6bd149 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:19.338038 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6567b9a0-220e-450e-81eb-1237ba6bd149 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:19.379455 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3a25bf1a-2ebb-4815-9b37-947ddfeb6e31 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:19.395706 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3a25bf1a-2ebb-4815-9b37-947ddfeb6e31 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:19.400675 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3a25bf1a-2ebb-4815-9b37-947ddfeb6e31 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:19.404529 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3a25bf1a-2ebb-4815-9b37-947ddfeb6e31 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 2957 microversion: 2.32 time: 0.775243 Jul 12 12:03:19.407023 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1604/3038] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:18 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 2957 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:19.419466 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-95b9a162-3799-4158-91f2-924a1f3628dd tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:19.420457 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-95b9a162-3799-4158-91f2-924a1f3628dd tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:19.434100 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-95b9a162-3799-4158-91f2-924a1f3628dd tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:19.436617 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-95b9a162-3799-4158-91f2-924a1f3628dd tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:19.446052 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-95b9a162-3799-4158-91f2-924a1f3628dd tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:19.447166 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-95b9a162-3799-4158-91f2-924a1f3628dd tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:19.474483 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6567b9a0-220e-450e-81eb-1237ba6bd149 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:19.498991 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6567b9a0-220e-450e-81eb-1237ba6bd149 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:19.503350 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6567b9a0-220e-450e-81eb-1237ba6bd149 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:19.505095 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6567b9a0-220e-450e-81eb-1237ba6bd149 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 200 len: 1264 microversion: 2.25 time: 0.222585 Jul 12 12:03:19.519946 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1435/3039] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:19 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:19.530252 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-5ff6f46f-556b-4caa-bb09-1d34e27ce2c2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:19.532856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-5ff6f46f-556b-4caa-bb09-1d34e27ce2c2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:19.547088 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5ff6f46f-556b-4caa-bb09-1d34e27ce2c2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:19.549323 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5ff6f46f-556b-4caa-bb09-1d34e27ce2c2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:19.550422 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5ff6f46f-556b-4caa-bb09-1d34e27ce2c2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:19.552212 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-5ff6f46f-556b-4caa-bb09-1d34e27ce2c2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:19.910711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-5ff6f46f-556b-4caa-bb09-1d34e27ce2c2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:19.918778 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-5ff6f46f-556b-4caa-bb09-1d34e27ce2c2 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1507 microversion: 2.1 time: 0.397451 Jul 12 12:03:19.919368 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1436/3040] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:19 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1507 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:19.928596 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-9ad56f33-884c-4383-b3e2-ee298c10258f req-800dbbac-c280-4f42-b9cd-e708d4d16427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e8509a-e132-4188-9ea8-f7ea3043f672", "name": "network-vif-plugged", "status": "completed", "tag": "f7838fb6-b628-4f6c-9cca-97fab689858b"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:19.945986 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-9ad56f33-884c-4383-b3e2-ee298c10258f req-800dbbac-c280-4f42-b9cd-e708d4d16427 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:19.947100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-9ad56f33-884c-4383-b3e2-ee298c10258f req-800dbbac-c280-4f42-b9cd-e708d4d16427 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:19.962150 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-9ad56f33-884c-4383-b3e2-ee298c10258f req-800dbbac-c280-4f42-b9cd-e708d4d16427 service nova] Creating event network-vif-plugged:f7838fb6-b628-4f6c-9cca-97fab689858b for instance 10e8509a-e132-4188-9ea8-f7ea3043f672 on n-h2-849104-4 Jul 12 12:03:19.970520 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-9ad56f33-884c-4383-b3e2-ee298c10258f req-800dbbac-c280-4f42-b9cd-e708d4d16427 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048556 Jul 12 12:03:19.971406 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1437/3041] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:19.979802 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3b936fcf-ecc5-4449-888a-97045bbd72a4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:19.980798 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3b936fcf-ecc5-4449-888a-97045bbd72a4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:19.991202 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b936fcf-ecc5-4449-888a-97045bbd72a4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:19.992729 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b936fcf-ecc5-4449-888a-97045bbd72a4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:19.993823 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b936fcf-ecc5-4449-888a-97045bbd72a4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:19.994601 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3b936fcf-ecc5-4449-888a-97045bbd72a4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:20.453925 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-95b9a162-3799-4158-91f2-924a1f3628dd tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c54b84fd2154250b8dc326b87923c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47db0ac76b374ba08a1693a94ddff731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:20.462877 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-95b9a162-3799-4158-91f2-924a1f3628dd tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1" status: 200 len: 1362 microversion: 2.1 time: 1.054604 Jul 12 12:03:20.463492 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1605/3042] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:19 2022] GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1 => generated 1362 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:20.501104 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b47a6b59-426e-41c2-9010-0e8bdf585b4d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:20.502357 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b47a6b59-426e-41c2-9010-0e8bdf585b4d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:20.531681 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b47a6b59-426e-41c2-9010-0e8bdf585b4d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:20.532164 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b47a6b59-426e-41c2-9010-0e8bdf585b4d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:20.532948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b47a6b59-426e-41c2-9010-0e8bdf585b4d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:20.533416 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b47a6b59-426e-41c2-9010-0e8bdf585b4d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:20.689660 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3b936fcf-ecc5-4449-888a-97045bbd72a4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:20.709867 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3b936fcf-ecc5-4449-888a-97045bbd72a4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 200 len: 1507 microversion: 2.1 time: 0.736689 Jul 12 12:03:20.716939 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1438/3043] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:19 2022] GET /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 1507 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:20.732525 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ee5e6bf0-2b50-4cc9-a552-770bfd9d86ef tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:20.733997 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ee5e6bf0-2b50-4cc9-a552-770bfd9d86ef tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:20.755564 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee5e6bf0-2b50-4cc9-a552-770bfd9d86ef tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:20.756355 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee5e6bf0-2b50-4cc9-a552-770bfd9d86ef tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:20.758363 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee5e6bf0-2b50-4cc9-a552-770bfd9d86ef tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:20.761929 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ee5e6bf0-2b50-4cc9-a552-770bfd9d86ef tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:21.173464 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b47a6b59-426e-41c2-9010-0e8bdf585b4d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:21.194483 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b47a6b59-426e-41c2-9010-0e8bdf585b4d tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1322 microversion: 2.1 time: 0.705860 Jul 12 12:03:21.195929 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1606/3044] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:20 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1322 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:21.208019 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-77f2800f-e181-49eb-a5c9-23fe02deb89b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:21.209047 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-77f2800f-e181-49eb-a5c9-23fe02deb89b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 6834c01a-284c-47fc-8939-403833f0ebd8] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:21.222797 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-77f2800f-e181-49eb-a5c9-23fe02deb89b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:21.228951 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-77f2800f-e181-49eb-a5c9-23fe02deb89b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:21.230107 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-77f2800f-e181-49eb-a5c9-23fe02deb89b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:21.240832 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-77f2800f-e181-49eb-a5c9-23fe02deb89b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:21.262960 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-77f2800f-e181-49eb-a5c9-23fe02deb89b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] HTTP exception thrown: Instance 6834c01a-284c-47fc-8939-403833f0ebd8 could not be found. Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-77f2800f-e181-49eb-a5c9-23fe02deb89b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Request method failure captured: Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 HTTP/1.1 Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWFEvGfQx2AgQ1Q_xSN12VYOc87SJAobrSGC55wg6DNAlBq3T4JtAZHH7iMQUR5lXvNzUSLeW97ubm6Zawq8ttB1_9M7ERq4ah2f-MKVVBt8xcOmQ4buDwnw7krbAqiOgGS9th_sXssvhn0yEsvALx7nhk5EsQhD1urO6k39VQDmN_U Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Openstack-Nova-Api-Version: 2.25 Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 29fd5f6c853549a794c75ebff736ccf4 Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2112324554 Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/29fd5f6c853549a794c75ebff736ccf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/29fd5f6c853549a794c75ebff736ccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/29fd5f6c853549a794c75ebff736ccf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_29fd5f6c853549a794c75ebff736ccf4", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2112324554 Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 29fd5f6c853549a794c75ebff736ccf4 Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2112324554 Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-LiveAutoBlockMigrationV225Test-2112324554-project Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: ae0b32f84b7146d49338e7a2c06bc579 Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2112324554-project Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 6834c01a-284c-47fc-8939-403833f0ebd8 could not be found. Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '6834c01a-284c-47fc-8939-403833f0ebd8'} Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6834c01a-284c-47fc-8939-403833f0ebd8 could not be found. Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6834c01a-284c-47fc-8939-403833f0ebd8 could not be found. Jul 12 12:03:21.266551 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:21.272456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:21.272456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:21.272456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:21.272456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:03:21.272456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:03:21.272456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:03:21.272456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:03:21.272456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6834c01a-284c-47fc-8939-403833f0ebd8 could not be found. Jul 12 12:03:21.272456 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:21.272456 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-77f2800f-e181-49eb-a5c9-23fe02deb89b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Returning 404 to user: Instance 6834c01a-284c-47fc-8939-403833f0ebd8 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:03:21.272456 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-77f2800f-e181-49eb-a5c9-23fe02deb89b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8" status: 404 len: 111 microversion: 2.25 time: 0.070921 Jul 12 12:03:21.276647 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1607/3045] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:21 2022] GET /compute/v2.1/servers/6834c01a-284c-47fc-8939-403833f0ebd8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 12:03:21.289279 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-1997fd09-2ebb-439a-9a45-434434564622 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:21.289791 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1997fd09-2ebb-439a-9a45-434434564622 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:21.304322 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1997fd09-2ebb-439a-9a45-434434564622 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:21.304790 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1997fd09-2ebb-439a-9a45-434434564622 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:21.305583 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1997fd09-2ebb-439a-9a45-434434564622 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:21.306036 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-1997fd09-2ebb-439a-9a45-434434564622 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:21.355926 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-1997fd09-2ebb-439a-9a45-434434564622 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 7c11deeb-3a1a-477f-ab1c-cd66a5fef930] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:03:21.551994 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-1997fd09-2ebb-439a-9a45-434434564622 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930" status: 204 len: 0 microversion: 2.1 time: 0.273468 Jul 12 12:03:21.553898 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1608/3046] 10.222.0.50 () {58 vars in 1238 bytes} [Tue Jul 12 12:03:21 2022] DELETE /compute/v2.1/servers/7c11deeb-3a1a-477f-ab1c-cd66a5fef930 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 12:03:21.590680 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-80322457-cf5b-42fe-b19f-ad228a2f7fbf tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:21.591821 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-80322457-cf5b-42fe-b19f-ad228a2f7fbf tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:21.615607 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-80322457-cf5b-42fe-b19f-ad228a2f7fbf tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:21.621485 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-80322457-cf5b-42fe-b19f-ad228a2f7fbf tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:21.622873 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-80322457-cf5b-42fe-b19f-ad228a2f7fbf tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:21.624000 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-80322457-cf5b-42fe-b19f-ad228a2f7fbf tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:21.683382 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ee5e6bf0-2b50-4cc9-a552-770bfd9d86ef tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:21.708141 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ee5e6bf0-2b50-4cc9-a552-770bfd9d86ef tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:21.717815 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ee5e6bf0-2b50-4cc9-a552-770bfd9d86ef tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:21.719823 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ee5e6bf0-2b50-4cc9-a552-770bfd9d86ef tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 2957 microversion: 2.32 time: 1.001035 Jul 12 12:03:21.721052 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1439/3047] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:20 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 2957 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:21.817655 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1287432087", "imageRef": "5ee904a7-466a-46fc-89be-d728bca3527e", "flavorRef": "452", "networks": [{"uuid": "f4ac0726-e839-448f-a6d9-960e0dc48281"}]}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:21.908089 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.network.neutron [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] validate_networks() for [('f4ac0726-e839-448f-a6d9-960e0dc48281', None, None, None, None, None)] {{(pid=125983) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 12:03:22.896772 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-80322457-cf5b-42fe-b19f-ad228a2f7fbf tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c54b84fd2154250b8dc326b87923c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47db0ac76b374ba08a1693a94ddff731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:22.906289 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-80322457-cf5b-42fe-b19f-ad228a2f7fbf tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1" status: 200 len: 1362 microversion: 2.1 time: 1.338649 Jul 12 12:03:22.917824 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1609/3048] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:21 2022] GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1 => generated 1362 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:22.924162 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b0c2e8fa-2679-4328-b1bc-f244ff6acc3c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:22.925110 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b0c2e8fa-2679-4328-b1bc-f244ff6acc3c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:22.931925 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b0c2e8fa-2679-4328-b1bc-f244ff6acc3c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:22.933244 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b0c2e8fa-2679-4328-b1bc-f244ff6acc3c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:22.934464 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b0c2e8fa-2679-4328-b1bc-f244ff6acc3c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:22.935360 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b0c2e8fa-2679-4328-b1bc-f244ff6acc3c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:23.253633 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Flavor limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 12:03:23.257334 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Image limits 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 12:03:23.262025 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Flavor pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 12:03:23.262829 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Image pref 0:0:0 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 12:03:23.263710 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.virt.hardware [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 12:03:23.305705 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:23.307184 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:23.316410 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:23.317682 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:23.361302 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Getting quotas for project b4d3ca9b6340438c998a53df6dd73496. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 12:03:23.375785 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.quota [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Getting quotas for user 7302f396799e41a28b8dec72fb3fc6db and project b4d3ca9b6340438c998a53df6dd73496. Resources: {'cores', 'instances', 'ram'} {{(pid=125983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 12:03:23.418907 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Going to run 1 instances... {{(pid=125983) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 12:03:23.425100 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 3e62539f-e524-468c-9fda-8d0c665c6857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee904a7-466a-46fc-89be-d728bca3527e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 12:03:23.582241 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f45124be-1258-4612-987f-bedd424d94cb tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.769186 Jul 12 12:03:23.586553 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1440/3049] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Jul 12 12:03:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 12:03:23.598575 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-c9096ed4-4887-4956-9431-cfaa9ace79fc req-a6acdc71-c4ee-434e-8436-2bd785c7c4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb8c998f-98d6-43d7-a11a-b0a648cccae1", "name": "network-vif-plugged", "status": "completed", "tag": "66c28bf3-b6db-4656-976e-ce75e0bd3288"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:23.662790 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-c9096ed4-4887-4956-9431-cfaa9ace79fc req-a6acdc71-c4ee-434e-8436-2bd785c7c4c4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:23.667178 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-c9096ed4-4887-4956-9431-cfaa9ace79fc req-a6acdc71-c4ee-434e-8436-2bd785c7c4c4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:23.687385 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:23.713913 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-c9096ed4-4887-4956-9431-cfaa9ace79fc req-a6acdc71-c4ee-434e-8436-2bd785c7c4c4 service nova] Creating event network-vif-plugged:66c28bf3-b6db-4656-976e-ce75e0bd3288 for instance eb8c998f-98d6-43d7-a11a-b0a648cccae1 on n-h1-849104-4 Jul 12 12:03:23.742757 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-c9096ed4-4887-4956-9431-cfaa9ace79fc req-a6acdc71-c4ee-434e-8436-2bd785c7c4c4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154570 Jul 12 12:03:23.747132 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1441/3050] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:23.764730 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-4492f407-6858-4c86-a0c4-ce58c6660b88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:23.766463 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-4492f407-6858-4c86-a0c4-ce58c6660b88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:23.782377 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4492f407-6858-4c86-a0c4-ce58c6660b88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:23.788283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4492f407-6858-4c86-a0c4-ce58c6660b88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:23.790252 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4492f407-6858-4c86-a0c4-ce58c6660b88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:23.792463 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-4492f407-6858-4c86-a0c4-ce58c6660b88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:24.165050 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b0c2e8fa-2679-4328-b1bc-f244ff6acc3c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:24.183081 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b0c2e8fa-2679-4328-b1bc-f244ff6acc3c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1322 microversion: 2.1 time: 1.260443 Jul 12 12:03:24.194025 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1610/3051] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:22 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1322 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:24.206190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-2de1f65f-b941-4923-a4e2-702d0097dedd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:24.211517 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-2de1f65f-b941-4923-a4e2-702d0097dedd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 3e62539f-e524-468c-9fda-8d0c665c6857] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:25.079678 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-2de1f65f-b941-4923-a4e2-702d0097dedd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:25.089016 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-2de1f65f-b941-4923-a4e2-702d0097dedd tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857" status: 200 len: 1218 microversion: 2.1 time: 0.890969 Jul 12 12:03:25.095825 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1611/3052] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:24 2022] GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857 => generated 1218 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:25.127514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-602087dd-ceff-4d1c-9082-e5a58107e373 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:25.138885 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-602087dd-ceff-4d1c-9082-e5a58107e373 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:25.148479 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-602087dd-ceff-4d1c-9082-e5a58107e373 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:25.149195 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-602087dd-ceff-4d1c-9082-e5a58107e373 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:25.150242 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-602087dd-ceff-4d1c-9082-e5a58107e373 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:25.154865 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-602087dd-ceff-4d1c-9082-e5a58107e373 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:25.241247 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:25.829056 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4492f407-6858-4c86-a0c4-ce58c6660b88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:25.841795 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-602087dd-ceff-4d1c-9082-e5a58107e373 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c54b84fd2154250b8dc326b87923c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47db0ac76b374ba08a1693a94ddff731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:25.843471 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4492f407-6858-4c86-a0c4-ce58c6660b88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:25.847785 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-4492f407-6858-4c86-a0c4-ce58c6660b88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:25.850863 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-4492f407-6858-4c86-a0c4-ce58c6660b88 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 2936 microversion: 2.32 time: 2.101864 Jul 12 12:03:25.855818 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1442/3053] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:23 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 2936 bytes in 2108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:25.866906 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-47dc2f0c-cff6-4aea-84d8-1a9e2c4dfda4 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:25.868884 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-47dc2f0c-cff6-4aea-84d8-1a9e2c4dfda4 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:25.886771 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-602087dd-ceff-4d1c-9082-e5a58107e373 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1" status: 200 len: 1362 microversion: 2.1 time: 0.770724 Jul 12 12:03:25.888251 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47dc2f0c-cff6-4aea-84d8-1a9e2c4dfda4 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:25.889135 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47dc2f0c-cff6-4aea-84d8-1a9e2c4dfda4 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:25.890250 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47dc2f0c-cff6-4aea-84d8-1a9e2c4dfda4 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:25.894729 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1612/3054] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:25 2022] GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1 => generated 1362 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:25.895621 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-47dc2f0c-cff6-4aea-84d8-1a9e2c4dfda4 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:25.930401 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-b36def1b-0d8e-4e44-b229-1bd245966d94 req-df0e6241-8845-4388-b0b7-cfed8fa283a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ecb79d2-418a-40f3-bbd7-5075a19926a1", "name": "network-vif-plugged", "status": "completed", "tag": "d888ba8b-9b44-4f36-8099-a696071920dd"}, {"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-unplugged", "status": "completed", "tag": "6e06bf3e-6215-4546-a454-04123539ab53"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:25.944635 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b36def1b-0d8e-4e44-b229-1bd245966d94 req-df0e6241-8845-4388-b0b7-cfed8fa283a5 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:25.945096 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-b36def1b-0d8e-4e44-b229-1bd245966d94 req-df0e6241-8845-4388-b0b7-cfed8fa283a5 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:25.990580 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-b36def1b-0d8e-4e44-b229-1bd245966d94 req-df0e6241-8845-4388-b0b7-cfed8fa283a5 service nova] Creating event network-vif-plugged:d888ba8b-9b44-4f36-8099-a696071920dd for instance 6ecb79d2-418a-40f3-bbd7-5075a19926a1 on n-h1-849104-4 Jul 12 12:03:25.996539 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-b36def1b-0d8e-4e44-b229-1bd245966d94 req-df0e6241-8845-4388-b0b7-cfed8fa283a5 service nova] Creating event network-vif-unplugged:6e06bf3e-6215-4546-a454-04123539ab53 for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:03:26.022512 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-b36def1b-0d8e-4e44-b229-1bd245966d94 req-df0e6241-8845-4388-b0b7-cfed8fa283a5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.095684 Jul 12 12:03:26.024644 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1613/3055] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:03:26.113728 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b7bc47bd-23ab-4481-a382-36b33ca96b50 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:26.114453 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b7bc47bd-23ab-4481-a382-36b33ca96b50 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 3e62539f-e524-468c-9fda-8d0c665c6857] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:26.134319 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7bc47bd-23ab-4481-a382-36b33ca96b50 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:26.134785 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7bc47bd-23ab-4481-a382-36b33ca96b50 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:26.135619 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7bc47bd-23ab-4481-a382-36b33ca96b50 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:26.136085 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b7bc47bd-23ab-4481-a382-36b33ca96b50 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:26.432102 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b7bc47bd-23ab-4481-a382-36b33ca96b50 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:26.448615 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b7bc47bd-23ab-4481-a382-36b33ca96b50 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857" status: 200 len: 1276 microversion: 2.1 time: 0.338967 Jul 12 12:03:26.449228 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1614/3056] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:26 2022] GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857 => generated 1276 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:26.877169 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-b420a856-cacf-4efe-8ba9-fb3fd4f8ffc9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:26.877797 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-b420a856-cacf-4efe-8ba9-fb3fd4f8ffc9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:26.897006 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b420a856-cacf-4efe-8ba9-fb3fd4f8ffc9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:26.897478 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b420a856-cacf-4efe-8ba9-fb3fd4f8ffc9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:26.898295 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b420a856-cacf-4efe-8ba9-fb3fd4f8ffc9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:26.898745 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-b420a856-cacf-4efe-8ba9-fb3fd4f8ffc9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:27.902357 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b420a856-cacf-4efe-8ba9-fb3fd4f8ffc9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:27.911938 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b420a856-cacf-4efe-8ba9-fb3fd4f8ffc9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:27.921315 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-b420a856-cacf-4efe-8ba9-fb3fd4f8ffc9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:27.928387 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-b420a856-cacf-4efe-8ba9-fb3fd4f8ffc9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 2915 microversion: 2.32 time: 1.055509 Jul 12 12:03:27.932077 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1615/3057] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:26 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 2915 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:03:27.938067 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e9647f7e-943c-4a0e-a08f-2afa9de9e29d tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:27.961035 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e9647f7e-943c-4a0e-a08f-2afa9de9e29d tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:27.970790 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9647f7e-943c-4a0e-a08f-2afa9de9e29d tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:27.971737 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9647f7e-943c-4a0e-a08f-2afa9de9e29d tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:27.972735 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9647f7e-943c-4a0e-a08f-2afa9de9e29d tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:27.975421 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e9647f7e-943c-4a0e-a08f-2afa9de9e29d tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:28.835270 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-47dc2f0c-cff6-4aea-84d8-1a9e2c4dfda4 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:28.848425 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-47dc2f0c-cff6-4aea-84d8-1a9e2c4dfda4 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1322 microversion: 2.1 time: 2.991030 Jul 12 12:03:28.849421 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1443/3058] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:25 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1322 bytes in 2993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:28.860835 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9e3d7482-b925-4882-9c16-81c1826b6c90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:28.861499 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9e3d7482-b925-4882-9c16-81c1826b6c90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 3e62539f-e524-468c-9fda-8d0c665c6857] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:28.863011 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e9647f7e-943c-4a0e-a08f-2afa9de9e29d tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c54b84fd2154250b8dc326b87923c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47db0ac76b374ba08a1693a94ddff731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:28.876364 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9e3d7482-b925-4882-9c16-81c1826b6c90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:28.876830 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9e3d7482-b925-4882-9c16-81c1826b6c90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:28.877620 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9e3d7482-b925-4882-9c16-81c1826b6c90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:28.878061 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9e3d7482-b925-4882-9c16-81c1826b6c90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:28.894197 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e9647f7e-943c-4a0e-a08f-2afa9de9e29d tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1" status: 200 len: 1549 microversion: 2.1 time: 0.959384 Jul 12 12:03:28.904521 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1616/3059] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:27 2022] GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1 => generated 1549 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:28.938469 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-9e7c92b0-fbf8-4c8b-b2b2-a5044c44bb7e req-3a583167-884d-4691-8944-4825dd8757c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-unplugged", "status": "completed", "tag": "7735c15f-29a4-4440-9e1b-3a9b16dafddb"}, {"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-unplugged", "status": "completed", "tag": "4b024111-c5ba-43ca-a440-579a6738d07e"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:28.964627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-9e7c92b0-fbf8-4c8b-b2b2-a5044c44bb7e req-3a583167-884d-4691-8944-4825dd8757c4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:28.965444 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-9e7c92b0-fbf8-4c8b-b2b2-a5044c44bb7e req-3a583167-884d-4691-8944-4825dd8757c4 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:29.029911 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-9e7c92b0-fbf8-4c8b-b2b2-a5044c44bb7e req-3a583167-884d-4691-8944-4825dd8757c4 service nova] Creating event network-vif-unplugged:7735c15f-29a4-4440-9e1b-3a9b16dafddb for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:03:29.030825 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-9e7c92b0-fbf8-4c8b-b2b2-a5044c44bb7e req-3a583167-884d-4691-8944-4825dd8757c4 service nova] Creating event network-vif-unplugged:4b024111-c5ba-43ca-a440-579a6738d07e for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:03:29.060953 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-9e7c92b0-fbf8-4c8b-b2b2-a5044c44bb7e req-3a583167-884d-4691-8944-4825dd8757c4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.153017 Jul 12 12:03:29.062014 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1617/3060] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:29.081629 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3367ecfe-fa22-451e-b50e-7b5213b7b7b1 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:29.093902 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3367ecfe-fa22-451e-b50e-7b5213b7b7b1 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] [instance: eb8c998f-98d6-43d7-a11a-b0a648cccae1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:29.120132 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3367ecfe-fa22-451e-b50e-7b5213b7b7b1 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:29.121326 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3367ecfe-fa22-451e-b50e-7b5213b7b7b1 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:29.122958 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3367ecfe-fa22-451e-b50e-7b5213b7b7b1 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:29.128075 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3367ecfe-fa22-451e-b50e-7b5213b7b7b1 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:29.336261 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9e3d7482-b925-4882-9c16-81c1826b6c90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:29.344486 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3367ecfe-fa22-451e-b50e-7b5213b7b7b1 tempest-ServerActionsTestJSON-177212062 tempest-ServerActionsTestJSON-177212062-project] 10.222.0.50 "GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.271165 Jul 12 12:03:29.345844 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1618/3061] 10.222.0.50 () {58 vars in 1274 bytes} [Tue Jul 12 12:03:29 2022] GET /compute/v2.1/servers/eb8c998f-98d6-43d7-a11a-b0a648cccae1/os-interface => generated 284 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:29.347067 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9e3d7482-b925-4882-9c16-81c1826b6c90 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857" status: 200 len: 1276 microversion: 2.1 time: 0.494195 Jul 12 12:03:29.356627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9570eac2-3b5d-474f-9390-ed5dd220f8b1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:29.361481 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1444/3062] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:28 2022] GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857 => generated 1276 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:29.366670 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9750bde0-5765-46fa-b6b3-a8a39649bcc4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:29.372845 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9750bde0-5765-46fa-b6b3-a8a39649bcc4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:29.373650 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9570eac2-3b5d-474f-9390-ed5dd220f8b1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:29.386462 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9750bde0-5765-46fa-b6b3-a8a39649bcc4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:29.387163 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9750bde0-5765-46fa-b6b3-a8a39649bcc4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:29.388308 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9750bde0-5765-46fa-b6b3-a8a39649bcc4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:29.391895 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9750bde0-5765-46fa-b6b3-a8a39649bcc4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:29.406612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9570eac2-3b5d-474f-9390-ed5dd220f8b1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:29.407514 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9570eac2-3b5d-474f-9390-ed5dd220f8b1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:29.410707 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9570eac2-3b5d-474f-9390-ed5dd220f8b1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:29.413305 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9570eac2-3b5d-474f-9390-ed5dd220f8b1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:29.446968 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9750bde0-5765-46fa-b6b3-a8a39649bcc4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:03:29.612383 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9750bde0-5765-46fa-b6b3-a8a39649bcc4 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 204 len: 0 microversion: 2.25 time: 0.246077 Jul 12 12:03:29.615234 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1445/3063] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 12:03:29 2022] DELETE /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 12:03:29.632106 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-26e7d522-cbd3-4b5b-85c2-fdd34416335c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:29.636283 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-26e7d522-cbd3-4b5b-85c2-fdd34416335c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:29.661155 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26e7d522-cbd3-4b5b-85c2-fdd34416335c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:29.662690 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26e7d522-cbd3-4b5b-85c2-fdd34416335c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:29.664532 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26e7d522-cbd3-4b5b-85c2-fdd34416335c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:29.667172 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-26e7d522-cbd3-4b5b-85c2-fdd34416335c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:30.223737 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-26e7d522-cbd3-4b5b-85c2-fdd34416335c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:30.241148 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-26e7d522-cbd3-4b5b-85c2-fdd34416335c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:30.243339 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-26e7d522-cbd3-4b5b-85c2-fdd34416335c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:30.245523 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-26e7d522-cbd3-4b5b-85c2-fdd34416335c tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1733 microversion: 2.25 time: 0.624842 Jul 12 12:03:30.246433 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1446/3064] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:29 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1733 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:30.251705 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-45df3c82-6543-41d1-be85-8088eeb38c28 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:30.262048 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-45df3c82-6543-41d1-be85-8088eeb38c28 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:30.269045 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-45df3c82-6543-41d1-be85-8088eeb38c28 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:30.271595 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-45df3c82-6543-41d1-be85-8088eeb38c28 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:30.272732 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-45df3c82-6543-41d1-be85-8088eeb38c28 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:30.277033 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-45df3c82-6543-41d1-be85-8088eeb38c28 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:30.300888 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9570eac2-3b5d-474f-9390-ed5dd220f8b1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:30.315282 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9570eac2-3b5d-474f-9390-ed5dd220f8b1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:30.316833 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9570eac2-3b5d-474f-9390-ed5dd220f8b1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:30.318082 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9570eac2-3b5d-474f-9390-ed5dd220f8b1 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 2868 microversion: 2.32 time: 0.970712 Jul 12 12:03:30.318636 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1619/3065] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:29 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 2868 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:30.350864 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-15ede6bb-591a-4a26-992e-c89c33f34151 req-c2e60af3-fe2b-4694-9ea0-8eb6bb177823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-deleted", "tag": "a0d155ae-ac1b-49ea-b8e9-248ed51e6471"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:30.368627 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-15ede6bb-591a-4a26-992e-c89c33f34151 req-c2e60af3-fe2b-4694-9ea0-8eb6bb177823 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:30.370252 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-15ede6bb-591a-4a26-992e-c89c33f34151 req-c2e60af3-fe2b-4694-9ea0-8eb6bb177823 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:30.399384 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-15ede6bb-591a-4a26-992e-c89c33f34151 req-c2e60af3-fe2b-4694-9ea0-8eb6bb177823 service nova] Creating event network-vif-deleted:a0d155ae-ac1b-49ea-b8e9-248ed51e6471 for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:03:30.407068 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-15ede6bb-591a-4a26-992e-c89c33f34151 req-c2e60af3-fe2b-4694-9ea0-8eb6bb177823 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074409 Jul 12 12:03:30.410529 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1620/3066] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:30.436066 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-4a037b10-4714-49cd-86ca-319fc5315958 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:30.443713 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-4a037b10-4714-49cd-86ca-319fc5315958 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 3e62539f-e524-468c-9fda-8d0c665c6857] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:30.452024 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4a037b10-4714-49cd-86ca-319fc5315958 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:30.452878 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4a037b10-4714-49cd-86ca-319fc5315958 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:30.454701 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4a037b10-4714-49cd-86ca-319fc5315958 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:30.455626 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-4a037b10-4714-49cd-86ca-319fc5315958 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:30.752094 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-4a037b10-4714-49cd-86ca-319fc5315958 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:30.763151 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-4a037b10-4714-49cd-86ca-319fc5315958 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857" status: 200 len: 1276 microversion: 2.1 time: 0.350982 Jul 12 12:03:30.766281 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1621/3067] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:30 2022] GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857 => generated 1276 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:31.077615 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-45df3c82-6543-41d1-be85-8088eeb38c28 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:31.090511 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-45df3c82-6543-41d1-be85-8088eeb38c28 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1517 microversion: 2.1 time: 0.842638 Jul 12 12:03:31.091382 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1447/3068] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:30 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1517 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:31.102236 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-8b023085-4711-4994-bb1d-a12938b785be req-783b8801-3915-48af-b3a7-d34d8c632948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c11deeb-3a1a-477f-ab1c-cd66a5fef930", "name": "network-vif-unplugged", "status": "completed", "tag": "4f655b24-a3d1-4d12-bfc2-6fee676ef485"}, {"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-unplugged", "status": "completed", "tag": "6ade7ded-bc94-401b-9a37-8c94c0fbf2c7"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:31.111622 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-98bdf71c-a09a-4b4d-88f8-6cd69b102748 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:31.113696 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-98bdf71c-a09a-4b4d-88f8-6cd69b102748 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:31.121718 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-8b023085-4711-4994-bb1d-a12938b785be req-783b8801-3915-48af-b3a7-d34d8c632948 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:31.123880 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-8b023085-4711-4994-bb1d-a12938b785be req-783b8801-3915-48af-b3a7-d34d8c632948 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:31.141880 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-8b023085-4711-4994-bb1d-a12938b785be req-783b8801-3915-48af-b3a7-d34d8c632948 service nova] Creating event network-vif-unplugged:4f655b24-a3d1-4d12-bfc2-6fee676ef485 for instance 7c11deeb-3a1a-477f-ab1c-cd66a5fef930 on n-h2-849104-4 Jul 12 12:03:31.142379 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-8b023085-4711-4994-bb1d-a12938b785be req-783b8801-3915-48af-b3a7-d34d8c632948 service nova] Creating event network-vif-unplugged:6ade7ded-bc94-401b-9a37-8c94c0fbf2c7 for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:03:31.153379 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-98bdf71c-a09a-4b4d-88f8-6cd69b102748 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:31.154189 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-98bdf71c-a09a-4b4d-88f8-6cd69b102748 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:31.155017 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-98bdf71c-a09a-4b4d-88f8-6cd69b102748 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:31.155856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-98bdf71c-a09a-4b4d-88f8-6cd69b102748 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:31.163427 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-8b023085-4711-4994-bb1d-a12938b785be req-783b8801-3915-48af-b3a7-d34d8c632948 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.077344 Jul 12 12:03:31.164780 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1622/3069] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:03:31.209176 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-98bdf71c-a09a-4b4d-88f8-6cd69b102748 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lazy-loading 'flavor' on Instance uuid 6ecb79d2-418a-40f3-bbd7-5075a19926a1 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:03:31.266272 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-05b2abf1-d92a-4444-9c79-9c8dbac6efe0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:31.266971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-05b2abf1-d92a-4444-9c79-9c8dbac6efe0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:31.285647 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05b2abf1-d92a-4444-9c79-9c8dbac6efe0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:31.286268 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05b2abf1-d92a-4444-9c79-9c8dbac6efe0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:31.287420 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05b2abf1-d92a-4444-9c79-9c8dbac6efe0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:31.288073 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-05b2abf1-d92a-4444-9c79-9c8dbac6efe0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:31.350130 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-98bdf71c-a09a-4b4d-88f8-6cd69b102748 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "POST /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1/action" status: 200 len: 32 microversion: 2.1 time: 0.244423 Jul 12 12:03:31.356859 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1448/3070] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Jul 12 12:03:31 2022] POST /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1/action => generated 32 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 12:03:31.372392 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-80ec9b87-f73f-4842-a326-a3e481950759 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:31.373106 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-80ec9b87-f73f-4842-a326-a3e481950759 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:31.394692 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80ec9b87-f73f-4842-a326-a3e481950759 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:31.395152 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80ec9b87-f73f-4842-a326-a3e481950759 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:31.395953 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80ec9b87-f73f-4842-a326-a3e481950759 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:31.396429 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-80ec9b87-f73f-4842-a326-a3e481950759 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:31.791252 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-05b2abf1-d92a-4444-9c79-9c8dbac6efe0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:31.800399 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-05b2abf1-d92a-4444-9c79-9c8dbac6efe0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:31.802741 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-05b2abf1-d92a-4444-9c79-9c8dbac6efe0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:31.814260 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-05b2abf1-d92a-4444-9c79-9c8dbac6efe0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1733 microversion: 2.25 time: 0.543160 Jul 12 12:03:31.816103 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1623/3071] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:31 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1733 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:03:31.822161 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3f593a4a-fdc4-4142-b83a-5c74e73190fc tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:31.823700 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3f593a4a-fdc4-4142-b83a-5c74e73190fc tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:31.834796 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f593a4a-fdc4-4142-b83a-5c74e73190fc tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:31.836437 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f593a4a-fdc4-4142-b83a-5c74e73190fc tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:31.837586 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f593a4a-fdc4-4142-b83a-5c74e73190fc tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:31.840951 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3f593a4a-fdc4-4142-b83a-5c74e73190fc tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:32.334939 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-80ec9b87-f73f-4842-a326-a3e481950759 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:32.354711 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-80ec9b87-f73f-4842-a326-a3e481950759 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:32.356395 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-80ec9b87-f73f-4842-a326-a3e481950759 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:32.358018 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-80ec9b87-f73f-4842-a326-a3e481950759 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 2582 microversion: 2.32 time: 0.999260 Jul 12 12:03:32.359193 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1449/3072] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:31 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 2582 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:32.364012 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-3fbee994-de18-4c21-9ecb-6fc1e3ae6aa4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:32.376959 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-3fbee994-de18-4c21-9ecb-6fc1e3ae6aa4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 3e62539f-e524-468c-9fda-8d0c665c6857] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:32.383483 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3fbee994-de18-4c21-9ecb-6fc1e3ae6aa4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:32.384206 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3fbee994-de18-4c21-9ecb-6fc1e3ae6aa4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:32.385217 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3fbee994-de18-4c21-9ecb-6fc1e3ae6aa4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:32.385825 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-3fbee994-de18-4c21-9ecb-6fc1e3ae6aa4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:32.926785 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3f593a4a-fdc4-4142-b83a-5c74e73190fc tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:32.941765 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3f593a4a-fdc4-4142-b83a-5c74e73190fc tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1523 microversion: 2.1 time: 1.124151 Jul 12 12:03:32.943360 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1624/3073] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:31 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1523 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:32.956144 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-feeaa873-c374-4bf8-a41c-f6363fd2d839 req-03612658-389a-4c0e-ba25-0370263ea6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c11deeb-3a1a-477f-ab1c-cd66a5fef930", "name": "network-vif-deleted", "tag": "4f655b24-a3d1-4d12-bfc2-6fee676ef485"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:32.967950 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-feeaa873-c374-4bf8-a41c-f6363fd2d839 req-03612658-389a-4c0e-ba25-0370263ea6b5 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:32.968932 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-feeaa873-c374-4bf8-a41c-f6363fd2d839 req-03612658-389a-4c0e-ba25-0370263ea6b5 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:32.990927 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-feeaa873-c374-4bf8-a41c-f6363fd2d839 req-03612658-389a-4c0e-ba25-0370263ea6b5 service nova] Creating event network-vif-deleted:4f655b24-a3d1-4d12-bfc2-6fee676ef485 for instance 7c11deeb-3a1a-477f-ab1c-cd66a5fef930 on n-h2-849104-4 Jul 12 12:03:32.997754 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-feeaa873-c374-4bf8-a41c-f6363fd2d839 req-03612658-389a-4c0e-ba25-0370263ea6b5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051638 Jul 12 12:03:32.998785 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1625/3074] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:33.019258 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-06fc59f1-cc7e-4b03-b763-51da8f097b22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:33.020232 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-06fc59f1-cc7e-4b03-b763-51da8f097b22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:33.027721 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-06fc59f1-cc7e-4b03-b763-51da8f097b22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:33.028522 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-06fc59f1-cc7e-4b03-b763-51da8f097b22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:33.029378 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-06fc59f1-cc7e-4b03-b763-51da8f097b22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:33.029935 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-06fc59f1-cc7e-4b03-b763-51da8f097b22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:33.098585 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-3fbee994-de18-4c21-9ecb-6fc1e3ae6aa4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:33.108010 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-3fbee994-de18-4c21-9ecb-6fc1e3ae6aa4 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857" status: 200 len: 1318 microversion: 2.1 time: 0.747484 Jul 12 12:03:33.109000 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1450/3075] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:32 2022] GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857 => generated 1318 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:33.389430 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-f210ae63-fdbb-4bb7-80e4-e26c5148e17a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:33.390177 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-f210ae63-fdbb-4bb7-80e4-e26c5148e17a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:33.393873 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:33.395342 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell0:SELECT=6 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:33.404449 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f210ae63-fdbb-4bb7-80e4-e26c5148e17a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:33.406036 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f210ae63-fdbb-4bb7-80e4-e26c5148e17a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:33.408217 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f210ae63-fdbb-4bb7-80e4-e26c5148e17a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:33.409055 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-f210ae63-fdbb-4bb7-80e4-e26c5148e17a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:33.481007 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-06fc59f1-cc7e-4b03-b763-51da8f097b22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:33.490199 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-06fc59f1-cc7e-4b03-b763-51da8f097b22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:33.491959 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-06fc59f1-cc7e-4b03-b763-51da8f097b22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:33.497344 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-06fc59f1-cc7e-4b03-b763-51da8f097b22 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1733 microversion: 2.25 time: 0.492603 Jul 12 12:03:33.498306 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1626/3076] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:32 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1733 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:33.965372 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-82c7dc24-3554-4cbc-9b1c-b37ff9fa4c8e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:33.967865 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-82c7dc24-3554-4cbc-9b1c-b37ff9fa4c8e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:33.979357 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-82c7dc24-3554-4cbc-9b1c-b37ff9fa4c8e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:33.980745 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-82c7dc24-3554-4cbc-9b1c-b37ff9fa4c8e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:33.982535 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-82c7dc24-3554-4cbc-9b1c-b37ff9fa4c8e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:33.984069 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-82c7dc24-3554-4cbc-9b1c-b37ff9fa4c8e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:34.373468 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-82c7dc24-3554-4cbc-9b1c-b37ff9fa4c8e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:34.386660 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-82c7dc24-3554-4cbc-9b1c-b37ff9fa4c8e tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1523 microversion: 2.1 time: 0.428319 Jul 12 12:03:34.392983 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1627/3077] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:33 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1523 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:34.407928 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-9ae31550-03e9-4dac-a3e8-9ebebfbb556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:34.408608 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-9ae31550-03e9-4dac-a3e8-9ebebfbb556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 3e62539f-e524-468c-9fda-8d0c665c6857] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:34.429801 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9ae31550-03e9-4dac-a3e8-9ebebfbb556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:34.430541 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9ae31550-03e9-4dac-a3e8-9ebebfbb556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:34.436226 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9ae31550-03e9-4dac-a3e8-9ebebfbb556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:34.439008 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-9ae31550-03e9-4dac-a3e8-9ebebfbb556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:34.565928 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f210ae63-fdbb-4bb7-80e4-e26c5148e17a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:34.578860 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f210ae63-fdbb-4bb7-80e4-e26c5148e17a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:34.580579 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-f210ae63-fdbb-4bb7-80e4-e26c5148e17a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:34.581878 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-f210ae63-fdbb-4bb7-80e4-e26c5148e17a tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 2535 microversion: 2.32 time: 1.203978 Jul 12 12:03:34.591558 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1451/3078] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:33 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 2535 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:34.605739 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-098c32fd-f95f-41cf-803a-091adc79f322 req-3f330295-bb3e-4345-b16a-b78e086ca0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb8c998f-98d6-43d7-a11a-b0a648cccae1", "tag": "66c28bf3-b6db-4656-976e-ce75e0bd3288"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:34.628932 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-098c32fd-f95f-41cf-803a-091adc79f322 req-3f330295-bb3e-4345-b16a-b78e086ca0f1 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:34.629682 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-098c32fd-f95f-41cf-803a-091adc79f322 req-3f330295-bb3e-4345-b16a-b78e086ca0f1 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:34.641970 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-098c32fd-f95f-41cf-803a-091adc79f322 req-3f330295-bb3e-4345-b16a-b78e086ca0f1 service nova] Creating event network-changed:66c28bf3-b6db-4656-976e-ce75e0bd3288 for instance eb8c998f-98d6-43d7-a11a-b0a648cccae1 on n-h1-849104-4 Jul 12 12:03:34.665887 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-098c32fd-f95f-41cf-803a-091adc79f322 req-3f330295-bb3e-4345-b16a-b78e086ca0f1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072816 Jul 12 12:03:34.667402 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1452/3079] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:34.672875 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-053a3981-acdd-4f93-a049-a5947131e76b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:34.673817 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-053a3981-acdd-4f93-a049-a5947131e76b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:34.688187 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-053a3981-acdd-4f93-a049-a5947131e76b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:34.689850 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-053a3981-acdd-4f93-a049-a5947131e76b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:34.690856 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-053a3981-acdd-4f93-a049-a5947131e76b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:34.691664 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-053a3981-acdd-4f93-a049-a5947131e76b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:34.890849 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-053a3981-acdd-4f93-a049-a5947131e76b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:34.899595 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-053a3981-acdd-4f93-a049-a5947131e76b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:34.908326 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-053a3981-acdd-4f93-a049-a5947131e76b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:34.909910 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-053a3981-acdd-4f93-a049-a5947131e76b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1665 microversion: 2.25 time: 0.241188 Jul 12 12:03:34.911997 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1453/3080] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:34 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1665 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:35.088822 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell0:SELECT=2 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:35.113023 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-89befaf4-0cbb-4157-a457-4cea51eba5ff req-35ff0e6f-72c3-4d04-b61d-acb769967d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-deleted", "tag": "7735c15f-29a4-4440-9e1b-3a9b16dafddb"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:35.126114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-89befaf4-0cbb-4157-a457-4cea51eba5ff req-35ff0e6f-72c3-4d04-b61d-acb769967d21 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:35.126571 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-89befaf4-0cbb-4157-a457-4cea51eba5ff req-35ff0e6f-72c3-4d04-b61d-acb769967d21 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:35.159203 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-9ae31550-03e9-4dac-a3e8-9ebebfbb556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:35.159657 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-89befaf4-0cbb-4157-a457-4cea51eba5ff req-35ff0e6f-72c3-4d04-b61d-acb769967d21 service nova] Creating event network-vif-deleted:7735c15f-29a4-4440-9e1b-3a9b16dafddb for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:03:35.171072 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-9ae31550-03e9-4dac-a3e8-9ebebfbb556f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857" status: 200 len: 1318 microversion: 2.1 time: 0.774593 Jul 12 12:03:35.172944 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1628/3081] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:34 2022] GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857 => generated 1318 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:35.180067 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-89befaf4-0cbb-4157-a457-4cea51eba5ff req-35ff0e6f-72c3-4d04-b61d-acb769967d21 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065575 Jul 12 12:03:35.182551 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1454/3082] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:03:35.405204 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e13e4378-52b1-4f0b-b630-32ab23cac858 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:35.405835 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e13e4378-52b1-4f0b-b630-32ab23cac858 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:35.413055 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e13e4378-52b1-4f0b-b630-32ab23cac858 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:35.413516 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e13e4378-52b1-4f0b-b630-32ab23cac858 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:35.414313 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e13e4378-52b1-4f0b-b630-32ab23cac858 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:35.414759 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e13e4378-52b1-4f0b-b630-32ab23cac858 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:35.612168 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-11b2c1ab-4497-4ce3-b4f0-1529d1789b4c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:35.613605 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-11b2c1ab-4497-4ce3-b4f0-1529d1789b4c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:35.639717 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11b2c1ab-4497-4ce3-b4f0-1529d1789b4c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:35.640517 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11b2c1ab-4497-4ce3-b4f0-1529d1789b4c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:35.641646 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11b2c1ab-4497-4ce3-b4f0-1529d1789b4c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:35.642336 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-11b2c1ab-4497-4ce3-b4f0-1529d1789b4c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:36.202858 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-11b2c1ab-4497-4ce3-b4f0-1529d1789b4c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:36.220749 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-11b2c1ab-4497-4ce3-b4f0-1529d1789b4c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:36.222255 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-11b2c1ab-4497-4ce3-b4f0-1529d1789b4c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:36.235723 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-11b2c1ab-4497-4ce3-b4f0-1529d1789b4c tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 2374 microversion: 2.32 time: 0.628068 Jul 12 12:03:36.237026 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1455/3083] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:35 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 2374 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:36.258921 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-c9b87d49-2c8b-4b78-901b-edea3882eec9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:36.259876 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-c9b87d49-2c8b-4b78-901b-edea3882eec9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:36.271313 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c9b87d49-2c8b-4b78-901b-edea3882eec9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:36.273338 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c9b87d49-2c8b-4b78-901b-edea3882eec9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:36.274406 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c9b87d49-2c8b-4b78-901b-edea3882eec9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:36.275165 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c9b87d49-2c8b-4b78-901b-edea3882eec9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:36.282199 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:36.324484 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c9b87d49-2c8b-4b78-901b-edea3882eec9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:36.324945 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-c9b87d49-2c8b-4b78-901b-edea3882eec9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:36.325414 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.objects.instance [None req-c9b87d49-2c8b-4b78-901b-edea3882eec9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lazy-loading 'fault' on Instance uuid b26b640d-3b19-492b-99f2-4c0cb3c10c25 {{(pid=125983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 12:03:36.551529 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c9b87d49-2c8b-4b78-901b-edea3882eec9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:36.566921 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c9b87d49-2c8b-4b78-901b-edea3882eec9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:36.593886 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-c9b87d49-2c8b-4b78-901b-edea3882eec9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:36.598540 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-c9b87d49-2c8b-4b78-901b-edea3882eec9 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 200 len: 1376 microversion: 2.25 time: 0.359655 Jul 12 12:03:36.602332 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1456/3084] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:36 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 1376 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:36.610918 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-0d17ddfd-38d6-462d-9c22-92a81ea664ee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:36.617403 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-0d17ddfd-38d6-462d-9c22-92a81ea664ee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 3e62539f-e524-468c-9fda-8d0c665c6857] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:36.641873 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0d17ddfd-38d6-462d-9c22-92a81ea664ee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:36.642595 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0d17ddfd-38d6-462d-9c22-92a81ea664ee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:36.643891 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0d17ddfd-38d6-462d-9c22-92a81ea664ee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:36.644470 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-0d17ddfd-38d6-462d-9c22-92a81ea664ee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:36.688992 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e13e4378-52b1-4f0b-b630-32ab23cac858 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:36.731333 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e13e4378-52b1-4f0b-b630-32ab23cac858 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1523 microversion: 2.1 time: 1.319243 Jul 12 12:03:36.745827 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1629/3085] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:35 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1523 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:37.257231 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-fa182739-a8f6-492e-a95c-266461348a56 req-05576dbb-0691-4264-96bf-519915ee03a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-deleted", "tag": "6e06bf3e-6215-4546-a454-04123539ab53"}, {"server_uuid": "b26b640d-3b19-492b-99f2-4c0cb3c10c25", "name": "network-vif-deleted", "tag": "fefc048a-c90e-4ca6-908e-d9728a5304fa"}, {"name": "network-changed", "server_uuid": "3e62539f-e524-468c-9fda-8d0c665c6857", "tag": "22e5c932-7cea-463d-ac7a-a1d6f70a675c"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:37.279416 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-fa182739-a8f6-492e-a95c-266461348a56 req-05576dbb-0691-4264-96bf-519915ee03a2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:37.282803 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-fa182739-a8f6-492e-a95c-266461348a56 req-05576dbb-0691-4264-96bf-519915ee03a2 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:37.306433 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-0d17ddfd-38d6-462d-9c22-92a81ea664ee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:37.319615 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-0d17ddfd-38d6-462d-9c22-92a81ea664ee tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857" status: 200 len: 1318 microversion: 2.1 time: 0.715681 Jul 12 12:03:37.322216 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1457/3086] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:36 2022] GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857 => generated 1318 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:37.336582 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-65f03e93-7480-454a-a409-6aa77ec8445b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:37.337509 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-65f03e93-7480-454a-a409-6aa77ec8445b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:37.351034 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-fa182739-a8f6-492e-a95c-266461348a56 req-05576dbb-0691-4264-96bf-519915ee03a2 service nova] Creating event network-vif-deleted:6e06bf3e-6215-4546-a454-04123539ab53 for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:03:37.354959 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-fa182739-a8f6-492e-a95c-266461348a56 req-05576dbb-0691-4264-96bf-519915ee03a2 service nova] Creating event network-vif-deleted:fefc048a-c90e-4ca6-908e-d9728a5304fa for instance b26b640d-3b19-492b-99f2-4c0cb3c10c25 on n-h1-849104-4 Jul 12 12:03:37.357465 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-fa182739-a8f6-492e-a95c-266461348a56 req-05576dbb-0691-4264-96bf-519915ee03a2 service nova] Creating event network-changed:22e5c932-7cea-463d-ac7a-a1d6f70a675c for instance 3e62539f-e524-468c-9fda-8d0c665c6857 on n-h2-849104-4 Jul 12 12:03:37.363656 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-65f03e93-7480-454a-a409-6aa77ec8445b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:37.364448 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-65f03e93-7480-454a-a409-6aa77ec8445b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:37.370468 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-65f03e93-7480-454a-a409-6aa77ec8445b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:37.371889 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-65f03e93-7480-454a-a409-6aa77ec8445b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:37.425608 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-fa182739-a8f6-492e-a95c-266461348a56 req-05576dbb-0691-4264-96bf-519915ee03a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.179707 Jul 12 12:03:37.430114 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1630/3087] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:37.627984 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3ab77738-f7b2-4087-a516-9a1e6a9992f6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:37.631365 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3ab77738-f7b2-4087-a516-9a1e6a9992f6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: b26b640d-3b19-492b-99f2-4c0cb3c10c25] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:37.647818 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3ab77738-f7b2-4087-a516-9a1e6a9992f6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:37.653563 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3ab77738-f7b2-4087-a516-9a1e6a9992f6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:37.656559 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3ab77738-f7b2-4087-a516-9a1e6a9992f6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:37.658125 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3ab77738-f7b2-4087-a516-9a1e6a9992f6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:37.705538 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-3ab77738-f7b2-4087-a516-9a1e6a9992f6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] HTTP exception thrown: Instance b26b640d-3b19-492b-99f2-4c0cb3c10c25 could not be found. Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3ab77738-f7b2-4087-a516-9a1e6a9992f6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Request method failure captured: Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 HTTP/1.1 Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWFEvGfQx2AgQ1Q_xSN12VYOc87SJAobrSGC55wg6DNAlBq3T4JtAZHH7iMQUR5lXvNzUSLeW97ubm6Zawq8ttB1_9M7ERq4ah2f-MKVVBt8xcOmQ4buDwnw7krbAqiOgGS9th_sXssvhn0yEsvALx7nhk5EsQhD1urO6k39VQDmN_U Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Openstack-Nova-Api-Version: 2.25 Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 29fd5f6c853549a794c75ebff736ccf4 Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2112324554 Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/29fd5f6c853549a794c75ebff736ccf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/29fd5f6c853549a794c75ebff736ccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/29fd5f6c853549a794c75ebff736ccf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_29fd5f6c853549a794c75ebff736ccf4", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2112324554 Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 29fd5f6c853549a794c75ebff736ccf4 Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2112324554 Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-LiveAutoBlockMigrationV225Test-2112324554-project Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: ae0b32f84b7146d49338e7a2c06bc579 Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2112324554-project Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance b26b640d-3b19-492b-99f2-4c0cb3c10c25 could not be found. Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': 'b26b640d-3b19-492b-99f2-4c0cb3c10c25'} Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b26b640d-3b19-492b-99f2-4c0cb3c10c25 could not be found. Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b26b640d-3b19-492b-99f2-4c0cb3c10c25 could not be found. Jul 12 12:03:37.708463 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:37.713398 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:37.713398 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:37.713398 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:37.713398 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:03:37.713398 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:03:37.713398 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:03:37.713398 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:03:37.713398 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b26b640d-3b19-492b-99f2-4c0cb3c10c25 could not be found. Jul 12 12:03:37.713398 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:37.715825 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3ab77738-f7b2-4087-a516-9a1e6a9992f6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Returning 404 to user: Instance b26b640d-3b19-492b-99f2-4c0cb3c10c25 could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:03:37.717946 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3ab77738-f7b2-4087-a516-9a1e6a9992f6 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25" status: 404 len: 111 microversion: 2.25 time: 0.099697 Jul 12 12:03:37.718541 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1631/3088] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:37 2022] GET /compute/v2.1/servers/b26b640d-3b19-492b-99f2-4c0cb3c10c25 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 12:03:37.735250 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ec87d2a6-25a8-4883-8caa-6bac897c3faa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '.version_select at 0x7f5e08fee4c0>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:37.773186 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ec87d2a6-25a8-4883-8caa-6bac897c3faa tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1580805149" status: 204 len: 0 microversion: 2.25 time: 0.050119 Jul 12 12:03:37.784605 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1632/3089] 10.222.0.50 () {60 vars in 1261 bytes} [Tue Jul 12 12:03:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1580805149 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 12 12:03:37.813152 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-f613f970-9ab7-455b-b0e5-be16e0d6f150 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:37.819043 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-f613f970-9ab7-455b-b0e5-be16e0d6f150 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:37.860837 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f613f970-9ab7-455b-b0e5-be16e0d6f150 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:37.861669 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f613f970-9ab7-455b-b0e5-be16e0d6f150 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:37.862664 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f613f970-9ab7-455b-b0e5-be16e0d6f150 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:37.863187 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-f613f970-9ab7-455b-b0e5-be16e0d6f150 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:38.011605 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-65f03e93-7480-454a-a409-6aa77ec8445b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:38.021380 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-65f03e93-7480-454a-a409-6aa77ec8445b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:38.023114 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-65f03e93-7480-454a-a409-6aa77ec8445b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:38.025090 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-65f03e93-7480-454a-a409-6aa77ec8445b tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 2374 microversion: 2.32 time: 0.701302 Jul 12 12:03:38.026558 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1458/3090] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:37 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 2374 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:38.339387 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-9016b223-579a-47cc-b0d1-b89faa5247a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:38.340687 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-9016b223-579a-47cc-b0d1-b89faa5247a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 3e62539f-e524-468c-9fda-8d0c665c6857] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:38.349639 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9016b223-579a-47cc-b0d1-b89faa5247a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:38.350227 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9016b223-579a-47cc-b0d1-b89faa5247a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:38.354960 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9016b223-579a-47cc-b0d1-b89faa5247a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:38.358814 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-9016b223-579a-47cc-b0d1-b89faa5247a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:38.526247 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-f613f970-9ab7-455b-b0e5-be16e0d6f150 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:38.536002 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-f613f970-9ab7-455b-b0e5-be16e0d6f150 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1523 microversion: 2.1 time: 0.747977 Jul 12 12:03:38.536827 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1633/3091] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:37 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1523 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:38.827354 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-9016b223-579a-47cc-b0d1-b89faa5247a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:38.849464 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-9016b223-579a-47cc-b0d1-b89faa5247a5 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857" status: 200 len: 1318 microversion: 2.1 time: 0.515409 Jul 12 12:03:38.850679 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1459/3092] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:38 2022] GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857 => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:03:39.047975 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-de7ddf46-62cf-423a-a691-4372d8ba0ab4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:39.050778 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-de7ddf46-62cf-423a-a691-4372d8ba0ab4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:39.063749 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de7ddf46-62cf-423a-a691-4372d8ba0ab4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:39.063749 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de7ddf46-62cf-423a-a691-4372d8ba0ab4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:39.065183 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de7ddf46-62cf-423a-a691-4372d8ba0ab4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:39.065736 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-de7ddf46-62cf-423a-a691-4372d8ba0ab4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:39.191955 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-de7ddf46-62cf-423a-a691-4372d8ba0ab4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:39.217948 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-de7ddf46-62cf-423a-a691-4372d8ba0ab4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:39.220310 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-de7ddf46-62cf-423a-a691-4372d8ba0ab4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:39.222363 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-de7ddf46-62cf-423a-a691-4372d8ba0ab4 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 2145 microversion: 2.32 time: 0.178826 Jul 12 12:03:39.236231 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1634/3093] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:39 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 2145 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:39.459039 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-7f893d1b-4406-4425-8538-8f16093d0fbf req-de99d8d0-5b91-4c43-bbe0-61ef0ff319ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-deleted", "tag": "4b024111-c5ba-43ca-a440-579a6738d07e"}, {"server_uuid": "759bc134-5cce-4b40-a746-fe444a128444", "name": "network-vif-deleted", "tag": "6ade7ded-bc94-401b-9a37-8c94c0fbf2c7"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:39.483421 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-7f893d1b-4406-4425-8538-8f16093d0fbf req-de99d8d0-5b91-4c43-bbe0-61ef0ff319ca service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:39.483866 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-7f893d1b-4406-4425-8538-8f16093d0fbf req-de99d8d0-5b91-4c43-bbe0-61ef0ff319ca service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:39.550081 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-7f893d1b-4406-4425-8538-8f16093d0fbf req-de99d8d0-5b91-4c43-bbe0-61ef0ff319ca service nova] Creating event network-vif-deleted:4b024111-c5ba-43ca-a440-579a6738d07e for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:03:39.550811 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-7f893d1b-4406-4425-8538-8f16093d0fbf req-de99d8d0-5b91-4c43-bbe0-61ef0ff319ca service nova] Creating event network-vif-deleted:6ade7ded-bc94-401b-9a37-8c94c0fbf2c7 for instance 759bc134-5cce-4b40-a746-fe444a128444 on n-h1-849104-4 Jul 12 12:03:39.559461 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3452a97c-d484-4d22-9251-8d9514428257 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:39.562509 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3452a97c-d484-4d22-9251-8d9514428257 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:39.569198 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-7f893d1b-4406-4425-8538-8f16093d0fbf req-de99d8d0-5b91-4c43-bbe0-61ef0ff319ca service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113250 Jul 12 12:03:39.576350 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1460/3094] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:39.593778 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3452a97c-d484-4d22-9251-8d9514428257 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:39.597771 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3452a97c-d484-4d22-9251-8d9514428257 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:39.599775 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3452a97c-d484-4d22-9251-8d9514428257 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:39.600567 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3452a97c-d484-4d22-9251-8d9514428257 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:39.651952 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_cell1:SELECT=100 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:39.871106 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-40c4399e-810b-4152-a941-d3180530d1bf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:39.872269 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-40c4399e-810b-4152-a941-d3180530d1bf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 3e62539f-e524-468c-9fda-8d0c665c6857] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:39.886053 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-40c4399e-810b-4152-a941-d3180530d1bf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:39.888796 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-40c4399e-810b-4152-a941-d3180530d1bf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:39.889879 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-40c4399e-810b-4152-a941-d3180530d1bf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:39.891791 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-40c4399e-810b-4152-a941-d3180530d1bf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:39.941971 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3452a97c-d484-4d22-9251-8d9514428257 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:39.958953 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3452a97c-d484-4d22-9251-8d9514428257 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1523 microversion: 2.1 time: 0.406600 Jul 12 12:03:39.964997 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1635/3095] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:39 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:40.244895 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-ef40fbf4-0d2f-45cf-93eb-bfce7d8f8f5d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:40.248465 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-ef40fbf4-0d2f-45cf-93eb-bfce7d8f8f5d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:40.267002 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ef40fbf4-0d2f-45cf-93eb-bfce7d8f8f5d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:40.269881 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ef40fbf4-0d2f-45cf-93eb-bfce7d8f8f5d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:40.271042 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ef40fbf4-0d2f-45cf-93eb-bfce7d8f8f5d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:40.274003 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-ef40fbf4-0d2f-45cf-93eb-bfce7d8f8f5d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:40.428190 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ef40fbf4-0d2f-45cf-93eb-bfce7d8f8f5d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:40.444119 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ef40fbf4-0d2f-45cf-93eb-bfce7d8f8f5d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:40.445754 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-ef40fbf4-0d2f-45cf-93eb-bfce7d8f8f5d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:40.447029 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-ef40fbf4-0d2f-45cf-93eb-bfce7d8f8f5d tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1605 microversion: 2.32 time: 0.208388 Jul 12 12:03:40.454046 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1636/3096] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:40 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1605 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:40.497771 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-40c4399e-810b-4152-a941-d3180530d1bf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:40.510079 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-40c4399e-810b-4152-a941-d3180530d1bf tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857" status: 200 len: 1318 microversion: 2.1 time: 0.645026 Jul 12 12:03:40.510977 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1461/3097] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:39 2022] GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857 => generated 1318 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:40.787287 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-7d903a6d-b363-4f48-8241-49674a5eb7f5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:40.787801 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7d903a6d-b363-4f48-8241-49674a5eb7f5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:40.804107 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d903a6d-b363-4f48-8241-49674a5eb7f5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:40.804568 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d903a6d-b363-4f48-8241-49674a5eb7f5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:40.805359 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d903a6d-b363-4f48-8241-49674a5eb7f5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:40.805800 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-7d903a6d-b363-4f48-8241-49674a5eb7f5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:40.849973 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-7d903a6d-b363-4f48-8241-49674a5eb7f5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Going to try to terminate instance {{(pid=125984) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:03:40.961302 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-7d903a6d-b363-4f48-8241-49674a5eb7f5 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 204 len: 0 microversion: 2.25 time: 0.177214 Jul 12 12:03:40.963555 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1637/3098] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 12:03:40 2022] DELETE /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 12:03:40.974489 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-d8cc0035-e674-45ea-8039-e68160e396de tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:40.975123 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-d8cc0035-e674-45ea-8039-e68160e396de tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:40.998736 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d8cc0035-e674-45ea-8039-e68160e396de tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:40.999277 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d8cc0035-e674-45ea-8039-e68160e396de tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:41.000612 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-974c9805-b783-41a0-9237-69820bc5c24c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:41.001834 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d8cc0035-e674-45ea-8039-e68160e396de tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:41.002625 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-974c9805-b783-41a0-9237-69820bc5c24c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:41.003271 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-d8cc0035-e674-45ea-8039-e68160e396de tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:41.026815 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-974c9805-b783-41a0-9237-69820bc5c24c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:41.032007 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-974c9805-b783-41a0-9237-69820bc5c24c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:41.033433 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-974c9805-b783-41a0-9237-69820bc5c24c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:41.034537 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-974c9805-b783-41a0-9237-69820bc5c24c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:41.535281 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-974c9805-b783-41a0-9237-69820bc5c24c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:41.548077 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-974c9805-b783-41a0-9237-69820bc5c24c tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1523 microversion: 2.1 time: 0.564835 Jul 12 12:03:41.548836 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1638/3099] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:40 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1523 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:41.561552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-6ed82034-59d9-47f7-b1d8-bac5639c9039 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:41.563027 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-6ed82034-59d9-47f7-b1d8-bac5639c9039 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:41.575604 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ed82034-59d9-47f7-b1d8-bac5639c9039 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:41.577972 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ed82034-59d9-47f7-b1d8-bac5639c9039 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:41.581307 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ed82034-59d9-47f7-b1d8-bac5639c9039 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:41.581982 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-6ed82034-59d9-47f7-b1d8-bac5639c9039 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:41.606437 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d8cc0035-e674-45ea-8039-e68160e396de tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:41.617505 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d8cc0035-e674-45ea-8039-e68160e396de tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:41.620089 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-d8cc0035-e674-45ea-8039-e68160e396de tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:41.631580 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-d8cc0035-e674-45ea-8039-e68160e396de tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1549 microversion: 2.25 time: 0.663295 Jul 12 12:03:41.644303 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1462/3100] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:40 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1549 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:41.651222 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-ecd7d0e9-18ff-4203-8286-788bcfcf9c6f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:41.655685 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-ecd7d0e9-18ff-4203-8286-788bcfcf9c6f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 3e62539f-e524-468c-9fda-8d0c665c6857] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:41.675733 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ecd7d0e9-18ff-4203-8286-788bcfcf9c6f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:41.676730 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ecd7d0e9-18ff-4203-8286-788bcfcf9c6f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:41.677831 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ecd7d0e9-18ff-4203-8286-788bcfcf9c6f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:41.678444 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-ecd7d0e9-18ff-4203-8286-788bcfcf9c6f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:41.833168 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6ed82034-59d9-47f7-b1d8-bac5639c9039 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:41.848299 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6ed82034-59d9-47f7-b1d8-bac5639c9039 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:41.855966 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-6ed82034-59d9-47f7-b1d8-bac5639c9039 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:41.858797 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-6ed82034-59d9-47f7-b1d8-bac5639c9039 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1605 microversion: 2.32 time: 0.306101 Jul 12 12:03:41.859675 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1639/3101] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:41 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1605 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:42.310786 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-ecd7d0e9-18ff-4203-8286-788bcfcf9c6f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:42.325648 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-ecd7d0e9-18ff-4203-8286-788bcfcf9c6f tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857" status: 200 len: 1318 microversion: 2.1 time: 0.686763 Jul 12 12:03:42.326349 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1463/3102] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:41 2022] GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857 => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:42.568812 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-e4fba53f-bbe9-40a9-aa36-a502abe3eed7 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:42.569540 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-e4fba53f-bbe9-40a9-aa36-a502abe3eed7 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:42.582814 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e4fba53f-bbe9-40a9-aa36-a502abe3eed7 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:42.583306 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e4fba53f-bbe9-40a9-aa36-a502abe3eed7 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:42.592112 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e4fba53f-bbe9-40a9-aa36-a502abe3eed7 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:42.592642 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-e4fba53f-bbe9-40a9-aa36-a502abe3eed7 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:42.657384 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e46c87b9-5a67-40f5-aced-ccf632301c0b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:42.658007 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e46c87b9-5a67-40f5-aced-ccf632301c0b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:42.673572 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e46c87b9-5a67-40f5-aced-ccf632301c0b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:42.675126 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e46c87b9-5a67-40f5-aced-ccf632301c0b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:42.676062 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e46c87b9-5a67-40f5-aced-ccf632301c0b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:42.676518 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e46c87b9-5a67-40f5-aced-ccf632301c0b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:43.106470 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e46c87b9-5a67-40f5-aced-ccf632301c0b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:43.124380 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e46c87b9-5a67-40f5-aced-ccf632301c0b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:43.129190 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e46c87b9-5a67-40f5-aced-ccf632301c0b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:43.130426 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e46c87b9-5a67-40f5-aced-ccf632301c0b tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 200 len: 1549 microversion: 2.25 time: 0.477543 Jul 12 12:03:43.138680 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1464/3103] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:42 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 1549 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:43.165767 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-6bcee461-17ca-4bb9-863c-77ed69f9a4db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:43.167072 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-6bcee461-17ca-4bb9-863c-77ed69f9a4db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:43.188000 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6bcee461-17ca-4bb9-863c-77ed69f9a4db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:43.188529 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6bcee461-17ca-4bb9-863c-77ed69f9a4db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:43.189322 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6bcee461-17ca-4bb9-863c-77ed69f9a4db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:43.189765 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-6bcee461-17ca-4bb9-863c-77ed69f9a4db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:43.472593 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6bcee461-17ca-4bb9-863c-77ed69f9a4db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:43.491309 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6bcee461-17ca-4bb9-863c-77ed69f9a4db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:43.507113 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-6bcee461-17ca-4bb9-863c-77ed69f9a4db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:43.510997 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-6bcee461-17ca-4bb9-863c-77ed69f9a4db tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1605 microversion: 2.32 time: 0.369260 Jul 12 12:03:43.511854 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1465/3104] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:43 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1605 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:43.537917 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-9e3fa5cb-6e30-478a-8e9a-4937fe43d928 req-3b3eceaf-c1d7-42ce-8c0b-7381d2e47cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5836cf59-e6e4-4504-953a-733dead8acde", "name": "network-vif-deleted", "tag": "9d1c95ba-995c-41c8-92ae-3e0b94344536"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:43.562829 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-9e3fa5cb-6e30-478a-8e9a-4937fe43d928 req-3b3eceaf-c1d7-42ce-8c0b-7381d2e47cf8 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:43.563694 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-9e3fa5cb-6e30-478a-8e9a-4937fe43d928 req-3b3eceaf-c1d7-42ce-8c0b-7381d2e47cf8 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:43.593160 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-9e3fa5cb-6e30-478a-8e9a-4937fe43d928 req-3b3eceaf-c1d7-42ce-8c0b-7381d2e47cf8 service nova] Creating event network-vif-deleted:9d1c95ba-995c-41c8-92ae-3e0b94344536 for instance 5836cf59-e6e4-4504-953a-733dead8acde on n-h2-849104-4 Jul 12 12:03:43.604568 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-9e3fa5cb-6e30-478a-8e9a-4937fe43d928 req-3b3eceaf-c1d7-42ce-8c0b-7381d2e47cf8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090695 Jul 12 12:03:43.607929 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1466/3105] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:03:43.624355 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-b1483700-e31a-4141-b822-764af1bdb70e tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:43.630448 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-b1483700-e31a-4141-b822-764af1bdb70e tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 3e62539f-e524-468c-9fda-8d0c665c6857] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:43.646107 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b1483700-e31a-4141-b822-764af1bdb70e tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:43.652791 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b1483700-e31a-4141-b822-764af1bdb70e tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:43.654143 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b1483700-e31a-4141-b822-764af1bdb70e tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:43.655318 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-b1483700-e31a-4141-b822-764af1bdb70e tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:43.877362 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-e4fba53f-bbe9-40a9-aa36-a502abe3eed7 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:43.899443 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-e4fba53f-bbe9-40a9-aa36-a502abe3eed7 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1523 microversion: 2.1 time: 1.330219 Jul 12 12:03:43.914336 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1640/3106] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:42 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1523 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:44.001104 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-b1483700-e31a-4141-b822-764af1bdb70e tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:44.021707 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-b1483700-e31a-4141-b822-764af1bdb70e tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857" status: 200 len: 1318 microversion: 2.1 time: 0.407803 Jul 12 12:03:44.026742 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1467/3107] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:43 2022] GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:44.157478 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-738d0580-280a-450d-8a2f-3ef7a0674ab1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:44.158442 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-738d0580-280a-450d-8a2f-3ef7a0674ab1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: 5836cf59-e6e4-4504-953a-733dead8acde] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:44.160852 n-d-849104-4 devstack@n-api.service[125984]: DEBUG dbcounter [-] [125984] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:44.194936 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-738d0580-280a-450d-8a2f-3ef7a0674ab1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:44.196957 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-738d0580-280a-450d-8a2f-3ef7a0674ab1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:44.199937 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-738d0580-280a-450d-8a2f-3ef7a0674ab1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:44.200853 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-738d0580-280a-450d-8a2f-3ef7a0674ab1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:44.241040 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.wsgi [None req-738d0580-280a-450d-8a2f-3ef7a0674ab1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] HTTP exception thrown: Instance 5836cf59-e6e4-4504-953a-733dead8acde could not be found. Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-738d0580-280a-450d-8a2f-3ef7a0674ab1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Request method failure captured: Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: request: GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde HTTP/1.1 Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: Accept: application/json Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: Accept-Encoding: identity Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: Connection: close Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: Content-Length: 0 Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: Content-Type: application/json Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: Host: 10.222.0.50 Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: Openstack-System-Scope: None Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: User-Agent: python-urllib3/1.26.9 Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Auth-Token: gAAAAABizWFEvGfQx2AgQ1Q_xSN12VYOc87SJAobrSGC55wg6DNAlBq3T4JtAZHH7iMQUR5lXvNzUSLeW97ubm6Zawq8ttB1_9M7ERq4ah2f-MKVVBt8xcOmQ4buDwnw7krbAqiOgGS9th_sXssvhn0yEsvALx7nhk5EsQhD1urO6k39VQDmN_U Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Id: None Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Domain-Name: None Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Identity-Status: Confirmed Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Is-Admin-Project: True Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Openstack-Nova-Api-Version: 2.25 Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Id: default Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Domain-Name: Default Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Id: 29fd5f6c853549a794c75ebff736ccf4 Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2112324554 Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Role: reader,member Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Roles: reader,member Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/29fd5f6c853549a794c75ebff736ccf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/29fd5f6c853549a794c75ebff736ccf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/29fd5f6c853549a794c75ebff736ccf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_29fd5f6c853549a794c75ebff736ccf4", "adminURL": "http://10.222.0.50:8080"}]}] Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2112324554 Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Id: 29fd5f6c853549a794c75ebff736ccf4 Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2112324554 Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-User: tempest-LiveAutoBlockMigrationV225Test-2112324554-project Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Id: default Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-User-Domain-Name: Default Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-User-Id: ae0b32f84b7146d49338e7a2c06bc579 Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2112324554-project Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: method: > Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: exception: Instance 5836cf59-e6e4-4504-953a-733dead8acde could not be found. Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: action_args: {'id': '5836cf59-e6e4-4504-953a-733dead8acde'} Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5836cf59-e6e4-4504-953a-733dead8acde could not be found. Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5836cf59-e6e4-4504-953a-733dead8acde could not be found. Jul 12 12:03:44.242751 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:44.247024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 12:03:44.247024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:44.247024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 12:03:44.247024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 12:03:44.247024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 12:03:44.247024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 12:03:44.247024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 12:03:44.247024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5836cf59-e6e4-4504-953a-733dead8acde could not be found. Jul 12 12:03:44.247024 n-d-849104-4 devstack@n-api.service[125984]: ERROR nova.api.openstack.wsgi Jul 12 12:03:44.247024 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-738d0580-280a-450d-8a2f-3ef7a0674ab1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Returning 404 to user: Instance 5836cf59-e6e4-4504-953a-733dead8acde could not be found. {{(pid=125984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 12:03:44.247727 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-738d0580-280a-450d-8a2f-3ef7a0674ab1 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde" status: 404 len: 111 microversion: 2.25 time: 0.091990 Jul 12 12:03:44.250804 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1641/3108] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:44 2022] GET /compute/v2.1/servers/5836cf59-e6e4-4504-953a-733dead8acde => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 12:03:44.259675 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-a10050fe-cb10-4c59-8b3b-af56e8b288a0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:44.260409 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a10050fe-cb10-4c59-8b3b-af56e8b288a0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:44.269237 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a10050fe-cb10-4c59-8b3b-af56e8b288a0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:44.271294 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a10050fe-cb10-4c59-8b3b-af56e8b288a0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:44.272920 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a10050fe-cb10-4c59-8b3b-af56e8b288a0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:44.273682 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-a10050fe-cb10-4c59-8b3b-af56e8b288a0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:44.344747 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-a10050fe-cb10-4c59-8b3b-af56e8b288a0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Going to try to terminate instance {{(pid=125983) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 12:03:44.530785 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-3b40464d-b345-4191-8f09-85dea6e3d2d9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:44.531712 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-3b40464d-b345-4191-8f09-85dea6e3d2d9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] [instance: 759bc134-5cce-4b40-a746-fe444a128444] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:44.540793 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3b40464d-b345-4191-8f09-85dea6e3d2d9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:44.542582 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3b40464d-b345-4191-8f09-85dea6e3d2d9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:44.544338 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3b40464d-b345-4191-8f09-85dea6e3d2d9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:44.544848 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-3b40464d-b345-4191-8f09-85dea6e3d2d9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:44.546554 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-a10050fe-cb10-4c59-8b3b-af56e8b288a0 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 204 len: 0 microversion: 2.25 time: 0.290560 Jul 12 12:03:44.547165 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1468/3109] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Jul 12 12:03:44 2022] DELETE /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 12:03:44.560176 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-e073078e-f074-44e3-9e9f-b3c8abd6bc42 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:44.561882 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-e073078e-f074-44e3-9e9f-b3c8abd6bc42 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] [instance: e9fce2eb-25af-411c-ab0a-761bac343671] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:44.571302 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e073078e-f074-44e3-9e9f-b3c8abd6bc42 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:44.573129 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e073078e-f074-44e3-9e9f-b3c8abd6bc42 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:44.574770 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e073078e-f074-44e3-9e9f-b3c8abd6bc42 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:44.575488 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-e073078e-f074-44e3-9e9f-b3c8abd6bc42 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:44.665267 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3b40464d-b345-4191-8f09-85dea6e3d2d9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:44.683028 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3b40464d-b345-4191-8f09-85dea6e3d2d9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:44.685256 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-3b40464d-b345-4191-8f09-85dea6e3d2d9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '173724289979423aaa08135e91b7f3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55402baffcd84d95ab9c09fc11b55fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:44.687189 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-3b40464d-b345-4191-8f09-85dea6e3d2d9 tempest-TaggedBootDevicesTest-2145814194 tempest-TaggedBootDevicesTest-2145814194-project] 10.222.0.50 "GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444" status: 200 len: 1605 microversion: 2.32 time: 0.160085 Jul 12 12:03:44.705731 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1642/3110] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:44 2022] GET /compute/v2.1/servers/759bc134-5cce-4b40-a746-fe444a128444 => generated 1605 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 12:03:44.923166 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [None req-459e107b-1f06-484a-b09f-96a408995ab8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Calling method '>' {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:44.924552 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.compute.api [None req-459e107b-1f06-484a-b09f-96a408995ab8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] [instance: 6ecb79d2-418a-40f3-bbd7-5075a19926a1] Fetching instance by UUID {{(pid=125984) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:44.948698 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-459e107b-1f06-484a-b09f-96a408995ab8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:44.949490 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-459e107b-1f06-484a-b09f-96a408995ab8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:44.953475 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-459e107b-1f06-484a-b09f-96a408995ab8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:44.956387 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [None req-459e107b-1f06-484a-b09f-96a408995ab8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:44.996690 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e073078e-f074-44e3-9e9f-b3c8abd6bc42 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:45.010929 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e073078e-f074-44e3-9e9f-b3c8abd6bc42 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:45.017021 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-e073078e-f074-44e3-9e9f-b3c8abd6bc42 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae0b32f84b7146d49338e7a2c06bc579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd5f6c853549a794c75ebff736ccf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:45.018263 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-e073078e-f074-44e3-9e9f-b3c8abd6bc42 tempest-LiveAutoBlockMigrationV225Test-2112324554 tempest-LiveAutoBlockMigrationV225Test-2112324554-project] 10.222.0.50 "GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671" status: 200 len: 1564 microversion: 2.25 time: 0.466622 Jul 12 12:03:45.018850 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1469/3111] 10.222.0.50 () {60 vars in 1276 bytes} [Tue Jul 12 12:03:44 2022] GET /compute/v2.1/servers/e9fce2eb-25af-411c-ab0a-761bac343671 => generated 1564 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 12:03:45.043332 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [None req-86f8fa43-97e0-444c-8c1f-b0ffa927de66 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Calling method '>' {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 12:03:45.043967 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.compute.api [None req-86f8fa43-97e0-444c-8c1f-b0ffa927de66 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] [instance: 3e62539f-e524-468c-9fda-8d0c665c6857] Fetching instance by UUID {{(pid=125983) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 12:03:45.046918 n-d-849104-4 devstack@n-api.service[125983]: DEBUG dbcounter [-] [125983] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 12:03:45.076610 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-86f8fa43-97e0-444c-8c1f-b0ffa927de66 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:45.077695 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-86f8fa43-97e0-444c-8c1f-b0ffa927de66 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:45.080371 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-86f8fa43-97e0-444c-8c1f-b0ffa927de66 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:45.082626 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [None req-86f8fa43-97e0-444c-8c1f-b0ffa927de66 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:45.256315 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.policy [None req-459e107b-1f06-484a-b09f-96a408995ab8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1122d2f0df264c94ab8d3ef08aff8f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b086b36480d443e799aaca3922305beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125984) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:45.271700 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [None req-459e107b-1f06-484a-b09f-96a408995ab8 tempest-ServerRescueNegativeTestJSON-364509779 tempest-ServerRescueNegativeTestJSON-364509779-project] 10.222.0.50 "GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1" status: 200 len: 1523 microversion: 2.1 time: 0.356357 Jul 12 12:03:45.273711 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1643/3112] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:44 2022] GET /compute/v2.1/servers/6ecb79d2-418a-40f3-bbd7-5075a19926a1 => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 12:03:45.595045 n-d-849104-4 devstack@n-api.service[125984]: DEBUG nova.api.openstack.wsgi [req-a08e304c-4f03-49d2-9946-1e08144a6800 req-84a838fd-3c16-4408-8257-b8c7eef8af82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e62539f-e524-468c-9fda-8d0c665c6857", "name": "network-vif-plugged", "status": "completed", "tag": "22e5c932-7cea-463d-ac7a-a1d6f70a675c"}]} {{(pid=125984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:45.598573 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.policy [None req-86f8fa43-97e0-444c-8c1f-b0ffa927de66 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7302f396799e41a28b8dec72fb3fc6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d3ca9b6340438c998a53df6dd73496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125983) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 12:03:45.606502 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [None req-86f8fa43-97e0-444c-8c1f-b0ffa927de66 tempest-ServerDiskConfigTestJSON-361222627 tempest-ServerDiskConfigTestJSON-361222627-project] 10.222.0.50 "GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857" status: 200 len: 1318 microversion: 2.1 time: 0.567325 Jul 12 12:03:45.608333 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1470/3113] 10.222.0.50 () {58 vars in 1235 bytes} [Tue Jul 12 12:03:45 2022] GET /compute/v2.1/servers/3e62539f-e524-468c-9fda-8d0c665c6857 => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 12:03:45.613699 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-a08e304c-4f03-49d2-9946-1e08144a6800 req-84a838fd-3c16-4408-8257-b8c7eef8af82 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:45.614450 n-d-849104-4 devstack@n-api.service[125984]: DEBUG oslo_concurrency.lockutils [req-a08e304c-4f03-49d2-9946-1e08144a6800 req-84a838fd-3c16-4408-8257-b8c7eef8af82 service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:45.632209 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.compute.server_external_events [req-a08e304c-4f03-49d2-9946-1e08144a6800 req-84a838fd-3c16-4408-8257-b8c7eef8af82 service nova] Creating event network-vif-plugged:22e5c932-7cea-463d-ac7a-a1d6f70a675c for instance 3e62539f-e524-468c-9fda-8d0c665c6857 on n-h2-849104-4 Jul 12 12:03:45.639496 n-d-849104-4 devstack@n-api.service[125984]: INFO nova.api.openstack.requestlog [req-a08e304c-4f03-49d2-9946-1e08144a6800 req-84a838fd-3c16-4408-8257-b8c7eef8af82 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050515 Jul 12 12:03:45.641580 n-d-849104-4 devstack@n-api.service[125984]: [pid: 125984|app: 0|req: 1644/3114] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 12:03:46.238508 n-d-849104-4 devstack@n-api.service[125983]: DEBUG nova.api.openstack.wsgi [req-99520587-fb41-41ba-8ef9-92ff3cf6497f req-3a6fa4cb-63d9-46eb-8d2b-e9e694a18cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fce2eb-25af-411c-ab0a-761bac343671", "name": "network-vif-deleted", "tag": "cf0349c7-341e-4a91-9f8c-4f3ac688bd8c"}]} {{(pid=125983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 12:03:46.248345 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-99520587-fb41-41ba-8ef9-92ff3cf6497f req-3a6fa4cb-63d9-46eb-8d2b-e9e694a18cce service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 12:03:46.248804 n-d-849104-4 devstack@n-api.service[125983]: DEBUG oslo_concurrency.lockutils [req-99520587-fb41-41ba-8ef9-92ff3cf6497f req-3a6fa4cb-63d9-46eb-8d2b-e9e694a18cce service nova] Lock "dd950407-7fc7-406c-84b0-4304624ff8c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 12:03:46.262740 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.compute.server_external_events [req-99520587-fb41-41ba-8ef9-92ff3cf6497f req-3a6fa4cb-63d9-46eb-8d2b-e9e694a18cce service nova] Creating event network-vif-deleted:cf0349c7-341e-4a91-9f8c-4f3ac688bd8c for instance e9fce2eb-25af-411c-ab0a-761bac343671 on n-h1-849104-4 Jul 12 12:03:46.268237 n-d-849104-4 devstack@n-api.service[125983]: INFO nova.api.openstack.requestlog [req-99520587-fb41-41ba-8ef9-92ff3cf6497f req-3a6fa4cb-63d9-46eb-8d2b-e9e694a18cce service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033341 Jul 12 12:03:46.269503 n-d-849104-4 devstack@n-api.service[125983]: [pid: 125983|app: 0|req: 1471/3115] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Jul 12 12:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 12:08:05.381213 n-d-849104-4 devstack@n-api.service[125983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 12:08:05.381925 n-d-849104-4 devstack@n-api.service[125983]: Tue Jul 12 12:08:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 12:09:00.612969 n-d-849104-4 devstack@n-api.service[125984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 12:09:00.613583 n-d-849104-4 devstack@n-api.service[125984]: Tue Jul 12 12:09:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 12:09:00.652622 n-d-849104-4 devstack@n-api.service[125984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 12:09:00.652793 n-d-849104-4 devstack@n-api.service[125984]: Tue Jul 12 12:09:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 12:09:01.147232 n-d-849104-4 devstack@n-api.service[125983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 12:09:01.147839 n-d-849104-4 devstack@n-api.service[125983]: Tue Jul 12 12:09:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 12:09:02.287087 n-d-849104-4 devstack@n-api.service[125984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 12:09:02.287504 n-d-849104-4 devstack@n-api.service[125984]: Tue Jul 12 12:09:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 12:09:12.423059 n-d-849104-4 devstack@n-api.service[125983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 12:09:12.423713 n-d-849104-4 devstack@n-api.service[125983]: Tue Jul 12 12:09:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!